From the source
Lead story
Ask your AI
Top stories
Models & availability
Latest
Rapidly scaling online storage to serve over 1 billion ChatGPT users
Habitat storage platform now handles 70 million requests per second for 1 billion weekly users
OpenAI detailed how its online storage platform, Habitat, scaled to support over 1 billion weekly users, handling more than 70 million requests per second and serving over 500 petabytes of data.
The post explains Habitat's evolution from a Python client-side library into a standalone service, and outlines the platform's architecture, including its use of Azure Cosmos DB, caches, and other storage resources.
From the source
Habitat is the online storage platform we built so OpenAI products can quickly and reliably access needed information. Habitat now handles more than 70 million requests every second, supporting products used by over 1 billion people each week, across almost 40 geographic regions.
openai.com
Other stories
Amazon · 2 OctSweep thousands of leases for compliance using Amazon Quick and the Adjudicated Query patternAmazon · 2 OctAdd secure Web Search to Claude Desktop with Amazon Bedrock AgentCore