Lead story
Models & availability
Latest
Lead story
Models & availability
Latest
This article describes OpenAI's infrastructure techniques for scaling PostgreSQL to handle millions of queries per second for ChatGPT.
From the source
An inside look at how OpenAI scaled PostgreSQL to millions of queries per second using replicas, caching, rate limiting, and workload isolation.
openai.com