Rapidly scaling online storage to serve over 1 billion ChatGPT users

OpenAI 详解存储平台 Habitat 如何扩展支撑超 10 亿 ChatGPT 用户（上篇）

OpenAI's online storage platform Habitat now handles over 70 million requests per second, serving 1 billion-plus weekly users. This first post traces its evolution from a simple Python client library into a distributed system managing 500 PB of data. The team faced over 10x year-over-year growth for three years, squeezing Python's asyncio latency, feature-flag tail latency, connection pooling, and downstream flood protection before migrating parts to Rust. The database layer runs on Azure Cosmos DB. Part two will cover multi-tenancy reliability and read optimization.