Trending storyDeveloping
OpenAI details how Habitat scaled online storage past 1B ChatGPT users
1 report1 sourceupdated 1 hour ago
What happened
AI digest
On October 24, OpenAI published the second part of its Habitat online storage scaling write-up. It describes how the platform uses Azure Cosmos DB multi-tenancy to support more than 1 billion ChatGPT users, 40 geographic regions and 500PB of data. The team moved from a single multi-tenant container to single-tenant isolation, then back to a default multi-tenant setup. It also cut overhead with QoS, hot-key rate limiting and a Rust proxy.
Written by AI from the coverage · updated 1 hour ago
Coverage
Follow the reports to see the story from different sides.
Oct 24
- OpenAI NewsRapidly scaling online storage to serve over 1 billion ChatGPT users (Part II)
OpenAI 详解其在线存储平台 Habitat 如何通过 Azure Cosmos DB 多租户方案支撑超 10 亿用户、40 个地理区域和 500PB 数据。团队经历从单一多租户容器到单租户隔离、再回归默认多租户的循环,并用 QoS、热键限流与 Rust 代理降低开销。
Heat over time
Not enough continuous observations to draw a trend yet.