Skip to content
Trending storyDeveloping

OpenAI details how Habitat scaled online storage past 1B ChatGPT users

1 report1 sourceupdated 1 hour ago

What happened

AI digest

On October 24, OpenAI published the second part of its Habitat online storage scaling write-up. It describes how the platform uses Azure Cosmos DB multi-tenancy to support more than 1 billion ChatGPT users, 40 geographic regions and 500PB of data. The team moved from a single multi-tenant container to single-tenant isolation, then back to a default multi-tenant setup. It also cut overhead with QoS, hot-key rate limiting and a Rust proxy.

Written by AI from the coverage · updated 1 hour ago

Coverage

Follow the reports to see the story from different sides.

Oct 24
  1. OpenAI News
    Rapidly scaling online storage to serve over 1 billion ChatGPT users (Part II)

    OpenAI 详解其在线存储平台 Habitat 如何通过 Azure Cosmos DB 多租户方案支撑超 10 亿用户、40 个地理区域和 500PB 数据。团队经历从单一多租户容器到单租户隔离、再回归默认多租户的循环,并用 QoS、热键限流与 Rust 代理降低开销。

Heat over time

Not enough continuous observations to draw a trend yet.