Skip to content
AI HOT (Curated Pool)

GPU rental prices doubled in six months while inference costs kept falling—efficiency is the hinge

Tomer Tunguz 解析 GPU 租金翻倍而 AI 价格下降的并行逻辑

B200 GPU rental hit $8.08/hr, doubling in six months. Meanwhile Claude Opus 5.5 runs 40% cheaper than its predecessor; OpenAI slashed Luna pricing 80% in July and another 50% in September. A benchmark that cost $0.55 18 months ago now clears for $0.0015—a 377x drop. Tunguz argues efficiency gains are offsetting hardware cost inflation, with the two curves running neck and neck for now. The post doesn't predict whether efficiency can keep outpacing GPU price hikes, but says gross profit per GPU-hour is the metric to watch.

Why it matters: Tunguz uses two opposing data points, doubling GPU rental prices and falling inference costs, to explain how hardware getting pricier and AI getting cheaper can happen at once, with efficiency as the buffer in between.

Read the original ↗Export Markdown