Skip to content
Hugging Face Blog

Model routing is simple—until you measure real cost, not sticker price

Model Routing Is Simple. Until It Isn’t.

IBM Research found that routing by model sticker price backfired in agent workloads. Across 417 AppWorld tasks, Claude Sonnet 4.6 cost $79 total vs. GPT-4.1's $155—nearly double—because Sonnet's lower cache-read pricing exploited high context reuse across steps. The post argues real cost, latency, and complexity all depend on workload-infrastructure interaction, making routing a systems optimization problem, not a classification one.

Why it matters: IBM ran 417 AppWorld tasks and found list prices misjudge cost: GPT-4.1 spent $155 total while Claude Sonnet 4.6 needed $79, a gap that comes from cache pricing when agents reread long context.

Read the original ↗Export Markdown