Hacker News front pageJul 13, 2026, 01:13 UTC+8

Ploy migrated its production AI agent from Claude Opus 4.8 to GPT-5.6: 2.2x faster, 27% cheaper

Migrating a production AI agent to GPT-5.6: 2.2x faster, 27% cheaper

Ploy's agent builds real marketing sites. For four months, no model beat Claude Opus. GPT-5.6 Sol is the first. Migration cut build time from 8 min to 3 min 42 sec, cost from $3.06 to $2.22, with a slightly higher visual score. The switch wasn't plug-and-play: eval harness, tool schemas, caching, and reasoning replay all needed rework because the stack had quietly specialized around Opus. The post doesn't disclose GPT-5.6's API pricing or context window.

Why it matters: Ploy published a same-day migration report from Claude Opus to GPT-5.6 with concrete latency and cost numbers plus engineering details — not a vendor case study. Downside: single-team experience, no failure cases or edge scenarios disclosed, so generalizability is unproven.

Read the original ↗Export Markdown

Take

This is worth reading because it's not a benchmark post—it's a production brain-transplant log. Ploy's agent builds real marketing sites, and for four months Opus was unbeatable. GPT-5.6 Sol is the first model to beat it on speed, cost, and visual quality simultaneously: builds dropped from 8 minutes to 3:42, cost from $3.06 to $2.22.

The useful bit isn't the numbers—it's the migration. Their eval harness, tool-call budgets, and caching were all tuned to Opus's sequential calling style. GPT-5.6 fans out parallel calls and blew through those budgets. Roughly a third of initial failures were harness assumptions, not model errors.

I'd discount this a bit: the post doesn't disclose GPT-5.6's API pricing or context window, so the 27% cost drop is relative to Opus pricing—if the new model costs more, that gap shrinks. Sample sizes are tiny too, just 10-11 builds. But the real value here is the concrete reminder that swapping models in production is never plug-and-play.

Source: Hacker News front page · ploy.ai
Published: Jul 13, 2026, 01:13 UTC+8 · Jul 13, 2026