Brood War Bench: No model played beyond beginner level in StarCraft
Brood War Bench
Ben Swerdlow pitted 19 models against each other in StarCraft: Brood War. Codex Astra / xhigh went 18–0, but no model surpassed beginner level. Older models treated the RTS as turn-based and got destroyed while thinking; Grok 4.6 issued only 6 command batches in 43 minutes and never fielded a combat unit. Claude Fable earnestly climbed the tech tree but couldn't execute. Codex models favored early Probe harassment that paralyzed opponents. The post doesn't specify whether matches were pure AI vs AI or involved human input.
Why it matters: Ben Swerdlow ran 19 models and effort settings head to head in StarCraft: Brood War; Codex Astra at xhigh went 18-0, and no model played above a beginner level.