Claude, GPT and Gemini score 0% completion on ProgramBench
0%完成率!Claude、GPT、Gemini 全灭,SWE-Bench作者新作把AI圈干沉默了
ProgramBench tested Claude Opus 4.7, GPT-5.4 and Gemini 3.1 Pro, with 0% full completion on rebuilding software projects. It gives only executables and usage docs, removes source/tests, and grades behavioral equivalence via agent-driven fuzzing. The key signal is system-level engineering, not function-level code generation.
Why it matters: The author of SWE-Bench launched ProgramBench, a new benchmark that asks models to rebuild complete software projects from scratch using only executables and docs; Claude, GPT and Gemini all scored zero.