Hugging Face used 1,200 people + coding agents to reproduce 2,200 ICML 2026 papers
Hugging Face ran a 19-day hackathon where 1,200+ participants used coding agents like Claude Code and Codex to reproduce claims from ICML 2026 papers. They covered 2,226 papers, roughly a third of the conference. One spotlight paper had a reviewer admitting they didn't check the proofs carefully; the reproduction later caught real issues. The core question: when agents can run experiments and write papers at scale, what role do humans play in research?
Why it matters: Hugging Face's large-scale reproduction experiment has concrete numbers and a surprising finding (a spotlight paper's proof error caught by agents), hitting all three HKR axes. Score not higher because the body only provides a title and excerpt — key data like reproduction suc...