The Second Half of Agent Evaluation: Why a Live Benchmark Is Needed
Agent评测的下半场:为什么需要一个「活的」Benchmark?
Claw-Eval-Live evaluates 13 frontier models on 105 tasks, and the top model stays below a 70% pass rate, while HR tasks average only 6.8% pass rate.
Why it matters: Claw-Eval-Live ran 105 tasks across 13 frontier models; the best pass rate stayed under 70% and HR tasks averaged 6.8%, showing static benchmarks miss how agents actually perform in deployment.