Skip to content
Xinzhiyuan · WeChat

The Second Half of Agent Evaluation: Why a Live Benchmark Is Needed

Agent评测的下半场:为什么需要一个「活的」Benchmark?

Claw-Eval-Live evaluates 13 frontier models on 105 tasks, and the top model stays below a 70% pass rate, while HR tasks average only 6.8% pass rate.

Why it matters: Claw-Eval-Live ran 105 tasks across 13 frontier models; the best pass rate stayed under 70% and HR tasks averaged 6.8%, showing static benchmarks miss how agents actually perform in deployment.

Read the original ↗Export Markdown