Skip to content
Hugging Face Blog

ITBench-AA: Frontier Models Score Below 50% on the First Benchmark for Agentic Enterprise IT Tasks

ITBench-AA: Frontier Models Score Below 50% on the First Benchmark for Agentic Enterprise IT Tasks — by Artificial Analysis and IBM

Artificial Analysis and IBM published the ITBench-AA title, saying frontier models scored below 50% on an enterprise IT agent task benchmark; the post does not disclose tested models, sample size, or scoring method.

Why it matters: Artificial Analysis and IBM's ITBench-AA tests site reliability engineering tasks, and the top models, Claude Opus 4.7 at 47% and GPT-5.5 at 46%, both fall short of half.

Read the original ↗Export Markdown