Skip to content
AI HOT · Tips & opinions

Pydantic AI benchmark: code mode cuts long-task cost 58% and time 51%

Pydantic AI tested 8 models across 5,276 scored runs in an internal benchmark. Code mode cut long-task cost by 58%, time by 51%, and raised success rate by 16.0 percentage points.

Why it matters: The same tool set was run two ways, and code mode saves on long tasks while adding overhead on short ones.

Read the original ↗Export Markdown