OpenRouter benchmark: Jev 1.13 trails Claude Opus 5 by 3.3 points on Banking77 classification, but is 13x faster and 22x cheaper

OpenRouter 实测 Jev 1.13 与 Claude Opus 5 在 Banking77 分类任务上的准确率、延迟与成本

OpenRouter tested Jev 1.13 and Claude Opus 5 on 3,080 Banking77 utterances across 77 intents. Jev hit 81.0% accuracy vs. Opus at 84.4%—a 3.3-point gap. Median latency: 175 ms for Jev, 2,266 ms for Opus. Cost per 1,000 requests: $0.11 vs. $2.42. Neither model produced malformed outputs. On compromised_card, Jev scored 95.0% while Opus got 70.0%. The post does not disclose Jev's parameter count or training details, and does not claim these results generalize to other classification tasks.