Skip to content
OpenAI News

Introducing HealthBench

OpenAI introduced HealthBench, a health AI benchmark built with 262 physicians from 60 countries and 5,000 realistic medical conversations. It includes 48,562 physician-written rubric criteria, with GPT-4.1 grading whether each criterion is met across multi-turn, multilingual, clinician and consumer scenarios. The key point for practitioners is the rubric design is physician-grounded, but the scorer is still a model rather than full human review.

Why it matters: 5000 multi-turn medical dialogues and 48562 hand-written rubric items give medical AI evaluation a public, reusable benchmark.

Read the original ↗Export Markdown