Skip to content
OpenAI News

MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineering

OpenAI released MLE-bench, a benchmark built from 75 Kaggle competitions to measure ML engineering ability in AI agents. The best setup, o1-preview with AIDE scaffolding, reached at least Kaggle bronze-medal level on 16.9% of tasks; the benchmark code is open-source.

Why it matters: OpenAI builds MLE-bench from 75 real Kaggle competitions so agents run the full pipeline, with the best setup reaching bronze-medal level in 16.9% of contests.

Read the original ↗Export Markdown