Skip to content
OpenAI News

Learning to reason with LLMs

OpenAI released o1-preview and reported 74% single-sample accuracy on AIME 2024, versus 12% for GPT-4o. The post says o1 reached the 89th percentile on Codeforces and exceeded human PhD experts on GPQA Diamond; it attributes this to large-scale RL and gains from both train-time and test-time compute. The key signal is scaling reasoning with compute, not just pretraining a larger base model.

Why it matters: OpenAI's o1-preview scores 74% on AIME 2024 math problems against GPT-4o's 12%, rising to 83% with repeated sampling.

Read the original ↗Export Markdown