Skip to content
AI HOT (Curated Pool)

Enabling two API settings tripled GPT-5.6's ARC-AGI-3 scores

启用两项 API 设置使 GPT-5.6 在 ARC-AGI-3 基准测试得分提升三倍

GPT-5.6 Sol scored just 7.8% on ARC-AGI-3 because the official harness discarded private reasoning after each action and used rolling truncation that dropped older moves. Switching to retained reasoning and context compaction raised the public-set score from 13.3% to 38.3% while cutting output tokens by 6x. Human testers averaged about 48%. The post doesn't disclose full private-set results or whether the same settings help other models.

Why it matters: OpenAI traced GPT-5.6's low ARC-AGI-3 score to the test harness clearing thinking and truncating history, and fixing both settings tripled the score.

Read the original ↗Export Markdown