Skip to content
r/LocalLLaMA

GPT-6 Astra hit 98.6% on ARC AGI-3 — don't fall for the hype

On GPT-6 Astra 98.6% ARC AGI-3: don't fall for the hype

OpenAI reported GPT-6 Astra at 98.6% on ARC AGI-3, but used a proprietary harness instead of the standard one. Nvidia already hit 100% with its AVO harness, and earlier systems like Arc-Skill and VISTA also neared perfect scores. Under the standard harness, Astra drops to 66%. That's still solid, but it's not AGI. The post doesn't spell out what OpenAI's custom harness changed, so I'd discount the 98.6% figure for now.

Why it matters: This post dismantles OpenAI's 98.6% narrative with two numbers — Nvidia's 100% and a 66% on the standard harness — high information density and strong conflict. Not scoring higher because the source is a Reddit individual post, not an institutional review, and the body doesn't...

Read the original ↗Export Markdown