Skip to content
r/LocalLLaMA

GPT-6 Astra hit 98.6% on ARC AGI-3 — don't fall for the hype

On GPT-6 Astra 98.6% ARC AGI-3: don't fall for the hype

OpenAI reported GPT-6 Astra at 98.6% on ARC AGI-3, but used a proprietary harness instead of the standard one. Nvidia already hit 100% with its AVO harness, and earlier systems like Arc-Skill and VISTA also neared perfect scores. Under the standard harness, Astra drops to 66%. That's still solid, but it's not AGI. The post doesn't spell out what OpenAI's custom harness changed, so I'd discount the 98.6% figure for now.

Why it matters: A Reddit user points out OpenAI did not use the standard harness on ARC AGI-3, and notes NVIDIA hit 100% with its AVO harness, giving context for the 98.6% score.

Read the original ↗Export Markdown