Milestone notes
Milestone note Reached Sep 2026

ARC-AGI-3 state of the art doubles — on the held-out set

OpenAI (GPT-6 Astra), measured by ARC Prize — ARC Prize ran GPT-6 Astra on the ARC-AGI-3 Semi-Private (held-out) set and scored it 62.7% on its provider-neutral Standard harness, at about $26K of compute — roughly double the previous best, Claude Opus 5 at 30.2%. OpenAI's own launch claimed 99.9%; that figure came from a Provider Adapter harness that preserves private reasoning state and compacts long conversations, which ARC Prize also ran and confirmed at 99.9% for about $19K. Both numbers are real and they measure different things: the model plus a neutral scaffold, versus the model plus a scaffold built for it. ARC Prize records Astra as surpassing human performance on 96% of levels and building the most precise symbolic model of novel environments it has seen — and states it is not claiming AGI. This entry records the 62.7%, because the held-out third-party number is the one that is comparable across systems.

Auto-drafted from a verified measurement, then human-checked.

More on this