ARC-AGI-3 state of the art doubles — on the held-out set
OpenAI (GPT-6 Astra), measured by ARC Prize — ARC Prize ran GPT-6 Astra on the ARC-AGI-3 Semi-Private (held-out) set and scored it 62.7% on its provider-neutral Standard harness, at about $26K of compute — roughly double the previous best, Claude Opus 5 at 30.2%. OpenAI's own launch claimed 99.9%; that figure came from a Provider Adapter harness that preserves private reasoning state and compacts long conversations, which ARC Prize also ran and confirmed at 99.9% for about $19K. Both numbers are real and they measure different things: the model plus a neutral scaffold, versus the model plus a scaffold built for it. ARC Prize records Astra as surpassing human performance on 96% of levels and building the most precise symbolic model of novel environments it has seen — and states it is not claiming AGI. This entry records the 62.7%, because the held-out third-party number is the one that is comparable across systems.
Reader response
Reactions and comments are reader opinion — unverified, and never part of the newsroom's fact record.
Comments 0
No comments yet — be the first.