Skip to main content
BenchLM
Data

Abstraction and Reasoning Corpus for AGI v3 (ARC-AGI-3)

We show this table for reference; we do not rank on it.

Data verified

An interactive successor to ARC-AGI-2 that evaluates whether an AI agent can learn unfamiliar task mechanics through action and feedback.

Earlier track

ARC-AGI-2 evaluates static grid-puzzle reasoning. It remains a separate benchmark track, and its scores are not directly comparable with ARC-AGI-3.

View ARC-AGI-2

Semi-Private score on ARC-AGI-3 — Captured 2026-10-25

We mirror the published semi-private score view for ARC-AGI-3. GPT-6 Astra (Max) leads the public snapshot at 62.7%, followed by GPT-6 Astra (XHigh) (59.3%) and GPT-6 Astra (High) (54.8%). We do not use these results to rank models overall.

68 configurationsReasoning15% of category scoreCurrentUpdated Captured 2026-10-25

Semi-Private score table (68 configurations)

Semi-Private score results for ARC-AGI-3
RankModel / configurationScoreParameters (B)Open / closed
1GPT-6 Astra (Max)OpenAIStandard · max reasoning
62.7%
Not reportedClosed
2GPT-6 Astra (XHigh)OpenAIStandard · xhigh reasoning
59.3%
Not reportedClosed
3GPT-6 Astra (High)OpenAIStandard · high reasoning
54.8%
Not reportedClosed
4GPT-6.1 Sol (Max)OpenAIStandard · max reasoning
52.7%
Not reportedClosed
5Gemini 4 Argon (Low)GoogleStandard · low reasoning
49.8%
Not reportedClosed
6Gemini 4 Argon (Medium)GoogleStandard · medium reasoning
46.3%
Not reportedClosed
7GPT-6.1 Sol (XHigh)OpenAIStandard · xhigh reasoning
39.9%
Not reportedClosed
8GPT-6 Astra (Medium)OpenAIStandard · medium reasoning
38.6%
Not reportedClosed
9GPT-6 Astra (None)OpenAIStandard · none reasoning
35.2%
Not reportedClosed
10Claude Opus 5 (High)AnthropicStandard · high reasoning
30.2%
Not reportedClosed
11GPT-6.1 Sol (High)OpenAIStandard · high reasoning
26.7%
Not reportedClosed
12Claude Sonnet 5.5 (XHigh)AnthropicStandard · xhigh reasoning
24.3%
Not reportedUnknown
13GPT-6 Astra (Low)OpenAIStandard · low reasoning
17.5%
Not reportedClosed
14GPT-6.1 Sol (Medium)OpenAIStandard · medium reasoning
10.6%
Not reportedClosed
15Gemini 3.8 Flash (High)GoogleStandard · high reasoning
10.4%
Not reportedClosed
16GPT-5.6 Sol (Max)OpenAIStandard · max reasoning
7.8%
Not reportedClosed
17GPT-5.6 Sol (XHigh)OpenAIStandard · xhigh reasoning
7.0%
Not reportedClosed
18Gemini 3.8 Flash (Low)GoogleStandard · low reasoning
6.0%
Not reportedClosed
19GPT-6 Sol (Max)OpenAIStandard · max reasoning
4.6%
Not reportedClosed
20Gemini 3.8 Flash (Medium)GoogleStandard · medium reasoning
4.0%
Not reportedClosed
21GPT-6.1 Sol (Low)OpenAIStandard · low reasoning
3.9%
Not reportedClosed
22GPT-5.6 Sol (High)OpenAIStandard · high reasoning
2.1%
Not reportedClosed
23Grok 4.6 (XHigh)xAIStandard · xhigh reasoning
2.1%
Not reportedClosed
24Grok 4.7 (XHigh)xAIStandard · xhigh reasoning
1.8%
Not reportedClosed
25GPT-6 Sol (XHigh)OpenAIStandard · xhigh reasoning
1.8%
Not reportedClosed
26Grok 4.7 (High)xAIStandard · high reasoning
1.7%
Not reportedClosed
27Grok 4.7 (Medium)xAIStandard · medium reasoning
1.7%
Not reportedClosed
28Claude Opus 4.8 (High)AnthropicStandard · high reasoning
1.5%
Not reportedClosed
29Claude Sonnet 5.5 (High)AnthropicStandard · high reasoning
1.2%
Not reportedUnknown
30GPT-5.6 Sol (Medium)OpenAIStandard · medium reasoning
1.1%
Not reportedClosed
31GPT-6 Sol (High)OpenAIStandard · high reasoning
0.9%
Not reportedClosed
32DeepSeek V4.1 Flash (Max)DeepSeekStandard · max reasoning
0.9%
Not reportedUnknown
33GPT-5.6 Terra (Max)OpenAIStandard · max reasoning
0.8%
Not reportedClosed
34GPT-5.6 Terra (XHigh)OpenAIStandard · xhigh reasoning
0.7%
Not reportedClosed
35Anthropic Opus 4.6 (Max)AnthropicStandard · max reasoning
0.5%
Not reportedClosed
36GPT-5.6 Terra (High)OpenAIStandard · high reasoning
0.5%
Not reportedClosed
37DeepSeek V4.1 Flash (High)DeepSeekStandard · high reasoning
0.5%
Not reportedUnknown
38Claude Haiku 5.5 (Max)AnthropicStandard · max reasoning
0.5%
Not reportedClosed
39GPT-5.5 (High)OpenAIStandard · high reasoning
0.4%
Not reportedClosed
40Gemini 3.1 Pro (Preview)GoogleStandard
0.4%
Not reportedClosed
41GPT-6 Sol (Medium)OpenAIStandard · medium reasoning
0.4%
Not reportedClosed
42Claude Sonnet 5.5 (Low)AnthropicStandard · low reasoning
0.4%
Not reportedUnknown
43Claude Sonnet 5.5 (Medium)AnthropicStandard · medium reasoning
0.4%
Not reportedUnknown
44DeepSeek V4.1 Flash (Low)DeepSeekStandard · low reasoning
0.3%
Not reportedUnknown
45DeepSeek V4.1 Flash (None)DeepSeekStandard · none reasoning
0.3%
Not reportedUnknown
46GPT-5.6 Sol (Low)OpenAIStandard · low reasoning
0.3%
Not reportedClosed
47Grok 4.5 (Medium)xAIStandard · medium reasoning
0.3%
Not reportedClosed
48Grok 4.5 (High)xAIStandard · high reasoning
0.3%
Not reportedClosed
49GPT-6 Sol (None)OpenAIStandard · none reasoning
0.3%
Not reportedClosed
50Grok 4.5 (Low)xAIStandard · low reasoning
0.3%
Not reportedClosed
51Grok 4.7 (Low)xAIStandard · low reasoning
0.2%
Not reportedClosed
52GPT-5.4 (High)OpenAIStandard · high reasoning
0.2%
Not reportedClosed
53GPT-6 Luna (Medium)OpenAIStandard · medium reasoning
0.2%
Not reportedClosed
54GPT-6 Luna (High)OpenAIStandard · high reasoning
0.2%
Not reportedClosed
55GPT-5.6 Luna (Max)OpenAIStandard · max reasoning
0.2%
Not reportedClosed
56Opus 4.7 (High)AnthropicStandard · high reasoning
0.2%
Not reportedClosed
57GPT-5.6 Luna (Low)OpenAIStandard · low reasoning
0.2%
Not reportedClosed
58GPT-5.6 Luna (Medium)OpenAIStandard · medium reasoning
0.2%
Not reportedClosed
59GPT-6 Luna (XHigh)OpenAIStandard · xhigh reasoning
0.2%
Not reportedClosed
60GPT-6 Sol (Low)OpenAIStandard · low reasoning
0.1%
Not reportedClosed
61GPT-6 Luna (Max)OpenAIStandard · max reasoning
0.1%
Not reportedClosed
62GPT-5.6 Luna (High)OpenAIStandard · high reasoning
0.1%
Not reportedClosed
63Grok 4.20 (Beta Reasoning)xAIStandard
0.1%
Not reportedUnknown
64GPT-5.6 Terra (Medium)OpenAIStandard · medium reasoning
0.1%
Not reportedClosed
65GPT-6 Luna (Low)OpenAIStandard · low reasoning
0.0%
Not reportedClosed
66GPT-6 Luna (None)OpenAIStandard · none reasoning
0.0%
Not reportedClosed
67GPT-5.6 Luna (XHigh)OpenAIStandard · xhigh reasoning
0.0%
Not reportedClosed
68GPT-5.6 Terra (Low)OpenAIStandard · low reasoning
0.0%
Not reportedClosed

Standard configurations

These are ARC Prize's published Semi-Private results. Every published reasoning-effort configuration stays separate; the table does not combine efforts or evaluation splits.

Standard and Provider Adapter harnesses are separate protocols. The Provider Adapter retains opaque reasoning state and compacts long conversations. A score gap can reflect those system differences.

API issues affected Gemini 4 Argon's Standard runs: 42 of 55 games completed at low effort and 46 at medium. Scores include partial credit across all 55. The high-effort run completed 19 games and has no published score.

Model pages use the highest declared published reasoning effort within each harness, rather than selecting whichever effort scored highest. Hidden or unpublished incomplete runs are not assigned a score.

The published ARC-AGI-3 snapshot places GPT-6 Astra (Max) first at 62.7%. The third row is 7.9 points behind. The broader top-10 range is 32.6 points, so the table still separates the published systems.

68 configurations have been evaluated on ARC-AGI-3. The benchmark falls in the Reasoning category. BenchLM shows the published table for reference; the per-model scores it stores feed the ranking. The Reasoning leaderboard ranks models by a weighted category score, and ARC-AGI-3 contributes 15% of it. BenchAlign v5.8 also uses it in the overall ranking.

About ARC-AGI-3

Year

2026

Tasks

Interactive game-like tasks with hidden rules

Format

Agentic task completion under a capped evaluation budget

Difficulty

Frontier agentic reasoning

ARC-AGI-3 measures interactive reasoning rather than static grid-puzzle completion. ARC Prize reports Standard and Provider Adapter harness runs separately. The ARC-AGI-3 field stores the Standard harness result. Provider Adapter runs have a separate catalog page and score field. Both pages retain every published effort configuration.

Freshness and provenance

Version

ARC-AGI 3

Refresh cadence

Static

Staleness state

Current

Question availability

Private interactive tasks with public aggregate results

Current

BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.

Questions

What does ARC-AGI-3 measure?

An interactive successor to ARC-AGI-2 that evaluates whether an AI agent can learn unfamiliar task mechanics through action and feedback.

Which model leads the published ARC-AGI-3 snapshot?

GPT-6 Astra (Max) currently leads the published ARC-AGI-3 snapshot with 62.7% semi-private score. BenchLM shows the published table for reference; the per-model scores it stores feed the ranking.

How many models are evaluated on ARC-AGI-3?

The Captured 2026-10-25 snapshot contains 68 AI models.

Last updated: Captured 2026-10-25 · mirrored from the public benchmark leaderboard

Know when it’s worth switching models

The model to choose, the cheaper alternative, and the release we would wait on.

Read a sample issue

Join 6,100+ subscribers.

One email each week. Unsubscribe anytime.