Blueprint-Bench 2
We show this table for reference; we do not rank on it.
An agentic spatial reasoning benchmark reported as a normalized score.
Normalized connectivity score on Blueprint-Bench 2 — September 23, 2026
We mirror the published normalized connectivity score view for Blueprint-Bench 2. GPT-6 Astra leads the public snapshot at 49.7%, followed by Claude Fable 5.1 (41.9%) and Claude Fable 5 (38.6%). We do not use these results to rank models overall.
GPT-6 Astra
OpenAI
Claude Fable 5.1
Anthropic
Claude Fable 5
Anthropic
26 modelsMultimodal & GroundedCurrentDisplay onlyUpdated September 23, 2026
Normalized connectivity score table (26 models)
ScoreHow we show Blueprint-Bench 2
We mirror Andon Labs' Blueprint-Bench 2 model table as a display-only spatial-reasoning benchmark. Each agent processes 50 apartments sequentially, examines roughly 20 interior photographs per apartment, and draws a structured floor plan.
The composite measures room connectivity, graph degree and density, room and door counts, and orientation. Scores are normalized so the random baseline is 0 and a perfect result is 100. The human result covers 12 apartments, so it stays outside the model ranking.
Snapshot
The published Blueprint-Bench 2 snapshot places GPT-6 Astra first at 49.7%. The third row is 11.1 points behind. The broader top-10 range is 18.9 points, so the table still separates the published systems.
26 models have been evaluated on Blueprint-Bench 2. The benchmark falls in the Multimodal & Grounded category. Blueprint-Bench 2 is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.
About Blueprint-Bench 2
Year
2026
Tasks
Spatial reasoning from blueprints
Format
Normalized score
Difficulty
Agentic spatial reasoning
Google reported Blueprint-Bench 2 in the Gemini 3.5 Flash launch comparison table. BenchLM stores it as a display-only multimodal and spatial-reasoning benchmark until Google publishes the full methodology page.
Freshness and provenance
Version
Blueprint-Bench 2 2026
Refresh cadence
Quarterly
Staleness state
Current
Question availability
Public benchmark set
BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.
Questions
What does Blueprint-Bench 2 measure?
An agentic spatial reasoning benchmark reported as a normalized score.
Which model leads the published Blueprint-Bench 2 snapshot?
GPT-6 Astra currently leads the published Blueprint-Bench 2 snapshot with 49.7% normalized connectivity score. BenchLM shows this benchmark for display only and does not use it in overall rankings.
How many models are evaluated on Blueprint-Bench 2?
The September 23, 2026 snapshot contains 26 AI models.
Know when it’s worth switching models
The model to choose, the cheaper alternative, and the release we would wait on.
Read a sample issueJoin 2,000+ readers.
One email each week. Unsubscribe anytime.