Skip to main content
BenchLM

BenchCAD Vision2Code voxel IoU without tools (BenchCAD Vision2Code (no tools))

We show this table for reference; we do not rank on it.

Data verified 34 confirmed releases in the last 30 daysFollow model changes

Generates CadQuery code from multi-view renders and scores geometric similarity by voxel intersection-over-union.

Benchmark score on BenchCAD Vision2Code (no tools) — September 27, 2026

We compile the BenchCAD Vision2Code (no tools) rows from provider self-reports. Claude Opus 5.5 leads the table at 0.730, followed by Claude Opus 5 (0.366). We do not use these results to rank models overall.

1Proprietary

Claude Opus 5.5

Anthropic

0.730
Overall 86.98Context 1M
2Proprietary

Claude Opus 5

Anthropic

0.366
Overall 79.81

2 modelsMultimodal & GroundedCurrentDisplay onlyUpdated September 27, 2026

Benchmark score table (2 models)

Score
1
Claude Opus 5.5Anthropic · Closed
0.730
2
Claude Opus 5Anthropic · Closed
0.366

About BenchCAD Vision2Code (no tools)

Year

2026

Tasks

1,000-file Vision2Code subset

Format

Voxel IoU

Difficulty

Programmatic CAD generation

Section 8.12.2 reports the five-run average on a random 1,000-file subset with max effort and no tools. The card documents two implementation fixes already merged upstream.

BenchCAD: A comprehensive, industry-standard benchmark for programmatic CAD

Freshness and provenance

Version

BenchCAD Vision2Code (no tools) 2026

Refresh cadence

Quarterly

Staleness state

Current

Question availability

Public benchmark set

CurrentDisplay only

BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.

Questions

What does BenchCAD Vision2Code (no tools) measure?

Generates CadQuery code from multi-view renders and scores geometric similarity by voxel intersection-over-union.

Which model scores highest on BenchCAD Vision2Code (no tools)?

Claude Opus 5.5 by Anthropic currently leads with a score of 0.730 on BenchCAD Vision2Code (no tools).

How many models are evaluated on BenchCAD Vision2Code (no tools)?

2 AI models have been evaluated on BenchCAD Vision2Code (no tools) on BenchLM.

Compare top models on BenchCAD Vision2Code (no tools)

Claude Opus 5.5 vs Claude Opus 5
Last updated: September 27, 2026 · BenchLM version BenchCAD Vision2Code (no tools) 2026

Know when it’s worth switching models

The model to choose, the cheaper alternative, and the release we would wait on.

Read a sample issue

Join 2,000+ readers.

One email each week. Unsubscribe anytime.