BenchCAD Vision2Code voxel IoU with tools (BenchCAD Vision2Code (tools))
We show this table for reference; we do not rank on it.
Generates CadQuery code from multi-view renders with image inspection and code-execution tools.
Benchmark score on BenchCAD Vision2Code (tools) — September 27, 2026
We compile the BenchCAD Vision2Code (tools) rows from provider self-reports. Claude Opus 5.5 leads the table at 0.962, followed by GPT-6 Astra (0.959) and Claude Opus 5 (0.821). We do not use these results to rank models overall.
Claude Opus 5.5
Anthropic
GPT-6 Astra
OpenAI
Claude Opus 5
Anthropic
3 modelsMultimodal & GroundedCurrentDisplay onlyUpdated September 27, 2026
Benchmark score table (3 models)
ScoreAmong the reported BenchCAD Vision2Code (tools) rows, Claude Opus 5.5 is first at 0.962. The third row is 0.141 score units behind. The broader top-10 range is 0.141 score units, so many of the published results sit in a relatively narrow band.
3 models have been evaluated on BenchCAD Vision2Code (tools). The benchmark falls in the Multimodal & Grounded category. BenchCAD Vision2Code (tools) is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.
About BenchCAD Vision2Code (tools)
Year
2026
Tasks
1,000-file Vision2Code subset
Format
Voxel IoU with tools
Difficulty
Programmatic CAD generation
Section 8.12.2 reports the five-run average on a random 1,000-file subset with max effort, a container, and image cropping.
Freshness and provenance
Version
BenchCAD Vision2Code (tools) 2026
Refresh cadence
Quarterly
Staleness state
Current
Question availability
Public benchmark set
BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.
Questions
What does BenchCAD Vision2Code (tools) measure?
Generates CadQuery code from multi-view renders with image inspection and code-execution tools.
Which model scores highest on BenchCAD Vision2Code (tools)?
Claude Opus 5.5 by Anthropic currently leads with a score of 0.962 on BenchCAD Vision2Code (tools).
How many models are evaluated on BenchCAD Vision2Code (tools)?
3 AI models have been evaluated on BenchCAD Vision2Code (tools) on BenchLM.
Compare top models on BenchCAD Vision2Code (tools)
Know when it’s worth switching models
The model to choose, the cheaper alternative, and the release we would wait on.
Read a sample issueJoin 2,000+ readers.
One email each week. Unsubscribe anytime.