Benchmark profile
BenchCAD Vision2Code voxel IoU without tools (BenchCAD Vision2Code (no tools))
Generates CadQuery code from multi-view renders and scores geometric similarity by voxel intersection-over-union.
Data verifiedBenchmark score on BenchCAD Vision2Code (no tools) — July 24, 2026
BenchLM mirrors the published score view for BenchCAD Vision2Code (no tools). Claude Opus 5 leads the public snapshot at 0.366. BenchLM does not use these results to rank models overall.
Benchmark score table (1 model)
ScoreAbout BenchCAD Vision2Code (no tools)
Year
2026
Tasks
1,000-file Vision2Code subset
Format
Voxel IoU
Difficulty
Programmatic CAD generation
Section 8.12.2 reports the five-run average on a random 1,000-file subset with max effort and no tools. The card documents two implementation fixes already merged upstream.
BenchLM freshness & provenance
Version
BenchCAD Vision2Code (no tools) 2026
Refresh cadence
Quarterly
Staleness state
Current
Question availability
Public benchmark set
BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.
FAQ
What does BenchCAD Vision2Code (no tools) measure?
Generates CadQuery code from multi-view renders and scores geometric similarity by voxel intersection-over-union.
Which model scores highest on BenchCAD Vision2Code (no tools)?
Claude Opus 5 by Anthropic currently leads with a score of 0.366 on BenchCAD Vision2Code (no tools).
How many models are evaluated on BenchCAD Vision2Code (no tools)?
1 AI models have been evaluated on BenchCAD Vision2Code (no tools) on BenchLM.