Benchmark profile
BenchCAD Vision2Code voxel IoU with tools (BenchCAD Vision2Code (tools))
Generates CadQuery code from multi-view renders with image inspection and code-execution tools.
Data verifiedBenchmark score on BenchCAD Vision2Code (tools) — July 24, 2026
BenchLM mirrors the published score view for BenchCAD Vision2Code (tools). Claude Opus 5 leads the public snapshot at 0.821. BenchLM does not use these results to rank models overall.
Benchmark score table (1 model)
ScoreAbout BenchCAD Vision2Code (tools)
Year
2026
Tasks
1,000-file Vision2Code subset
Format
Voxel IoU with tools
Difficulty
Programmatic CAD generation
Section 8.12.2 reports the five-run average on a random 1,000-file subset with max effort, a container, and image cropping.
BenchLM freshness & provenance
Version
BenchCAD Vision2Code (tools) 2026
Refresh cadence
Quarterly
Staleness state
Current
Question availability
Public benchmark set
BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.
FAQ
What does BenchCAD Vision2Code (tools) measure?
Generates CadQuery code from multi-view renders with image inspection and code-execution tools.
Which model scores highest on BenchCAD Vision2Code (tools)?
Claude Opus 5 by Anthropic currently leads with a score of 0.821 on BenchCAD Vision2Code (tools).
How many models are evaluated on BenchCAD Vision2Code (tools)?
1 AI models have been evaluated on BenchCAD Vision2Code (tools) on BenchLM.