Benchmark profile
SWE-bench Multimodal (SWE Multimodal)
A multimodal variant of SWE-bench that adds visual context such as screenshots and design mockups to software engineering issue descriptions.
Data verifiedBenchmark score on SWE Multimodal — July 29, 2026
BenchLM mirrors the published score view for SWE Multimodal. Claude Opus 5 leads the public snapshot at 59.4% , followed by Claude Opus 4.8 (38.4%) and Claude Sonnet 5 (28.1%). BenchLM does not use these results to rank models overall.
Claude Opus 5
Anthropic
claude-opus-5
Claude Opus 4.8
Anthropic
claude-opus-4-8
Claude Sonnet 5
Anthropic
claude-sonnet-5
Benchmark score table (3 models)
ScoreThe published SWE Multimodal snapshot places Claude Opus 5 first at 59.4%. The third row is 31.3 points behind. The broader top-10 range is 31.3 points, so the table still separates the published systems.
3 models have been evaluated on SWE Multimodal. The benchmark falls in the Coding category. This category carries a 20% weight in BenchLM.ai's overall scoring system. SWE Multimodal is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.
About SWE Multimodal
Year
2025
Tasks
Multimodal software engineering tasks
Format
Code patch generation with visual context
Difficulty
Frontier multimodal coding
BenchLM stores provider-reported SWE-bench Multimodal values in the coding category when the model vendor reports the benchmark as part of a software-engineering capability suite.
BenchLM freshness & provenance
Version
SWE Multimodal 2025
Refresh cadence
Quarterly
Staleness state
Current
Question availability
Public benchmark set
BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.
FAQ
What does SWE Multimodal measure?
A multimodal variant of SWE-bench that adds visual context such as screenshots and design mockups to software engineering issue descriptions.
Which model scores highest on SWE Multimodal?
Claude Opus 5 by Anthropic currently leads with a score of 59.4% on SWE Multimodal.
How many models are evaluated on SWE Multimodal?
3 AI models have been evaluated on SWE Multimodal on BenchLM.
Compare Top Models on SWE Multimodal
Know when it’s worth switching models
The model to choose, the cheaper alternative, and the release we would wait on.
Read a sample issueJoin 2,000+ readers.
One email each week. Unsubscribe anytime.