SWE-bench Multimodal (SWE Multimodal)
We mirror this table; we do not rank on it.
A multimodal variant of SWE-bench that adds visual context such as screenshots and design mockups to software engineering issue descriptions.
Benchmark score on SWE Multimodal — September 18, 2026
We mirror the published score view for SWE Multimodal. Claude Opus 5 leads the public snapshot at 59.4%, followed by Claude Fable 5.1 (54.7%) and Claude Opus 4.8 (38.4%). We do not use these results to rank models overall.
Claude Opus 5
Anthropic
Claude Fable 5.1
Anthropic
Claude Opus 4.8
Anthropic
4 modelsCodingCurrentDisplay onlyUpdated September 18, 2026
Benchmark score table (4 models)
ScoreThe published SWE Multimodal snapshot places Claude Opus 5 first at 59.4%. The third row is 21.0 points behind. The broader top-10 range is 31.3 points, so the table still separates the published systems.
4 models have been evaluated on SWE Multimodal. The benchmark falls in the Coding category. This category carries a 20% weight in BenchLM.ai's overall scoring system. SWE Multimodal is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.
About SWE Multimodal
Year
2025
Tasks
Multimodal software engineering tasks
Format
Code patch generation with visual context
Difficulty
Frontier multimodal coding
BenchLM stores provider-reported SWE-bench Multimodal values in the coding category when the model vendor reports the benchmark as part of a software-engineering capability suite.
Freshness and provenance
Version
SWE Multimodal 2025
Refresh cadence
Quarterly
Staleness state
Current
Question availability
Public benchmark set
BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.
Questions
What does SWE Multimodal measure?
A multimodal variant of SWE-bench that adds visual context such as screenshots and design mockups to software engineering issue descriptions.
Which model scores highest on SWE Multimodal?
Claude Opus 5 by Anthropic currently leads with a score of 59.4% on SWE Multimodal.
How many models are evaluated on SWE Multimodal?
4 AI models have been evaluated on SWE Multimodal on BenchLM.
Compare top models on SWE Multimodal
Know when it’s worth switching models
The model to choose, the cheaper alternative, and the release we would wait on.
Read a sample issueJoin 2,000+ readers.
One email each week. Unsubscribe anytime.