Vals AI hosted SWE-bench view for solving production software engineering tasks.
BenchLM mirrors the public Vals AI Vals SWE-bench mirror leaderboard captured from https://www.vals.ai/benchmarks/swebench and updated by Vals on May 16, 2026. The snapshot preserves overall scores, uncertainty, latency, cost-per-test metadata, and task-level scores where Vals publishes them.
Vals SWE-bench mirror is display only on BenchLM. Vals proprietary or Vals-hosted aggregate views are useful context, but BenchLM does not use them as weighted ranking inputs or as a replacement for benchmark-native source records.
BenchLM mirrors the published vals swe-bench score view for Vals SWE-bench mirror. GPT-5.5 leads the public snapshot at 82.60% , followed by Claude Opus 4.7 (82.00%) and Gemini 3.5 Flash (78.80%). BenchLM does not use these results to rank models overall.
GPT-5.5
OpenAI
openai/gpt-5.5
Claude Opus 4.7
Anthropic
anthropic/claude-opus-4-7
Gemini 3.5 Flash
google/gemini-3.5-flash
The published Vals SWE-bench mirror snapshot is tightly clustered at the top: GPT-5.5 sits at 82.60%, while the third row is only 3.80 points behind. The broader top-10 spread is 6.20 points, so many of the published scores sit in a relatively narrow band.
48 models have been evaluated on Vals SWE-bench mirror. The benchmark falls in the External benchmark mirrors category. BenchLM tracks this category separately from its weighted global scoring system, so these results are best compared on the dedicated Korean benchmark views. Vals SWE-bench mirror is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.
Year
2026
Tasks
Software engineering issue-resolution tasks
Format
Accuracy score
Difficulty
Production software engineering
BenchLM keeps this separate from its canonical SWE-bench Verified page so Vals-hosted results remain secondary context rather than source-of-record data.
Version
Vals SWE-bench mirror 2026
Refresh cadence
Quarterly
Staleness state
Current
Question availability
Public benchmark set
BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.
Vals AI hosted SWE-bench view for solving production software engineering tasks.
GPT-5.5 currently leads the published Vals SWE-bench mirror snapshot with 82.60% vals swe-bench score. BenchLM shows this benchmark for display only and does not use it in overall rankings.
48 AI models are included in BenchLM's mirrored Vals SWE-bench mirror snapshot, based on the public leaderboard captured on May 16, 2026.
For engineers, researchers, and the plain curious — a weekly brief on new models, ranking shifts, and pricing changes.
Free. No spam. Unsubscribe anytime.