SWE-Rebench
A continuously updated software engineering benchmark by Nebius using fresh GitHub issues to avoid contamination. Models are evaluated 5 times per problem under a fixed ReAct scaffolding; the Resolved Rate (best pass@1) is reported.
Data verified 33 confirmed releases in the last 30 daysSee provider release alertsClaude Opus 4.6 leads the SWE-Rebench leaderboard on BenchLM's September 2026 update with 65.3%, ahead of GLM-5 (62.8%) and GLM-5.1 (62.7%), across 13 models.
Top models on SWE-Rebench — September 15, 2026
As of September 15, 2026, Claude Opus 4.6 leads the SWE-Rebench leaderboard with 65.3% , followed by GLM-5 (62.8%) and GLM-5.1 (62.7%).
Claude Opus 4.6
Anthropic
GLM-5
Z.AI
GLM-5.1
Z.AI
13 modelsCoding10% of category scoreCurrentUpdated September 15, 2026
Leaderboard (13 models)
ScoreAccording to BenchLM.ai, Claude Opus 4.6 leads the SWE-Rebench benchmark with a score of 65.3%, followed by GLM-5 (62.8%) and GLM-5.1 (62.7%). The top models are clustered within 2.6 points, suggesting this benchmark is nearing saturation for frontier models.
13 models have been evaluated on SWE-Rebench. The benchmark falls in the Coding category. This category carries a 20% weight in BenchLM.ai's overall scoring system. Within that category, SWE-Rebench contributes 10% of the category score, so strong performance here directly affects a model's overall ranking.
About SWE-Rebench
Year
2026
Tasks
Fresh GitHub issues (rolling window)
Format
Code patch generation
Difficulty
Professional software engineering
SWE-Rebench uses a rolling window of fresh problems from real GitHub repositories, sourced after each model's release date to prevent contamination. Each model runs 5 times with a standardized 128K-context ReAct scaffold. Unlike SWE-bench Verified (2023 problems), scores reflect consistent, up-to-date difficulty.
BenchLM freshness & provenance
Version
Rolling 2026 window
Refresh cadence
Rolling
Staleness state
Current
Question availability
Rolling public issues
BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.
FAQ
What does SWE-Rebench measure?
A continuously updated software engineering benchmark by Nebius using fresh GitHub issues to avoid contamination. Models are evaluated 5 times per problem under a fixed ReAct scaffolding; the Resolved Rate (best pass@1) is reported.
Which model scores highest on SWE-Rebench?
Claude Opus 4.6 by Anthropic currently leads with a score of 65.3% on SWE-Rebench.
How many models are evaluated on SWE-Rebench?
13 AI models have been evaluated on SWE-Rebench on BenchLM.
Compare Top Models on SWE-Rebench
Know when it’s worth switching models
The model to choose, the cheaper alternative, and the release we would wait on.
Read a sample issueJoin 2,000+ readers.
One email each week. Unsubscribe anytime.