Scale Labs SWE Atlas - QnA (SWE Atlas - QnA)
We show this table for reference; we do not rank on it.
A Scale Labs public leaderboard mirrored as display-only reference data. It does not affect BenchLM rankings.
Scale score on SWE Atlas - QnA — November 12, 2026 snapshot
We mirror the published scale score view for SWE Atlas - QnA. Fable 5.2 leads the public snapshot at 83.9%, followed by Qwen 3.8 Max (81.5%) and Fable 5.1 (79%). We do not use these results to rank models overall.
Fable 5.2
Anthropic
SWE Atlas - QnA
Qwen 3.8 Max
Alibaba
SWE Atlas - QnA
Fable 5.1
Anthropic
SWE Atlas - QnA
28 modelsCodingCurrentDisplay onlyUpdated November 12, 2026 snapshot
Scale score table (28 models)
| Rank | Model / configuration | Score | Parameters (B) | Open / closed |
|---|---|---|---|---|
| 1 | Fable 5.2AnthropicSWE Atlas - QnA | 83.9% | Not reported | Unknown |
| 2 | Qwen 3.8 MaxAlibabaSWE Atlas - QnA | 81.5% | Not reported | Unknown |
| 3 | Fable 5.1AnthropicSWE Atlas - QnA | 79% | Not reported | Unknown |
| 4 | Opus 5.5AnthropicSWE Atlas - QnA | 77.4% | Not reported | Unknown |
| 5 | Inkling 2 SmallThinking Machines LabSWE Atlas - QnA | 74.2% | Not reported | Closed |
| 6 | Sonnet 5.5AnthropicSWE Atlas - QnA | 74.2% | Not reported | Unknown |
| 7 | Gemini 4 CarbonGoogleSWE Atlas - QnA | 73.4% | Not reported | Closed |
| 8 | Grok 4.7xAISWE Atlas - QnA | 73.4% | Not reported | Closed |
| 9 | Muse Wonder 1.0MetaSWE Atlas - QnA | 73.4% | Not reported | Unknown |
| 10 | DeepSeek V4.1 Flash 1017DeepSeekSWE Atlas - QnA | 71% | Not reported | Open |
| 11 | GPT-6.1 SolOpenAISWE Atlas - QnA | 71% | Not reported | Closed |
| 12 | GLM-5.3Z.AISWE Atlas - QnA | 70.2% | Not reported | Open |
| 13 | GPT-6 AstraOpenAISWE Atlas - QnA | 70.2% | Not reported | Closed |
| 14 | Kimi K3.1 ProMoonshot AISWE Atlas - QnA | 70.2% | Not reported | Open |
| 15 | GLM-5.3-FlashZ.AISWE Atlas - QnA | 66.9% | Not reported | Open |
| 16 | Gemini 4 ArgonGoogleSWE Atlas - QnA | 65.3% | Not reported | Closed |
| 17 | Kimi K3Moonshot AISWE Atlas - QnA | 65.3% | Not reported | Open |
| 18 | Haiku 5.5AnthropicSWE Atlas - QnA | 62.1% | Not reported | Unknown |
| 19 | Mistral Large 4MistralSWE Atlas - QnA | 61.3% | Not reported | Open |
| 20 | Muse Ember 1.0MetaSWE Atlas - QnA | 61.3% | Not reported | Unknown |
| 21 | GPT-6.1 TerraOpenAISWE Atlas - QnA | 54% | Not reported | Closed |
| 22 | GPT-6 LunaOpenAISWE Atlas - QnA | 50.8% | Not reported | Closed |
| 23 | Muse Spark OpenMetaSWE Atlas - QnA | 50% | Not reported | Open |
| 24 | MiniMax M3MiniMaxSWE Atlas - QnA | 49.2% | Not reported | Open |
| 25 | Gemini 3.8 FlashGoogleSWE Atlas - QnA | 45.2% | Not reported | Closed |
| 26 | Nemotron 3.5 Super VLNvidiaSWE Atlas - QnA | 26.6% | Not reported | Unknown |
| 27 | Nemotron 3 UltraNVIDIASWE Atlas - QnA | 21.8% | Not reported | Open |
| 28 | GPT-OSS 120BOpenAISWE Atlas - QnA | 10.5% | Not reported | Open |
How to read this leaderboard
Compare the published configurations as complete evaluation systems. The source can combine a base model, agent scaffold, tools, budget, and inference setting in each result.
Operator receipt: 28 sourced rows are currently displayable on this page; the leading published row is Fable 5.2 at 83.9%.
Honest limit: This Scale table is display-only context, not benchmark provenance or a weighted model-only comparison.
How BenchLM shows SWE Atlas - QnA
BenchLM mirrors 28 published rows from Scale Labs’ public SWE Atlas - QnA leaderboard, captured on November 12, 2026 snapshot.
The table is display only. It is useful context for a published agent or model configuration, but it does not enter BenchLM’s overall or category rankings.
The published SWE Atlas - QnA snapshot places Fable 5.2 first at 83.9%. The third row is 4.9 points behind. The broader top-10 range is 12.9 points, so the table still separates the published systems.
28 models have been evaluated on SWE Atlas - QnA. The benchmark falls in the Coding category. We keep external benchmark mirrors separate from the weighted global scoring system, so these results remain source-specific evidence. SWE Atlas - QnA is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.
About SWE Atlas - QnA
Year
2026
Tasks
28 published rows
Format
Published Scale leaderboard score
Difficulty
External agent and model evaluation
BenchLM mirrors 28 published rows from the SWE Atlas - QnA public table captured on November 12, 2026 snapshot.
Freshness and provenance
Version
SWE Atlas - QnA 2026
Refresh cadence
Quarterly
Staleness state
Current
Question availability
Public benchmark set
BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.
Questions
What does SWE Atlas - QnA measure?
A Scale Labs public leaderboard mirrored as display-only reference data. It does not affect BenchLM rankings.
Which model leads the published SWE Atlas - QnA snapshot?
Fable 5.2 currently leads the published SWE Atlas - QnA snapshot with 83.9% scale score. BenchLM shows this benchmark for display only and does not use it in overall rankings.
How many models are evaluated on SWE Atlas - QnA?
The November 12, 2026 snapshot snapshot contains 28 AI models.
Know when it’s worth switching models
The model to choose, the cheaper alternative, and the release we would wait on.
Read a sample issueJoin 7,000+ subscribers.
One email each week. Unsubscribe anytime.