Skip to main content
Radar

Five or fewer confirmed AI changes, with original sources, on mornings when something changed.A free source-linked morning brief.

Start the free Radar Brief
Coding benchmark report

Best LLM for Coding (August 2026): SWE-bench & LiveCodeBench Ranked

Data refreshed:

Programming and software development

Claude Mythos 5 leads coding on BenchLM's August 2026 rankings with a score of 81.7, ahead of Claude Fable 5 (81.4) and GPT-5.6 Sol (79.1). Supported and Estimated labels show the evidence maturity behind each position.

Decision lens: the score determines position; Supported and Estimated labels describe the evidence behind that position without removing sparsely reported models.

Data refreshed
August 26, 2026
Ranked
144 of 403 models
Supported / Estimated
54 / 90
Weighted evidence
2 of 8 benchmarks
8 tracked benchmarks

HumanEval, SWE-bench Verified, LiveCodeBench, LiveCodeBench Pro, FLTEval, SWE-bench Pro, SWE-Rebench, SWE Multilingual, CursorBench, Multi-SWE Bench, VIBE-Pro, NL2Repo, Vibe Code Bench, React Native Evals, SWE-bench Verified*, Spider 2.0-Lite

Best Coding picks

BenchLM summaries for coding plus the practical tradeoffs users check next: open weights, price, speed, latency, and context.

How BenchLM scores these

SWE-bench Pro & LiveCodeBench Leaderboard

Primary score: BenchAlign coding score. Higher values rank first. Use the Show metric control to change the value shown in each row.

Updated Embed leaderboard

Supported positions have diverse direct evidence. Estimated positions remain ranked but carry wider uncertainty.

Filters
Supported positions have diverse direct evidence. Estimated positions remain ranked with wider uncertainty.
Rank / modelWeighted Coding
1
Claude Mythos 5Anthropic · ClosedSupported
81.7%
2
Claude Fable 5Anthropic · ClosedSupported
81.4%
3
GPT-5.6 SolOpenAI · ClosedSupported
79.1%
4
Kimi K3Moonshot AI · ClosedSupported
78.7%
5
Claude Opus 5Anthropic · ClosedSupported
78.6%
6
GPT-5.6 LunaOpenAI · ClosedSupported
73.4%
7
GPT-5.5OpenAI · ClosedSupported
72.4%
8
Claude Opus 4.8Anthropic · ClosedSupported
72.0%
9
Claude Sonnet 5Anthropic · ClosedSupported
70.6%
10
GPT-5.6 TerraOpenAI · ClosedSupported
69.2%
11
Claude Opus 4.7Anthropic · ClosedSupported
68.8%
12
Gemini 3.7 FlashGoogle · ClosedSupported
66.7%
13
Qwen3.8 MaxAlibaba · Open weightSupported
66.0%
14
Muse Spark 1.1Meta · ClosedSupported
65.8%
15
Gemini 3.6 FlashGoogle · ClosedSupported
65.4%
16
Claude Opus 4.7 (Adaptive)Anthropic · ClosedEstimated
65.3%
17
Qwen3.8-27BAlibaba · Open weightSupported
64.9%
18
GLM-5.2Z.AI · Open weightSupported
64.8%
19
Grok 4.6xAI · ClosedSupported
63.8%
20
Hy3Tencent · Open weightSupported
63.6%
21
GPT-5.3 CodexOpenAI · ClosedEstimated
63.5%
22
Muse SparkMeta · ClosedSupported
63.3%
23
Muse Spark 1.2Meta · ClosedSupported
63.1%
24
Gemini 3.5 FlashGoogle · ClosedSupported
62.2%
25
Claude Opus 4.5Anthropic · ClosedEstimated
62.1%

Top AI Models for CodingAugust 2026

As of August 2026, Claude Mythos 5 leads the BenchAlign coding leaderboard with a score of 81.7, followed by Claude Fable 5 (81.4) and GPT-5.6 Sol (79.1). BenchLM is currently showing 54 Supported and 90 Estimated models in this category.

What changed

Claude Mythos 5 ranks #1 at 81.7 with a Supported evidence label.

Claude Fable 5 ranks #2 at 81.4 with a Supported evidence label.

GPT-5.6 Sol ranks #3 at 79.1 with a Supported evidence label.

Top models by benchmark

Real-world GitHub issues from popular Python repos, human-verified subset(16% of category score)

Score in Context

What these scores mean

BenchAlign places direct benchmarks and independent external signals on a common calibrated scale. The score is relative to the current evidence universe; it is not a raw percentage from any single test.

Known limitations

Estimated rows have less diverse direct evidence and wider uncertainty. They remain ranked so a newly released model is not treated as weak merely because fewer benchmark publishers have evaluated it.

How we weight

This lens combines category-relevant external evidence with admitted benchmark protocols. Evidence sources are calibrated for difficulty before aggregation, and no generated benchmark row contributes to the score.

Leaderboards exclude benchmark rows that BenchLM generated from other scores or cloned from reference models. When a weighted benchmark is missing after that filter, the category falls back to the remaining trustworthy public rows instead of filling the gap with synthetic values.

The full scoring rules, freshness handling, and runtime/pricing caveats live on the BenchLM methodology page.

Scroll horizontally to read the full evidence ledger.

Coding benchmark weights, ranking status, and descriptions
BenchmarkWeightStatusDescription
SWE-bench Pro50%WeightedFrontier real-world SE tasks
LiveCodeBench50%WeightedContamination-free competitive programming
SWE-RebenchDisplay onlyFresh rolling-window GitHub issues
ProgramBenchDisplay onlyCleanroom full-program reconstruction
SWE-bench VerifiedDisplay onlyHistorical baseline, superseded by Pro
FLTEvalDisplay onlyLean 4 proof engineering, sparse coverage
React Native EvalsDisplay onlyFramework-specific mobile app engineering
HumanEvalDisplay onlySaturated by frontier models

About Coding Benchmarks

Python programming problems with test cases

Common questions

Which LLM is best for coding?

The model in the #1 row of the live leaderboard above is BenchLM's current best LLM for coding. Rankings are recomputed on every data refresh from a weighted blend of SWE-bench Pro (real GitHub issues) and LiveCodeBench (contamination-resistant competitive programming), so the answer box at the top of this page always names the current leader and its score rather than a snapshot that can go stale.

What is the best LLM for coding right now?

Right now the top three coding models are shown in the answer box and Top ranked panel on this page, updated with each leaderboard refresh. The current leaders separate themselves on SWE-bench Pro, the hardest widely run software engineering benchmark, where a few points of difference typically decide whether a model can resolve a multi-file GitHub issue end to end. Check the live table for today's exact ordering and scores.

What is the best free LLM for coding?

Free usually means one of two things: a free chat tier for a proprietary model, or open weights you can download and run yourself. Most frontier coding models offer rate-limited free tiers in their chat apps, while open-weight models cost nothing to self-host beyond compute. For the strongest no-cost option, start with the highest-ranked open-weight model on this leaderboard, then compare it in our best open-source LLM ranking.

What is the best open source LLM for coding?

The best open-source coding model is the highest-ranked row marked Open Weight on the leaderboard above. Open-weight models now sit within a few points of the proprietary frontier on SWE-bench Pro and LiveCodeBench, and can be self-hosted, fine-tuned, and run without per-token API pricing. Our best open-source LLM page ranks them across every category and is the fastest way to find the current open-weight leader.

How do you benchmark an LLM's coding ability?

By executing the model's code, not by grading it subjectively. SWE-bench Pro hands models real GitHub issues and counts a task solved only when the generated patch passes the repository's own test suite. LiveCodeBench scores freshly published competitive-programming problems to rule out training-data contamination. BenchLM weights those two benchmarks equally for the coding score, and tracks display-only signals such as DeepSWE, which measures long-horizon software engineering with agent harnesses.

Coding leaderboard updates

Know which model codes best — before your team picks the wrong one.

Read a sample issue

Join 2,000+ readers.

One email each week. Unsubscribe anytime.

Related