Skip to main content

Model profile

Claude 4 Sonnet

AnthropicEstablishedReleased May 2025
Data verified
Overall Score
42.79Public #158 of 200Verified #74 of 99
Arena Elo
1239
Eligible category ranks
2of 8
Price (1M tokens)
$3 in / $15 out
API pricing
Speed
40tok/s
Context
200K

Evidence coverage

16 of 321 tracked benchmarks are published. 3 are verified and 13 provisional. 6 of 8 categories are measured.

Updated July 20, 2026Methodology
Published / tracked
16 / 321
Verified
3
Provisional
13
Categories with evidence
6 / 8

Evidence by category

  • Agentic3 benchmarks
    Mixed evidence
  • Coding2 benchmarks
    Mixed evidence
  • Reasoning2 benchmarks
    Reported
  • Knowledge6 benchmarks
    Reported
  • Math0 benchmarks
    Not measured
  • Multilingual0 benchmarks
    Not measured
  • Multimodal2 benchmarks
    Reported
  • Inst. Following1 benchmark
    Reported
ProprietaryNon-Reasoning
Confidence:
Low
base

Claude 4 Sonnet ranks #158 out of 200 models on the public leaderboard with an overall score of 42.79/100. It also ranks #74 out of 99 on the verified leaderboard. While not a frontier model, it offers specific advantages depending on the use case.

Claude 4 Sonnet is a proprietary model with a 200K token context window. It processes queries without explicit chain-of-thought reasoning, offering faster response times and lower token usage.

This profile currently has 16 of 321 tracked benchmarks. BenchLM only exposes non-generated benchmark rows publicly, so missing categories stay blank until a sourced evaluation is available.

Its strongest category is Agentic (#85), while its weakest is Coding (#96). This performance profile makes it particularly useful for coding agents, browser research, and computer-use workflows.

Peer position

Exact provisional scores and ranks for the closest listed peers. A score can appear before a model clears the evidence threshold for a rank, so equal scores can have different rank states.

Range 42.0643.2

  1. Gemma 4 E4B
    Google
    #15543.2
    Gemma 4 E4B is #155 with a score of 43.2.
    Compare
  2. Mistral Medium 3
    Mistral
    #15643.2
    Mistral Medium 3 is #156 with a score of 43.2.
    Compare
  3. Sarvam 105B
    Sarvam
    #15742.97
    Sarvam 105B is #157 with a score of 42.97.
    Compare
  4. Claude 4 SonnetCurrent model
    Anthropic
    #15842.79
    Claude 4 Sonnet is #158 with a score of 42.79.
  5. GPT-OSS 20B
    OpenAI
    #15942.74
    GPT-OSS 20B is #159 with a score of 42.74.
    Compare
  6. DeepSeek R1 Distill Qwen 32B
    DeepSeek
    #16042.58
    DeepSeek R1 Distill Qwen 32B is #160 with a score of 42.58.
    Compare
  7. GPT-4.1 nano
    OpenAI
    #16142.06
    GPT-4.1 nano is #161 with a score of 42.06.
    Compare

Category percentile

More

Relative position among models eligible for each sourced category. A higher percentile means a stronger position within that category's ranked cohort; 100 is highest.

  1. Agentic29%
    Eligible cohort rank #85 of 119Category score 42.8
  2. Coding21%
    Eligible cohort rank #96 of 122Category score 43.9

Category evidence

Scores and ranks appear only where this model has published benchmark evidence. Categories without displayable source records remain not measured.

Category scores, ranks, weighting, benchmark coverage, and evidence status
CategoryScore
AgenticRank #85 of 119Percentile 29thWeight 22%3 benchmarksMixed sources42.8
CodingRank #96 of 122Percentile 21stWeight 20%2 benchmarksMixed sources43.9
ReasoningRank Not rankedWeight 17%2 benchmarksReported71.4
KnowledgeRank Not rankedWeight 12%6 benchmarksReported45.8
MathWeight 5%0 benchmarksNot measuredNot measured
MultilingualWeight 7%0 benchmarksNot measuredNot measured
MultimodalRank Not rankedWeight 12%2 benchmarksReported79.8
Inst. FollowingRank Not rankedWeight 5%1 benchmarkReported83.0

Chatbot Arena performance

Scroll horizontally to inspect confidence intervals and vote counts.

Chatbot Arena Elo, confidence interval, and vote count by evaluation view
ViewEloConfidence intervalVotes
Text Overall1239Not availableNot available

Benchmark Details

Rows below have a displayable published verification record. Each source link and provenance note remains in the page HTML while its category is closed. Source-unverified manual rows and generated rows stay hidden.

Agentic3 benchmarks
τ²-bench resultsReported

τ²-Bench Tool-Agent-User Evaluation

52.3%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
Gert LabsBenchmark exact

Gert Labs Composite Game Benchmark

39.66%Display only
Source: Gert Labs rankingsProvenance: Gert Labs reports this composite leaderboard score in the public rankings API. BenchLM scales the source gscore from 0-1 to 0-100 and stores it as a display-only agentic benchmark.
JobBenchBenchmark exact
18.4%Display only
Source: JobBench paperProvenance: JobBench reports Sonnet-4 under Claude Code on the main-set leaderboard. BenchLM stores the reported main-set score.
Coding2 benchmarks
SWE-bench VerifiedProvider exact

Software Engineering Benchmark Verified

72.7%Weighted 16%
Source: Anthropic: Introducing Claude 4Provenance: Provider exact
AA-SciCodeReported

Artificial Analysis SciCode

37.3%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
Reasoning2 benchmarks
AA-LCRReported

Artificial Analysis Long Context Reasoning

44.3%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
CritPtReported

Critical Physics Tasks

1.1%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
Knowledge6 benchmarks
Artificial Analysis Intelligence IndexReported
25.5%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
AA-GPQA DiamondReported

Artificial Analysis GPQA Diamond

68.3%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
AA-HLEReported

Artificial Analysis Humanity's Last Exam

4.0%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
AA-Omniscience IndexReported

Artificial Analysis Omniscience Index

-9.2%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
AA-Omniscience AccuracyReported

Artificial Analysis Omniscience Accuracy

22.4%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
AA-Omniscience Hallucination RateReported

Artificial Analysis Omniscience Hallucination Rate

40.8%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
Multimodal2 benchmarks
AA-MMMU-ProReported

Artificial Analysis MMMU-Pro

62.4%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
Design Arena WebsiteReported

Design Arena Website Elo

1178Display only
Source: OpenRouter model benchmarksProvenance: Display-only Design Arena Website Elo synced from OpenRouter model benchmark metadata. It is excluded from BenchLM weighted scoring.
Inst. Following1 benchmark
AA-IFBenchReported

Artificial Analysis IFBench

45.4%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.

Frequently Asked Questions

How does Claude 4 Sonnet perform overall in AI benchmarks?

Claude 4 Sonnet has 16 published benchmark scores on BenchLM, but it does not yet have enough non-generated coverage to receive a global overall rank.

Is Claude 4 Sonnet good for knowledge and understanding?

Claude 4 Sonnet has visible benchmark coverage in knowledge and understanding, but BenchLM does not currently assign it a global category rank there.

Is Claude 4 Sonnet good for coding and programming?

Claude 4 Sonnet ranks #96 out of 122 models in coding and programming benchmarks with an average score of 43.9. There are stronger options in this category.

Is Claude 4 Sonnet good for reasoning and logic?

Claude 4 Sonnet has visible benchmark coverage in reasoning and logic, but BenchLM does not currently assign it a global category rank there.

Is Claude 4 Sonnet good for agentic tool use and computer tasks?

Claude 4 Sonnet ranks #85 out of 119 models in agentic tool use and computer tasks benchmarks with an average score of 42.8. There are stronger options in this category.

Is Claude 4 Sonnet good for multimodal and grounded tasks?

Claude 4 Sonnet has visible benchmark coverage in multimodal and grounded tasks, but BenchLM does not currently assign it a global category rank there.

Is Claude 4 Sonnet good for instruction following?

Claude 4 Sonnet has visible benchmark coverage in instruction following, but BenchLM does not currently assign it a global category rank there.

Does Claude 4 Sonnet have full benchmark coverage on BenchLM?

Not yet. Claude 4 Sonnet currently has 16 published benchmark scores out of the 321 benchmarks BenchLM tracks. BenchLM only exposes non-generated public benchmark rows, so missing categories stay blank until a sourced evaluation is available.

What is the context window size of Claude 4 Sonnet?

Claude 4 Sonnet has a published context window of 200K, which determines how much text it can process in a single interaction.

Last updated: July 20, 2026 · Runtime metrics stay blank until BenchLM has a sourced snapshot.

Choose with this week’s evidence

Join 2,000+ readers for ranking moves, new releases, pricing changes, and the evidence behind them.

Free. One email per week.