Skip to main content

Claude 3.5 Sonnet

AnthropicEstablishedReleased June 2024
Overall Score
Est. 42Prov. #71 of 110
Arena Elo
1214
Categories Ranked
8of 8
Price (1M tokens)
$ in / $ out
Speed
N/A
Context
200K
ProprietaryNon-Reasoning
Confidence
base

According to BenchLM.ai, Claude 3.5 Sonnet ranks #71 out of 110 models on the provisional leaderboard with an overall score of 42/100. It does not yet have enough sourced coverage for BenchLM's verified leaderboard. While not a frontier model, it offers specific advantages depending on the use case.

Claude 3.5 Sonnet is a proprietary model with a 200K token context window. It processes queries without explicit chain-of-thought reasoning, offering faster response times and lower token usage.

This profile currently has 2 of 152 tracked benchmarks. BenchLM only exposes non-generated benchmark rows publicly, so missing categories stay blank until a sourced evaluation is available.

Its strongest category is Multimodal & Grounded (#42), while its weakest is Instruction Following (#67). This performance profile makes it particularly strong for screenshots, documents, charts, and grounded multimodal workflows.

Ranking Distribution

Category rank across 8 benchmark categories — sorted by best rank

Category Performance

Scores across all benchmark categories (0-100 scale)

Category Breakdown

Agentic

#59
41.0/ 100
Weight: 22%0 benchmarks
Terminal-Bench 2.0BrowseCompOSWorld-VerifiedGAIATAU-benchWebArena

Coding

#55
42.1/ 100
Weight: 20%1 benchmark
SWE-bench VerifiedLiveCodeBenchSWE-bench ProSWE-RebenchSciCode

Reasoning

#53
49.9/ 100
Weight: 17%0 benchmarks
MuSRLongBench v2MRCRv2ARC-AGI-2

Knowledge

#62
41.3/ 100
Weight: 12%1 benchmark
GPQASuperGPQAMMLU-ProHLEFrontierScienceSimpleQA

Math

#53
50.8/ 100
Weight: 5%0 benchmarks
AIME 2025BRUMO 2025MATH-500FrontierMath

Multilingual

#43
64.5/ 100
Weight: 7%0 benchmarks
MGSMMMLU-ProX

Multimodal

#42
65.5/ 100
Weight: 12%0 benchmarks
MMMU-ProOfficeQA Pro

Inst. Following

#67
59.3/ 100
Weight: 5%0 benchmarks
IFEvalIFBench

Chatbot Arena Performance

Text Overall1214

Benchmark Details

Only benchmark rows with an attached exact-source record are shown here. Source-unverified manual rows and generated rows are hidden from model pages.

Frequently Asked Questions

How does Claude 3.5 Sonnet perform overall in AI benchmarks?

Claude 3.5 Sonnet currently ranks #71 out of 110 models on BenchLM's provisional leaderboard with an overall score of 42 (estimated). It is created by Anthropic and features a 200K context window.

Is Claude 3.5 Sonnet good for knowledge and understanding?

Claude 3.5 Sonnet ranks #62 out of 110 models in knowledge and understanding benchmarks with an average score of 41.3. There are stronger options in this category.

Is Claude 3.5 Sonnet good for coding and programming?

Claude 3.5 Sonnet ranks #55 out of 110 models in coding and programming benchmarks with an average score of 42.1. There are stronger options in this category.

Does Claude 3.5 Sonnet have full benchmark coverage on BenchLM?

Not yet. Claude 3.5 Sonnet currently has 2 published benchmark scores out of the 152 benchmarks BenchLM tracks. BenchLM only exposes non-generated public benchmark rows, so missing categories stay blank until a sourced evaluation is available.

What is the context window size of Claude 3.5 Sonnet?

Claude 3.5 Sonnet has a context window of 200K, which determines how much text it can process in a single interaction.

Last updated: April 20, 2026 · Runtime metrics stay blank until BenchLM has a sourced snapshot.

Don't miss the next GPT moment

Which models moved up, what’s new, and what it costs. One email a week, 3-min read.

Free. One email per week.