Model profile
Data verifiedEvidence coverage
4 of 321 tracked benchmarks are published. 2 are verified and 2 provisional. 3 of 8 categories are measured.
- Published / tracked
- 4 / 321
- Verified
- 2
- Provisional
- 2
- Categories with evidence
- 3 / 8
Evidence by category
- Agentic0 benchmarksNot measured
- Coding1 benchmarkReported
- Reasoning0 benchmarksNot measured
- Knowledge1 benchmarkReported
- Math2 benchmarksVerified
- Multilingual0 benchmarksNot measured
- Multimodal0 benchmarksNot measured
- Inst. Following0 benchmarksNot measured
Claude 3.5 Sonnet ranks #132 out of 200 models on the public leaderboard with an overall score of 47.74/100. It does not yet have enough sourced coverage for BenchLM's verified leaderboard. While not a frontier model, it offers specific advantages depending on the use case.
Claude 3.5 Sonnet is a proprietary model with a 200K token context window. It processes queries without explicit chain-of-thought reasoning, offering faster response times and lower token usage.
This profile currently has 4 of 321 tracked benchmarks. BenchLM only exposes non-generated benchmark rows publicly, so missing categories stay blank until a sourced evaluation is available.
Peer position
Exact provisional scores and ranks for the closest listed peers. A score can appear before a model clears the evidence threshold for a rank, so equal scores can have different rank states.
Range 47.41–48.09
- Gemini 2.5 FlashGoogleCompare#13048.09Gemini 2.5 Flash is #130 with a score of 48.09.
- o3OpenAICompare#13147.89o3 is #131 with a score of 47.89.
- Claude 3.5 SonnetCurrent modelAnthropic#13247.74Claude 3.5 Sonnet is #132 with a score of 47.74.
- GLM-4.5-AirZ.AICompare#13347.7GLM-4.5-Air is #133 with a score of 47.7.
- Qwen3.5 FlashAlibabaCompare#13447.65Qwen3.5 Flash is #134 with a score of 47.65.
- Command A+CohereCompare#13547.51Command A+ is #135 with a score of 47.51.
- o3-miniOpenAICompare#13647.41o3-mini is #136 with a score of 47.41.
Category percentile
More
Relative position among models eligible for each sourced category. A higher percentile means a stronger position within that category's ranked cohort; 100 is highest.
Category evidence
Scores and ranks appear only where this model has published benchmark evidence. Categories without displayable source records remain not measured.
| Category | Score | Rank | Percentile | Weight | Benchmarks | Evidence |
|---|---|---|---|---|---|---|
| AgenticWeight 22%0 benchmarksNot measured | Not measured | Not ranked | Not available | 22% | 0 benchmarks | Not measured |
| CodingRank Not rankedWeight 20%1 benchmarkReported | 41.2 | Not ranked | Not available | 20% | 1 benchmark | Reported |
| ReasoningWeight 17%0 benchmarksNot measured | Not measured | Not ranked | Not available | 17% | 0 benchmarks | Not measured |
| KnowledgeRank Not rankedWeight 12%1 benchmarkReported | 39.9 | Not ranked | Not available | 12% | 1 benchmark | Reported |
| MathRank Not rankedWeight 5%2 benchmarksVerified | 25.9 | Not ranked | Not available | 5% | 2 benchmarks | Verified |
| MultilingualWeight 7%0 benchmarksNot measured | Not measured | Not ranked | Not available | 7% | 0 benchmarks | Not measured |
| MultimodalWeight 12%0 benchmarksNot measured | Not measured | Not ranked | Not available | 12% | 0 benchmarks | Not measured |
| Inst. FollowingWeight 5%0 benchmarksNot measured | Not measured | Not ranked | Not available | 5% | 0 benchmarks | Not measured |
Chatbot Arena performance
Scroll horizontally to inspect confidence intervals and vote counts.
| View | Elo | Confidence interval | Votes |
|---|---|---|---|
| Text Overall | 1214 | Not available | Not available |
Benchmark Details
Rows below have a displayable published verification record. Each source link and provenance note remains in the page HTML while its category is closed. Source-unverified manual rows and generated rows stay hidden.
Coding1 benchmark
Software Engineering Benchmark Verified
Knowledge1 benchmark
Graduate-Level Google-Proof Q&A
Math2 benchmarks
FrontierMath v2 Tiers 1-3
FrontierMath v2 Tier 4
Frequently Asked Questions
How does Claude 3.5 Sonnet perform overall in AI benchmarks?
Claude 3.5 Sonnet has 4 published benchmark scores on BenchLM, but it does not yet have enough non-generated coverage to receive a global overall rank.
Is Claude 3.5 Sonnet good for knowledge and understanding?
Claude 3.5 Sonnet has visible benchmark coverage in knowledge and understanding, but BenchLM does not currently assign it a global category rank there.
Is Claude 3.5 Sonnet good for coding and programming?
Claude 3.5 Sonnet has visible benchmark coverage in coding and programming, but BenchLM does not currently assign it a global category rank there.
Is Claude 3.5 Sonnet good for mathematics?
Claude 3.5 Sonnet has visible benchmark coverage in mathematics, but BenchLM does not currently assign it a global category rank there.
Does Claude 3.5 Sonnet have full benchmark coverage on BenchLM?
Not yet. Claude 3.5 Sonnet currently has 4 published benchmark scores out of the 321 benchmarks BenchLM tracks. BenchLM only exposes non-generated public benchmark rows, so missing categories stay blank until a sourced evaluation is available.
What is the context window size of Claude 3.5 Sonnet?
Claude 3.5 Sonnet has a published context window of 200K, which determines how much text it can process in a single interaction.
Related Resources
Choose with this week’s evidence
Join 2,000+ readers for ranking moves, new releases, pricing changes, and the evidence behind them.
Free. One email per week.