Skip to main content
BenchLM
Data

Data as of October 14, 2026 · How the score is built

EstablishedProprietaryReasoning

Released Feb 24, 2025200K contextClaude 3.7 Sonnet system card

Claude 3.7 Sonnet Thinking

Decision readingClaude 3.7 Sonnet Thinking is tracked, but not publicly ranked yet. The profile exposes 6 sourced benchmark rows and leaves unsupported fields blank until a published record exists.

Released Feb 24, 2025 — see all recent releases

Decision snapshot

Each value carries a field reference instead of floating alone. Markers compare this model with the current ranked and priced catalog; they are not absolute quality thresholds.

Capability

Unranked

field median 49.8Not eligible for a public rank

Price

Not listed

input median $0.80No comparable first-party hosted token rate

Speed

Not measured

field median 90 tok/sTime to first token not measured

Context

200Ktokens

field median 256,000Reported for this model; direct source link not stored

Strongest published evidence

Published rows are visible, but no category has enough eligible evidence for a comparative rank.

Validate before choosing

6 published rows leave some tracked benchmark slots empty. No comparable first-party API token rate is published.

Source-linked · 6 displayable benchmark rows

Follow model changes

Category score record

Scores and ranks appear only where published evidence can be displayed. The table keeps the score, weight, cohort, and evidence state together.

Category scores, ranks, weighting, benchmark coverage, and evidence status
CategoryScore
AgenticWeight 22%0 benchmarksNot measured
Not measured
CodingWeight 20%0 benchmarksNot measured
Not measured
ReasoningWeight 17%0 benchmarksNot measured
Not measured
MultimodalWeight 12%1 benchmarkVerified
Score pending
KnowledgeRank Not rankedWeight 12%2 benchmarksVerified
69.5
MultilingualWeight 7%0 benchmarksNot measured
Not measured
Inst. FollowingWeight 5%1 benchmarkVerified
Score pending
MathWeight 5%2 benchmarksVerified
Score pending

6 of 670 tracked benchmark slots have displayable evidence · bars run 0–100

Coverage details

How much of this is verified

Coverage is split by category so a strong number never hides a thin evidence base. Verified means the row is tied to a published source; provisional rows remain visible but separate.

  1. AgenticNot measured
  2. CodingNot measured
  3. ReasoningNot measured
  4. Multimodal1/1 verified
  5. Knowledge2/2 verified
  6. MultilingualNot measured
  7. Inst. Following1/1 verified
  8. Math2/2 verified
Verified sourceProvisionalNot measured

Benchmark ledger

Multimodal opens by default. The marker compares each value with the best source-verified result in the catalog; provisional leaders do not set the reference. Expand the remaining categories for every published row.

Multimodal1 row
Multimodal benchmark values, best verified comparison, weight, and source status
MMMUMassive Multi-discipline Multimodal UnderstandingScore75.0%Versus best verified row

Best verified: Qwen3.5 397B · 85.0%

Gap10 behindWeightDisplay only
Knowledge2 rows
Knowledge benchmark values, best verified comparison, weight, and source status
GPQAGraduate-Level Google-Proof Q&AScore78.2%Versus best verified row

Best verified: GPT-6 Astra · 96%

Gap17.8 behindWeight3% ref. weight
MMMLUScore86.1%Versus best verified row

Best verified: Interfaze Beta · 90.9%

Gap4.8 behindWeightDisplay only
Inst. Following1 row
Inst. Following benchmark values, best verified comparison, weight, and source status
IFEvalInstruction-Following EvalScore93.2%Versus best verified row

Best verified: LFM2.5-24B-A2B · 96.8%

Gap3.5 behindWeightDisplay only
Math2 rows
Math benchmark values, best verified comparison, weight, and source status
MATH-500MATH-500 Problem SetScore96.2%Versus best verified row

Best verified: Ternary Bonsai 2 27B · 98.8%

Gap2.6 behindWeightDisplay only
AIME 2024American Invitational Mathematics Examination 2024Score61.3%Versus best verified row

Best verified: GPT-OSS 120B · 95.8%

Gap34.5 behindWeightDisplay only

Bars run 0–100; the dark tick marks the best source-verified value

All 6 rows

Lineage

The sequence follows explicit supersedes links. Each score is estimated for that model; a relative can inform a sparse estimate but never sets a floor, so a newer release can score below an earlier one. Scores and prices remain blank when the corresponding public row or first-party rate is unavailable.

  1. Feb 24, 2025 · you are here

    Claude 3.7 Sonnet Thinking

    Not publicly ranked · Price not listed

Radar

Claude 3.7 Sonnet Thinking release history

Full release history

Radar confirmed these at the source. Use Claude 3.7 Sonnet Thinking in your work? Explore Radar to follow supported changes and choose your alerts.

Radar

Spec sheet

Each documented value carries its source. Missing fields stay visible as not sourced or not published, rather than disappearing from the page.

API model ID
Not published
Context window
200K
Maximum output
Not sourced yet
Knowledge cutoff
Not sourced yet
Input modalities
Not sourced yet
Output modalities
Not sourced yet
Parameters
Not disclosed by the provider
Availability
Not sourced yet
Cloud regions
Not tracked yet
Lifecycle
Established
API capabilities
Tool calling, structured outputs, and batch support are not tracked yet
Prompt caching
Not documented in the pricing record
Self-host
Weights are not published
Rate limits
Not tracked yet

How to read this profile

The visual layer above carries the decisions. These notes preserve the model, ranking, coverage, and family context behind the numbers.

We track Claude 3.7 Sonnet Thinking, but the public leaderboard excludes this profile until enough non-generated benchmark coverage is available. Only published rows appear above.

Claude 3.7 Sonnet Thinking is a proprietary model with a 200K context window. It uses an explicit reasoning mode, which can improve complex problem solving while adding latency and token use.

Official exact values from Anthropic's February 24, 2025 launch table, extended thinking with a 64K token budget, without parallel test-time compute. BenchLM stores gpqa, mmmlu, math500, aime2024, ifeval, mmmu. Each value's source and evaluation setting is recorded in row-level source verification. Kept out of rankings because the published results cover few of the benchmarks BenchLM ranks on.

Claude 3.7 Sonnet Thinking sits in the Claude 3.7 Sonnet family with Claude 3.7 Sonnet. 6 of 670 tracked benchmark slots currently have displayable evidence. Missing categories stay blank.

Last updated October 14, 2026. Runtime fields remain blank until a sourced snapshot exists.

Questions

How does Claude 3.7 Sonnet Thinking perform overall in AI benchmarks?

Claude 3.7 Sonnet Thinking has 6 source-displayable benchmark rows, but it does not qualify for a public overall rank. The available rows remain visible by category without being converted into a site-wide score. Missing evidence stays blank instead of being estimated from an earlier model.

Is Claude 3.7 Sonnet Thinking good for knowledge and understanding?

Claude 3.7 Sonnet Thinking has source-displayable benchmark coverage for knowledge and understanding, but the public category table does not assign it a rank there. The individual rows remain available for inspection. A missing category position means the evidence threshold was not met; it does not convert the model's unmeasured work into a zero.

Is Claude 3.7 Sonnet Thinking good for mathematics?

Claude 3.7 Sonnet Thinking has source-displayable benchmark coverage for mathematics, but the public category table does not assign it a rank there. The individual rows remain available for inspection. A missing category position means the evidence threshold was not met; it does not convert the model's unmeasured work into a zero.

Is Claude 3.7 Sonnet Thinking good for multimodal and grounded tasks?

Claude 3.7 Sonnet Thinking has source-displayable benchmark coverage for multimodal and grounded tasks, but the public category table does not assign it a rank there. The individual rows remain available for inspection. A missing category position means the evidence threshold was not met; it does not convert the model's unmeasured work into a zero.

Is Claude 3.7 Sonnet Thinking good for instruction following?

Claude 3.7 Sonnet Thinking has source-displayable benchmark coverage for instruction following, but the public category table does not assign it a rank there. The individual rows remain available for inspection. A missing category position means the evidence threshold was not met; it does not convert the model's unmeasured work into a zero.

Which sibling models are related to Claude 3.7 Sonnet Thinking?

Claude 3.7 Sonnet Thinking belongs to the Claude 3.7 Sonnet family. Related tracked variants include Claude 3.7 Sonnet. A sibling link indicates shared lineage or a documented configuration relationship; it does not mean the variants have identical pricing, context limits, benchmark evidence, or deployment behavior. Compare before switching.

Does Claude 3.7 Sonnet Thinking have full benchmark coverage on BenchLM?

No. Claude 3.7 Sonnet Thinking currently has 6 source-displayable rows across 670 tracked benchmark slots. The profile exposes published, non-generated evidence and leaves missing categories blank until an exact evaluation is available. Coverage describes how much was measured; it is not a penalty added to an individual benchmark result.

What is the context window size of Claude 3.7 Sonnet Thinking?

Claude 3.7 Sonnet Thinking has a reported context window of 200K in the exact-model catalog record. The value stays visible, but the profile marks its source link as unavailable instead of presenting it as directly documented. Maximum output length remains separate because providers often publish a different limit.

Watch Claude 3.7 Sonnet Thinking in the weekly brief

Get one weekly email when material rank, price, availability, or benchmark evidence changes are worth revisiting.

Read a sample issue

Join 5,500+ readers.

Compare Claude 3.7 Sonnet Thinking with every tracked model931 comparisons