benchlm.ai

Claude Sonnet 4.6 vs Qwen2.5-1M

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

Claude Sonnet 4.6 wins overall with a score of 80 vs 66 (14 point difference).Claude Sonnet 4.6 wins 4 out of 4 categories.

Claude Sonnet 4.6

CreatorAnthropic
TypeProprietary
Context1M
Score80

Qwen2.5-1M

CreatorAlibaba
TypeOpen Weight
Context1M
Score66

Knowledge

Claude Sonnet 4.6

Claude Sonnet 4.6

96

Qwen2.5-1M

81.8

99
MMLU
84
97
GPQA
83
95
SuperGPQA
81
93
OpenBookQA
79

Coding

Claude Sonnet 4.6

Claude Sonnet 4.6

93

Qwen2.5-1M

76

93
HumanEval
76

Mathematics

Claude Sonnet 4.6

Claude Sonnet 4.6

97.1

Qwen2.5-1M

84

99
AIME 2023
85
99
AIME 2024
87
98
AIME 2025
86
95
HMMT Feb 2023
81
97
HMMT Feb 2024
83
96
HMMT Feb 2025
82
96
BRUMO 2025
84

Reasoning

Claude Sonnet 4.6

Claude Sonnet 4.6

94

Qwen2.5-1M

80

95
SimpleQA
81
93
MuSR
79

Frequently Asked Questions

Which is better, Claude Sonnet 4.6 or Qwen2.5-1M?

Claude Sonnet 4.6 scores higher overall with 80 vs 66, a difference of 14 points across all benchmarks.

Which is better for knowledge tasks, Claude Sonnet 4.6 or Qwen2.5-1M?

Claude Sonnet 4.6 leads in knowledge tasks with an average score of 96 vs 81.8.

Which is better for coding, Claude Sonnet 4.6 or Qwen2.5-1M?

Claude Sonnet 4.6 leads in coding with an average score of 93 vs 76.

Which is better for math, Claude Sonnet 4.6 or Qwen2.5-1M?

Claude Sonnet 4.6 leads in math with an average score of 97.1 vs 84.

Which is better for reasoning, Claude Sonnet 4.6 or Qwen2.5-1M?

Claude Sonnet 4.6 leads in reasoning with an average score of 94 vs 80.

Related Comparisons

Claude Sonnet 4.6 vs GPT-5.4Claude Sonnet 4.6 vs Gemini 3.1 ProClaude Sonnet 4.6 vs Claude Opus 4.6Claude Sonnet 4.6 vs GPT-5.3 CodexClaude Sonnet 4.6 vs Grok 4.1Claude Sonnet 4.6 vs GPT-5.2