benchlm.ai

Qwen2.5-1M vs Qwen3.5 397B (Reasoning)

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

Qwen3.5 397B (Reasoning) wins overall with a score of 70 vs 66 (4 point difference).Qwen3.5 397B (Reasoning) wins 4 out of 4 categories.

Qwen2.5-1M

CreatorAlibaba
TypeOpen Weight
Context1M
Score66

Qwen3.5 397B (Reasoning)

CreatorAlibaba
TypeOpen Weight
Context128K
Score70

Knowledge

Qwen3.5 397B (Reasoning)

Qwen2.5-1M

81.8

Qwen3.5 397B (Reasoning)

88

84
MMLU
91
83
GPQA
89
81
SuperGPQA
87
79
OpenBookQA
85

Coding

Qwen3.5 397B (Reasoning)

Qwen2.5-1M

76

Qwen3.5 397B (Reasoning)

83

76
HumanEval
83

Mathematics

Qwen3.5 397B (Reasoning)

Qwen2.5-1M

84

Qwen3.5 397B (Reasoning)

92

85
AIME 2023
93
87
AIME 2024
95
86
AIME 2025
94
81
HMMT Feb 2023
89
83
HMMT Feb 2024
91
82
HMMT Feb 2025
90
84
BRUMO 2025
92

Reasoning

Qwen3.5 397B (Reasoning)

Qwen2.5-1M

80

Qwen3.5 397B (Reasoning)

86

81
SimpleQA
87
79
MuSR
85

Frequently Asked Questions

Which is better, Qwen2.5-1M or Qwen3.5 397B (Reasoning)?

Qwen3.5 397B (Reasoning) scores higher overall with 70 vs 66, a difference of 4 points across all benchmarks.

Which is better for knowledge tasks, Qwen2.5-1M or Qwen3.5 397B (Reasoning)?

Qwen3.5 397B (Reasoning) leads in knowledge tasks with an average score of 88 vs 81.8.

Which is better for coding, Qwen2.5-1M or Qwen3.5 397B (Reasoning)?

Qwen3.5 397B (Reasoning) leads in coding with an average score of 83 vs 76.

Which is better for math, Qwen2.5-1M or Qwen3.5 397B (Reasoning)?

Qwen3.5 397B (Reasoning) leads in math with an average score of 92 vs 84.

Which is better for reasoning, Qwen2.5-1M or Qwen3.5 397B (Reasoning)?

Qwen3.5 397B (Reasoning) leads in reasoning with an average score of 86 vs 80.

Related Comparisons

Qwen2.5-1M vs GPT-5.4Qwen2.5-1M vs Gemini 3.1 ProQwen2.5-1M vs Claude Opus 4.6Qwen2.5-1M vs GPT-5.3 CodexQwen2.5-1M vs Grok 4.1Qwen2.5-1M vs GPT-5.2