Qwen2.5-1M vs Qwen3.5 397B

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

Qwen2.5-1M wins overall with a score of 66 vs 65 (1 point difference).Qwen2.5-1M wins 4 out of 4 categories.

Knowledge

Qwen2.5-1M

Qwen2.5-1M

81.8

Qwen3.5 397B

80.8

84
MMLU
83
83
GPQA
82
81
SuperGPQA
80
79
OpenBookQA
78

Coding

Qwen2.5-1M

Qwen2.5-1M

76

Qwen3.5 397B

75

76
HumanEval
75

Mathematics

Qwen2.5-1M

Qwen2.5-1M

84

Qwen3.5 397B

82

85
AIME 2023
83
87
AIME 2024
85
86
AIME 2025
84
81
HMMT Feb 2023
79
83
HMMT Feb 2024
81
82
HMMT Feb 2025
80
84
BRUMO 2025
82

Reasoning

Qwen2.5-1M

Qwen2.5-1M

80

Qwen3.5 397B

79

81
SimpleQA
80
79
MuSR
78

Frequently Asked Questions

Which is better, Qwen2.5-1M or Qwen3.5 397B?

Qwen2.5-1M scores higher overall with 66 vs 65, a difference of 1 points across all benchmarks.

Which is better for knowledge tasks, Qwen2.5-1M or Qwen3.5 397B?

Qwen2.5-1M leads in knowledge tasks with an average score of 81.8 vs 80.8.

Which is better for coding, Qwen2.5-1M or Qwen3.5 397B?

Qwen2.5-1M leads in coding with an average score of 76 vs 75.

Which is better for math, Qwen2.5-1M or Qwen3.5 397B?

Qwen2.5-1M leads in math with an average score of 84 vs 82.

Which is better for reasoning, Qwen2.5-1M or Qwen3.5 397B?

Qwen2.5-1M leads in reasoning with an average score of 80 vs 79.