Qwen2.5-1M vs Z-1

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

Qwen2.5-1M wins overall with a score of 66 vs 43 (23 point difference).Qwen2.5-1M wins 4 out of 4 categories.

Knowledge

Qwen2.5-1M

Qwen2.5-1M

81.8

Z-1

49.8

84
MMLU
52
83
GPQA
51
81
SuperGPQA
49
79
OpenBookQA
47

Coding

Qwen2.5-1M

Qwen2.5-1M

76

Z-1

44

76
HumanEval
44

Mathematics

Qwen2.5-1M

Qwen2.5-1M

84

Z-1

51

85
AIME 2023
52
87
AIME 2024
54
86
AIME 2025
53
81
HMMT Feb 2023
48
83
HMMT Feb 2024
50
82
HMMT Feb 2025
49
84
BRUMO 2025
51

Reasoning

Qwen2.5-1M

Qwen2.5-1M

80

Z-1

49

81
SimpleQA
50
79
MuSR
48

Frequently Asked Questions

Which is better, Qwen2.5-1M or Z-1?

Qwen2.5-1M scores higher overall with 66 vs 43, a difference of 23 points across all benchmarks.

Which is better for knowledge tasks, Qwen2.5-1M or Z-1?

Qwen2.5-1M leads in knowledge tasks with an average score of 81.8 vs 49.8.

Which is better for coding, Qwen2.5-1M or Z-1?

Qwen2.5-1M leads in coding with an average score of 76 vs 44.

Which is better for math, Qwen2.5-1M or Z-1?

Qwen2.5-1M leads in math with an average score of 84 vs 51.

Which is better for reasoning, Qwen2.5-1M or Z-1?

Qwen2.5-1M leads in reasoning with an average score of 80 vs 49.