o3-pro vs Qwen2.5-1M

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

o3-pro wins overall with a score of 68 vs 66 (2 point difference).o3-pro wins 4 out of 4 categories.

Knowledge

o3-pro

o3-pro

87.3

Qwen2.5-1M

81.8

88
MMLU
84
89
GPQA
83
87
SuperGPQA
81
85
OpenBookQA
79

Coding

o3-pro

o3-pro

80

Qwen2.5-1M

76

80
HumanEval
76

Mathematics

o3-pro

o3-pro

89

Qwen2.5-1M

84

90
AIME 2023
85
92
AIME 2024
87
91
AIME 2025
86
86
HMMT Feb 2023
81
88
HMMT Feb 2024
83
87
HMMT Feb 2025
82
89
BRUMO 2025
84

Reasoning

o3-pro

o3-pro

85

Qwen2.5-1M

80

86
SimpleQA
81
84
MuSR
79

Frequently Asked Questions

Which is better, o3-pro or Qwen2.5-1M?

o3-pro scores higher overall with 68 vs 66, a difference of 2 points across all benchmarks.

Which is better for knowledge tasks, o3-pro or Qwen2.5-1M?

o3-pro leads in knowledge tasks with an average score of 87.3 vs 81.8.

Which is better for coding, o3-pro or Qwen2.5-1M?

o3-pro leads in coding with an average score of 80 vs 76.

Which is better for math, o3-pro or Qwen2.5-1M?

o3-pro leads in math with an average score of 89 vs 84.

Which is better for reasoning, o3-pro or Qwen2.5-1M?

o3-pro leads in reasoning with an average score of 85 vs 80.