o3 vs Qwen2.5-1M

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

o3 wins overall with a score of 67 vs 66 (1 point difference).o3 wins 4 out of 4 categories.

Knowledge

o3

o3

85.3

Qwen2.5-1M

81.8

86
MMLU
84
87
GPQA
83
85
SuperGPQA
81
83
OpenBookQA
79

Coding

o3

o3

78

Qwen2.5-1M

76

78
HumanEval
76

Mathematics

o3

o3

87

Qwen2.5-1M

84

88
AIME 2023
85
90
AIME 2024
87
89
AIME 2025
86
84
HMMT Feb 2023
81
86
HMMT Feb 2024
83
85
HMMT Feb 2025
82
87
BRUMO 2025
84

Reasoning

o3

o3

83

Qwen2.5-1M

80

84
SimpleQA
81
82
MuSR
79

Frequently Asked Questions

Which is better, o3 or Qwen2.5-1M?

o3 scores higher overall with 67 vs 66, a difference of 1 points across all benchmarks.

Which is better for knowledge tasks, o3 or Qwen2.5-1M?

o3 leads in knowledge tasks with an average score of 85.3 vs 81.8.

Which is better for coding, o3 or Qwen2.5-1M?

o3 leads in coding with an average score of 78 vs 76.

Which is better for math, o3 or Qwen2.5-1M?

o3 leads in math with an average score of 87 vs 84.

Which is better for reasoning, o3 or Qwen2.5-1M?

o3 leads in reasoning with an average score of 83 vs 80.