Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.
o3-pro wins overall with a score of 68 vs 58 (10 point difference).o3-pro wins 4 out of 4 categories.
Llama 3.1 405B
68.5
o3-pro
87.3
Llama 3.1 405B
62
o3-pro
80
Llama 3.1 405B
69
o3-pro
89
Llama 3.1 405B
67
o3-pro
85
o3-pro scores higher overall with 68 vs 58, a difference of 10 points across all benchmarks.
o3-pro leads in knowledge tasks with an average score of 87.3 vs 68.5.
o3-pro leads in coding with an average score of 80 vs 62.
o3-pro leads in math with an average score of 89 vs 69.
o3-pro leads in reasoning with an average score of 85 vs 67.