Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.
o3-pro wins overall with a score of 68 vs 48 (20 point difference).o3-pro wins 4 out of 4 categories.
Llama 3 70B
56.5
o3-pro
87.3
Llama 3 70B
50
o3-pro
80
Llama 3 70B
57
o3-pro
89
Llama 3 70B
55
o3-pro
85
o3-pro scores higher overall with 68 vs 48, a difference of 20 points across all benchmarks.
o3-pro leads in knowledge tasks with an average score of 87.3 vs 56.5.
o3-pro leads in coding with an average score of 80 vs 50.
o3-pro leads in math with an average score of 89 vs 57.
o3-pro leads in reasoning with an average score of 85 vs 55.