Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.
o3 wins overall with a score of 67 vs 58 (9 point difference).o3 wins 4 out of 4 categories.
Llama 3.1 405B
68.5
o3
85.3
Llama 3.1 405B
62
o3
78
Llama 3.1 405B
69
o3
87
Llama 3.1 405B
67
o3
83
o3 scores higher overall with 67 vs 58, a difference of 9 points across all benchmarks.
o3 leads in knowledge tasks with an average score of 85.3 vs 68.5.
o3 leads in coding with an average score of 78 vs 62.
o3 leads in math with an average score of 87 vs 69.
o3 leads in reasoning with an average score of 83 vs 67.