Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.
o3 wins overall with a score of 67 vs 48 (19 point difference).o3 wins 4 out of 4 categories.
Llama 3 70B
56.5
o3
85.3
Llama 3 70B
50
o3
78
Llama 3 70B
57
o3
87
Llama 3 70B
55
o3
83
o3 scores higher overall with 67 vs 48, a difference of 19 points across all benchmarks.
o3 leads in knowledge tasks with an average score of 85.3 vs 56.5.
o3 leads in coding with an average score of 78 vs 50.
o3 leads in math with an average score of 87 vs 57.
o3 leads in reasoning with an average score of 83 vs 55.