Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.
o4-mini (high) wins overall with a score of 65 vs 48 (17 point difference).o4-mini (high) wins 4 out of 4 categories.
Llama 3 70B
56.5
o4-mini (high)
80.5
Llama 3 70B
50
o4-mini (high)
74
Llama 3 70B
57
o4-mini (high)
82
Llama 3 70B
55
o4-mini (high)
79
o4-mini (high) scores higher overall with 65 vs 48, a difference of 17 points across all benchmarks.
o4-mini (high) leads in knowledge tasks with an average score of 80.5 vs 56.5.
o4-mini (high) leads in coding with an average score of 74 vs 50.
o4-mini (high) leads in math with an average score of 82 vs 57.
o4-mini (high) leads in reasoning with an average score of 79 vs 55.