Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.
o1-preview wins overall with a score of 71 vs 20 (51 point difference).o1-preview wins 4 out of 4 categories.
Mistral 8x7B v0.2
26.8
o1-preview
89
Mistral 8x7B v0.2
21
o1-preview
86
Mistral 8x7B v0.2
28
o1-preview
93
Mistral 8x7B v0.2
26
o1-preview
87
o1-preview scores higher overall with 71 vs 20, a difference of 51 points across all benchmarks.
o1-preview leads in knowledge tasks with an average score of 89 vs 26.8.
o1-preview leads in coding with an average score of 86 vs 21.
o1-preview leads in math with an average score of 93 vs 28.
o1-preview leads in reasoning with an average score of 87 vs 26.