o1-preview vs Z-1

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

o1-preview wins overall with a score of 71 vs 43 (28 point difference).o1-preview wins 4 out of 4 categories.

Knowledge

o1-preview

o1-preview

89

Z-1

49.8

92
MMLU
52
90
GPQA
51
88
SuperGPQA
49
86
OpenBookQA
47

Coding

o1-preview

o1-preview

86

Z-1

44

86
HumanEval
44

Mathematics

o1-preview

o1-preview

93

Z-1

51

94
AIME 2023
52
96
AIME 2024
54
95
AIME 2025
53
90
HMMT Feb 2023
48
92
HMMT Feb 2024
50
91
HMMT Feb 2025
49
93
BRUMO 2025
51

Reasoning

o1-preview

o1-preview

87

Z-1

49

88
SimpleQA
50
86
MuSR
48

Frequently Asked Questions

Which is better, o1-preview or Z-1?

o1-preview scores higher overall with 71 vs 43, a difference of 28 points across all benchmarks.

Which is better for knowledge tasks, o1-preview or Z-1?

o1-preview leads in knowledge tasks with an average score of 89 vs 49.8.

Which is better for coding, o1-preview or Z-1?

o1-preview leads in coding with an average score of 86 vs 44.

Which is better for math, o1-preview or Z-1?

o1-preview leads in math with an average score of 93 vs 51.

Which is better for reasoning, o1-preview or Z-1?

o1-preview leads in reasoning with an average score of 87 vs 49.