o1-preview Benchmark Scores & Performance

Benchmark analysis of o1-preview by OpenAI across 14 tests.

Creator

OpenAI

Source Type

Proprietary

Reasoning

Reasoning

Context Window

200K

Overall Score

71#18 of 88

Knowledge Benchmarks

MMLU
92
GPQA
90
SuperGPQA
88
OpenBookQA
86

Coding Benchmarks

HumanEval
86

Mathematics Benchmarks

AIME 2023
94
AIME 2024
96
AIME 2025
95
HMMT Feb 2023
90
HMMT Feb 2024
92
HMMT Feb 2025
91
BRUMO 2025
93

Reasoning Benchmarks

SimpleQA
88
MuSR
86

Frequently Asked Questions

How does o1-preview perform overall in AI benchmarks?

o1-preview ranks #18 out of 88 models with an overall score of 71. It is created by OpenAI and features a 200K context window.

Is o1-preview good for knowledge and understanding?

o1-preview ranks #18 out of 88 models in knowledge and understanding benchmarks with an average score of 89. There are stronger options in this category.

Is o1-preview good for coding and programming?

o1-preview ranks #16 out of 88 models in coding and programming benchmarks with an average score of 86. There are stronger options in this category.

Is o1-preview good for mathematics?

o1-preview ranks #18 out of 88 models in mathematics benchmarks with an average score of 93. There are stronger options in this category.

Is o1-preview good for reasoning and logic?

o1-preview ranks #18 out of 88 models in reasoning and logic benchmarks with an average score of 87. There are stronger options in this category.

What is the context window size of o1-preview?

o1-preview has a context window of 200K tokens, which determines how much text it can process in a single interaction.