o1-preview
According to BenchLM.ai, o1-preview ranks #18 out of 119 models on the provisional leaderboard with an overall score of 83/100. It does not yet have enough sourced coverage for BenchLM's verified leaderboard. This places it in the mid-tier of AI models, with strengths in specific benchmark categories.
o1-preview is a proprietary model with a 200K token context window. It uses explicit chain-of-thought reasoning, which typically improves performance on math and complex reasoning tasks at the cost of higher latency and token usage.
o1-preview sits inside the o1 family alongside o1, o1-pro. This profile currently has 2 of 225 tracked benchmarks. BenchLM only exposes non-generated benchmark rows publicly, so missing categories stay blank until a sourced evaluation is available.
Its strongest category is Agentic (#7), while its weakest is Instruction Following (#39). This performance profile makes it particularly useful for coding agents, browser research, and computer-use workflows.
Ranking Distribution
Category rank across 8 benchmark categories — sorted by best rank
Category Performance
Scores across all benchmark categories (0-100 scale)
Category Breakdown
Agentic
#7Coding
#20Reasoning
#7Knowledge
#18Math
#8Multilingual
#18Multimodal
#33Inst. Following
#39Chatbot Arena Performance
Benchmark Details
Only benchmark rows with an attached exact-source record are shown here. Source-unverified manual rows and generated rows are hidden from model pages.
Compare This Model
See how o1-preview stacks up against similar models
Frequently Asked Questions
How does o1-preview perform overall in AI benchmarks?
o1-preview currently ranks #18 out of 119 models on BenchLM's provisional leaderboard with an overall score of 83 (estimated). It is created by OpenAI and features a 200K context window.
Is o1-preview good for knowledge and understanding?
o1-preview ranks #18 out of 119 models in knowledge and understanding benchmarks with an average score of 80.1. There are stronger options in this category.
Is o1-preview good for coding and programming?
o1-preview ranks #20 out of 119 models in coding and programming benchmarks with an average score of 79.3. There are stronger options in this category.
Which sibling models are related to o1-preview?
o1-preview belongs to the o1 family. Related variants on BenchLM include o1, o1-pro.
Does o1-preview have full benchmark coverage on BenchLM?
Not yet. o1-preview currently has 2 published benchmark scores out of the 225 benchmarks BenchLM tracks. BenchLM only exposes non-generated public benchmark rows, so missing categories stay blank until a sourced evaluation is available.
What is the context window size of o1-preview?
o1-preview has a context window of 200K, which determines how much text it can process in a single interaction.
Related Resources
Don't miss the next GPT moment
Which models moved up, what’s new, and what it costs. One email a week, 3-min read.
Free. One email per week.