Skip to main content
benchlm.ai

o1-preview

OpenAISupersededReleased Sep 12, 2024
Overall Score
Coming soon
Arena Elo
1388
Categories Ranked
8of 8
Price (1M tokens)
$ in / $ out
Speed
N/A
Context
200K
ProprietaryReasoning
Confidence
snapshot

BenchLM is tracking o1-preview, but sourced benchmark results are not published on the site yet. This page currently shows the model metadata we can verify now, and score-level benchmark coverage will appear once public evaluations land.

o1-preview is a proprietary model with a 200K token context window. It uses explicit chain-of-thought reasoning, which typically improves performance on math and complex reasoning tasks at the cost of higher latency and token usage.

o1-preview sits inside the o1 family alongside o1, o1-pro. This profile currently has 0 sourced benchmarks on BenchLM, so the benchmark sections below are intentionally marked as coming soon.

Its strongest category is Agentic (#13), while its weakest is Instruction Following (#46). This performance profile makes it particularly useful for coding agents, browser research, and computer-use workflows.

Ranking Distribution

Category rank across 8 benchmark categories — sorted by best rank

Category Performance

Scores across all benchmark categories (0-100 scale)

Category Breakdown

Agentic

#13
80.9/ 100
Weight: 22%0 benchmarks
Terminal-Bench 2.0BrowseCompOSWorld-VerifiedGAIATAU-benchWebArena

Coding

#32
65.8/ 100
Weight: 20%0 benchmarks
SWE-bench VerifiedLiveCodeBenchSWE-bench ProSWE-RebenchSciCode

Reasoning

#18
76.0/ 100
Weight: 17%0 benchmarks
MuSRLongBench v2MRCRv2ARC-AGI-2

Knowledge

#22
79.0/ 100
Weight: 12%0 benchmarks
GPQASuperGPQAMMLU-ProHLEFrontierScienceSimpleQA

Math

#21
82.8/ 100
Weight: 5%0 benchmarks
AIME 2025BRUMO 2025MATH-500FrontierMath

Multilingual

#17
84.6/ 100
Weight: 7%0 benchmarks
MGSMMMLU-ProX

Multimodal

#37
67.5/ 100
Weight: 12%0 benchmarks
MMMU-ProOfficeQA Pro

Inst. Following

#46
69.7/ 100
Weight: 5%0 benchmarks
IFEvalIFBench

Chatbot Arena Performance

Text Overall1388CI: ±5.031,122 votes
Coding1416CI: ±9.35,123 votes
Math1385CI: ±9.64,569 votes
Instruction Following1379CI: ±6.812,782 votes
Creative Writing1364CI: ±9.84,508 votes
Multi-turn1390CI: ±9.25,871 votes
Hard Prompts1396CI: ±7.78,496 votes
Hard Prompts (English)1413CI: ±9.44,917 votes
Longer Query1381CI: ±9.64,578 votes

Benchmark Details

Only benchmark rows with an attached exact-source record are shown here. Source-unverified manual rows and generated rows are hidden from model pages.

o1 Family

snapshot · preview

Canonical Entry

o1
o1Prov. 59o1-proProv. 30

Compare This Model

See how o1-preview stacks up against similar models

o1OpenAI
Prov. 59
o1-proOpenAI
Prov. 30
GPT-5.4OpenAI
Prov. 93
GPT-5.4 ProOpenAI
Prov. 92
GPT-5.3 CodexOpenAI
Prov. 89

Frequently Asked Questions

How does o1-preview perform overall in AI benchmarks?

BenchLM is tracking o1-preview, but sourced benchmark coverage is still coming soon. We currently list its creator, model type, and context window while we wait for public benchmark results.

Which sibling models are related to o1-preview?

o1-preview belongs to the o1 family. Related variants on BenchLM include o1, o1-pro.

Does o1-preview have full benchmark coverage on BenchLM?

Not yet. o1-preview currently has 0 published benchmark scores out of the 152 benchmarks BenchLM tracks. BenchLM only exposes non-generated public benchmark rows, so missing categories stay blank until a sourced evaluation is available.

What is the context window size of o1-preview?

o1-preview has a context window of 200K, which determines how much text it can process in a single interaction.

Related Resources

More from OpenAI LLM Pricing Comparison BenchLM Methodology The AI Race Which LLM Should I Use? Benchmark Explainers
Last updated: April 20, 2026 · Runtime metrics stay blank until BenchLM has a sourced snapshot.

Don't miss the next GPT moment

Which models moved up, what’s new, and what it costs. One email a week, 3-min read.

Free. One email per week.