Model profile
o1
Evidence coverage
16 of 321 tracked benchmarks are published. 4 are verified and 12 provisional. 6 of 8 categories are measured.
- Published / tracked
- 16 / 321
- Verified
- 4
- Provisional
- 12
- Categories with evidence
- 6 / 8
Evidence by category
- Agentic1 benchmarkReported
- Coding2 benchmarksReported
- Reasoning2 benchmarksReported
- Knowledge8 benchmarksMixed evidence
- Math1 benchmarkVerified
- Multilingual0 benchmarksNot measured
- Multimodal0 benchmarksNot measured
- Inst. Following2 benchmarksMixed evidence
o1 ranks #129 out of 200 models on the public leaderboard with an overall score of 48.1/100. It does not yet have enough sourced coverage for BenchLM's verified leaderboard. While not a frontier model, it offers specific advantages depending on the use case.
o1 is a proprietary model with a 200K token context window. It uses explicit chain-of-thought reasoning, which typically improves performance on math and complex reasoning tasks at the cost of higher latency and token usage.
o1 sits inside the o1 family alongside o1-preview, o1-pro. BenchLM links it directly to o1-preview as the earlier related model in that lineage. This profile currently has 16 of 321 tracked benchmarks. BenchLM only exposes non-generated benchmark rows publicly, so missing categories stay blank until a sourced evaluation is available.
Its strongest category is Instruction Following (#18), while its weakest is Coding (#69). This performance profile makes it a well-rounded choice across a range of tasks.
Peer position
Exact provisional scores and ranks for the closest listed peers. A score can appear before a model clears the evidence threshold for a rank, so equal scores can have different rank states.
Range 47.7–48.33
- o3-proOpenAICompare#12748.33o3-pro is #127 with a score of 48.33.
- Qwen3 MaxAlibabaCompare#12848.16Qwen3 Max is #128 with a score of 48.16.
- o1Current modelOpenAI#12948.1o1 is #129 with a score of 48.1.
- Gemini 2.5 FlashGoogleCompare#13048.09Gemini 2.5 Flash is #130 with a score of 48.09.
- o3OpenAICompare#13147.89o3 is #131 with a score of 47.89.
- Claude 3.5 SonnetAnthropicCompare#13247.74Claude 3.5 Sonnet is #132 with a score of 47.74.
- GLM-4.5-AirZ.AICompare#13347.7GLM-4.5-Air is #133 with a score of 47.7.
Category percentile
More
Relative position among models eligible for each sourced category. A higher percentile means a stronger position within that category's ranked cohort; 100 is highest.
- Inst. Following54%Eligible cohort rank #18 of 38Category score 85.4
- Coding44%Eligible cohort rank #69 of 122Category score 49.4
Category evidence
Scores and ranks appear only where this model has published benchmark evidence. Categories without displayable source records remain not measured.
| Category | Score | Rank | Percentile | Weight | Benchmarks | Evidence |
|---|---|---|---|---|---|---|
| AgenticRank Not rankedWeight 22%1 benchmarkReported | 65.6 | Not ranked | Not available | 22% | 1 benchmark | Reported |
| CodingRank #69 of 122Percentile 44thWeight 20%2 benchmarksReported | 49.4 | #69 of 122 | 44th | 20% | 2 benchmarks | Reported |
| ReasoningRank Not rankedWeight 17%2 benchmarksReported | 78.1 | Not ranked | Not available | 17% | 2 benchmarks | Reported |
| KnowledgeRank Not rankedWeight 12%8 benchmarksMixed sources | 64.4 | Not ranked | Not available | 12% | 8 benchmarks | Mixed sources |
| MathRank Not rankedWeight 5%1 benchmarkVerified | 32.8 | Not ranked | Not available | 5% | 1 benchmark | Verified |
| MultilingualWeight 7%0 benchmarksNot measured | Not measured | Not ranked | Not available | 7% | 0 benchmarks | Not measured |
| MultimodalWeight 12%0 benchmarksNot measured | Not measured | Not ranked | Not available | 12% | 0 benchmarks | Not measured |
| Inst. FollowingRank #18 of 38Percentile 54thWeight 5%2 benchmarksMixed sources | 85.4 | #18 of 38 | 54th | 5% | 2 benchmarks | Mixed sources |
Benchmark Details
Rows below have a displayable published verification record. Each source link and provenance note remains in the page HTML while its category is closed. Source-unverified manual rows and generated rows stay hidden.
Agentic1 benchmark
τ²-Bench Tool-Agent-User Evaluation
Coding2 benchmarks
Artificial Analysis Coding Index
Artificial Analysis SciCode
Reasoning2 benchmarks
Artificial Analysis Long Context Reasoning
Critical Physics Tasks
Knowledge8 benchmarks
Graduate-Level Google-Proof Q&A
Massive Multitask Language Understanding
Artificial Analysis GPQA Diamond
Artificial Analysis Humanity's Last Exam
Artificial Analysis Omniscience Index
Artificial Analysis Omniscience Accuracy
Artificial Analysis Omniscience Hallucination Rate
Math1 benchmark
FrontierMath v2 Tiers 1-3
Inst. Following2 benchmarks
Instruction-Following Eval
Artificial Analysis IFBench
Frequently Asked Questions
How does o1 perform overall in AI benchmarks?
o1 has 16 published benchmark scores on BenchLM, but it does not yet have enough non-generated coverage to receive a global overall rank.
Is o1 good for knowledge and understanding?
o1 has visible benchmark coverage in knowledge and understanding, but BenchLM does not currently assign it a global category rank there.
Is o1 good for coding and programming?
o1 ranks #69 out of 122 models in coding and programming benchmarks with an average score of 49.4. There are stronger options in this category.
Is o1 good for mathematics?
o1 has visible benchmark coverage in mathematics, but BenchLM does not currently assign it a global category rank there.
Is o1 good for reasoning and logic?
o1 has visible benchmark coverage in reasoning and logic, but BenchLM does not currently assign it a global category rank there.
Is o1 good for agentic tool use and computer tasks?
o1 has visible benchmark coverage in agentic tool use and computer tasks, but BenchLM does not currently assign it a global category rank there.
Is o1 good for instruction following?
o1 ranks #18 out of 38 models in instruction following benchmarks with an average score of 85.4. There are stronger options in this category.
Which sibling models are related to o1?
o1 belongs to the o1 family. Related variants on BenchLM include o1-preview, o1-pro.
Does o1 have full benchmark coverage on BenchLM?
Not yet. o1 currently has 16 published benchmark scores out of the 321 benchmarks BenchLM tracks. BenchLM only exposes non-generated public benchmark rows, so missing categories stay blank until a sourced evaluation is available.
What is the context window size of o1?
o1 has a published context window of 200K, which determines how much text it can process in a single interaction.
Related Resources
Choose with this week’s evidence
Join 2,000+ readers for ranking moves, new releases, pricing changes, and the evidence behind them.
Free. One email per week.