Model profile
o4-mini (high)
Evidence coverage
2 of 321 tracked benchmarks are published. 2 are verified and 0 provisional. 1 of 8 categories are measured.
- Published / tracked
- 2 / 321
- Verified
- 2
- Provisional
- 0
- Categories with evidence
- 1 / 8
Evidence by category
- Agentic0 benchmarksNot measured
- Coding0 benchmarksNot measured
- Reasoning0 benchmarksNot measured
- Knowledge0 benchmarksNot measured
- Math2 benchmarksVerified
- Multilingual0 benchmarksNot measured
- Multimodal0 benchmarksNot measured
- Inst. Following0 benchmarksNot measured
o4-mini (high) ranks #118 out of 200 models on the public leaderboard with an overall score of 49.98/100. It does not yet have enough sourced coverage for BenchLM's verified leaderboard. While not a frontier model, it offers specific advantages depending on the use case.
o4-mini (high) is a proprietary model with a 200K token context window. It uses explicit chain-of-thought reasoning, which typically improves performance on math and complex reasoning tasks at the cost of higher latency and token usage.
This profile currently has 2 of 321 tracked benchmarks. BenchLM only exposes non-generated benchmark rows publicly, so missing categories stay blank until a sourced evaluation is available.
Peer position
Exact provisional scores and ranks for the closest listed peers. A score can appear before a model clears the evidence threshold for a rank, so equal scores can have different rank states.
Range 49.84–50.23
- Seed 1.6ByteDanceCompare#11550.23Seed 1.6 is #115 with a score of 50.23.
- GPT-OSS 120BOpenAICompare#11650.08GPT-OSS 120B is #116 with a score of 50.08.
- Nemotron 3 Super 100BNVIDIACompare#11750.08Nemotron 3 Super 100B is #117 with a score of 50.08.
- o4-mini (high)Current modelOpenAI#11849.98o4-mini (high) is #118 with a score of 49.98.
- DeepSeekMath V2DeepSeekCompare#11949.89DeepSeekMath V2 is #119 with a score of 49.89.
- Qwen2.5-1MAlibabaCompare#12049.89Qwen2.5-1M is #120 with a score of 49.89.
- Seed-2.0-LiteByteDanceCompare#12149.84Seed-2.0-Lite is #121 with a score of 49.84.
Category percentile
More
Relative position among models eligible for each sourced category. A higher percentile means a stronger position within that category's ranked cohort; 100 is highest.
Category evidence
Scores and ranks appear only where this model has published benchmark evidence. Categories without displayable source records remain not measured.
| Category | Score | Rank | Percentile | Weight | Benchmarks | Evidence |
|---|---|---|---|---|---|---|
| AgenticWeight 22%0 benchmarksNot measured | Not measured | Not ranked | Not available | 22% | 0 benchmarks | Not measured |
| CodingWeight 20%0 benchmarksNot measured | Not measured | Not ranked | Not available | 20% | 0 benchmarks | Not measured |
| ReasoningWeight 17%0 benchmarksNot measured | Not measured | Not ranked | Not available | 17% | 0 benchmarks | Not measured |
| KnowledgeWeight 12%0 benchmarksNot measured | Not measured | Not ranked | Not available | 12% | 0 benchmarks | Not measured |
| MathRank Not rankedWeight 5%2 benchmarksVerified | 43.6 | Not ranked | Not available | 5% | 2 benchmarks | Verified |
| MultilingualWeight 7%0 benchmarksNot measured | Not measured | Not ranked | Not available | 7% | 0 benchmarks | Not measured |
| MultimodalWeight 12%0 benchmarksNot measured | Not measured | Not ranked | Not available | 12% | 0 benchmarks | Not measured |
| Inst. FollowingWeight 5%0 benchmarksNot measured | Not measured | Not ranked | Not available | 5% | 0 benchmarks | Not measured |
Chatbot Arena performance
Scroll horizontally to inspect confidence intervals and vote counts.
| View | Elo | Confidence interval | Votes |
|---|---|---|---|
| Text Overall | 1258 | Not available | Not available |
Benchmark Details
Rows below have a displayable published verification record. Each source link and provenance note remains in the page HTML while its category is closed. Source-unverified manual rows and generated rows stay hidden.
Math2 benchmarks
FrontierMath v2 Tiers 1-3
FrontierMath v2 Tier 4
Frequently Asked Questions
How does o4-mini (high) perform overall in AI benchmarks?
o4-mini (high) has 2 published benchmark scores on BenchLM, but it does not yet have enough non-generated coverage to receive a global overall rank.
Is o4-mini (high) good for mathematics?
o4-mini (high) has visible benchmark coverage in mathematics, but BenchLM does not currently assign it a global category rank there.
Does o4-mini (high) have full benchmark coverage on BenchLM?
Not yet. o4-mini (high) currently has 2 published benchmark scores out of the 321 benchmarks BenchLM tracks. BenchLM only exposes non-generated public benchmark rows, so missing categories stay blank until a sourced evaluation is available.
What is the context window size of o4-mini (high)?
o4-mini (high) has a published context window of 200K, which determines how much text it can process in a single interaction.
Related Resources
Choose with this week’s evidence
Join 2,000+ readers for ranking moves, new releases, pricing changes, and the evidence behind them.
Free. One email per week.