Skip to main content
BenchLM
Data

Data as of October 14, 2026 · How the score is built

EstablishedProprietaryReasoning

Released Sep 12, 2024128K contextOpenAI o1-mini model page

o1-mini

Decision readingo1-mini is tracked, but not publicly ranked yet. The profile exposes 7 sourced benchmark rows and leaves unsupported fields blank until a published record exists.

Released Sep 12, 2024 — see all recent releases

Decision snapshot

Each value carries a field reference instead of floating alone. Markers compare this model with the current ranked and priced catalog; they are not absolute quality thresholds.

Capability

Unranked

field median 49.8Not eligible for a public rank

Price

$1.10input / $4.40 output

input median $0.80cached $0.55 · blended $2.75

Speed

Not measured

field median 90 tok/sTime to first token not measured

Context

128Ktokens

field median 256,000Maximum output length is tracked separately

Strongest published evidence

Published rows are visible, but no category has enough eligible evidence for a comparative rank.

Validate before choosing

7 published rows leave some tracked benchmark slots empty. Independent runtime speed has not been measured.

Source-linked · 7 displayable benchmark rows

Follow model changes

Category score record

Scores and ranks appear only where published evidence can be displayed. The table keeps the score, weight, cohort, and evidence state together.

Category scores, ranks, weighting, benchmark coverage, and evidence status
CategoryScore
AgenticWeight 22%0 benchmarksNot measured
Not measured
CodingWeight 20%1 benchmarkVerified
Score pending
ReasoningWeight 17%1 benchmarkVerified
Score pending
MultimodalWeight 12%0 benchmarksNot measured
Not measured
KnowledgeRank Not rankedWeight 12%3 benchmarksVerified
44.4
MultilingualWeight 7%1 benchmarkVerified
Score pending
Inst. FollowingWeight 5%0 benchmarksNot measured
Not measured
MathWeight 5%1 benchmarkVerified
Score pending

7 of 670 tracked benchmark slots have displayable evidence · bars run 0–100

Coverage details

How much of this is verified

Coverage is split by category so a strong number never hides a thin evidence base. Verified means the row is tied to a published source; provisional rows remain visible but separate.

  1. AgenticNot measured
  2. Coding1/1 verified
  3. Reasoning1/1 verified
  4. MultimodalNot measured
  5. Knowledge3/3 verified
  6. Multilingual1/1 verified
  7. Inst. FollowingNot measured
  8. Math1/1 verified
Verified sourceProvisionalNot measured

Benchmark ledger

Coding opens by default. The marker compares each value with the best source-verified result in the catalog; provisional leaders do not set the reference. Expand the remaining categories for every published row.

Coding1 row
Coding benchmark values, best verified comparison, weight, and source status
HumanEvalEvaluating Large Language Models Trained on CodeScore92.4%Versus best verified row

Best verified: o4-mini · 97.3%

Gap4.9 behindWeightDisplay only
Reasoning1 row
Reasoning benchmark values, best verified comparison, weight, and source status
DROPDiscrete Reasoning Over ParagraphsScore83.9%Versus best verified row

Best verified: o1-mini · 83.9%

GapBest verifiedWeightDisplay only
Knowledge3 rows
Knowledge benchmark values, best verified comparison, weight, and source status
GPQAGraduate-Level Google-Proof Q&AScore60%Versus best verified row

Best verified: GPT-6 Astra · 96%

Gap36 behindWeight3% ref. weight
MMLUMassive Multitask Language UnderstandingScore85.2%Versus best verified row

Best verified: o1 · 91.8%

Gap6.6 behindWeightDisplay only
SimpleQAMeasuring Short-Form Factuality in Large Language ModelsScore7.6%Versus best verified row

Best verified: GPT-4.5 · 62.5%

Gap54.9 behindWeightDisplay only
Multilingual1 row
Multilingual benchmark values, best verified comparison, weight, and source status
MGSMMultilingual Grade School MathScore89.9%Versus best verified row

Best verified: o4-mini · 93.7%

Gap3.8 behindWeightDisplay only
Math1 row
Math benchmark values, best verified comparison, weight, and source status
MATH-500MATH-500 Problem SetScore90%Versus best verified row

Best verified: Ternary Bonsai 2 27B · 98.8%

Gap8.8 behindWeightDisplay only

Bars run 0–100; the dark tick marks the best source-verified value

All 7 rows

Lineage

The sequence follows explicit supersedes links. Each score is estimated for that model; a relative can inform a sparse estimate but never sets a floor, so a newer release can score below an earlier one. Scores and prices remain blank when the corresponding public row or first-party rate is unavailable.

  1. Sep 12, 2024 · you are here

    o1-mini

    Not publicly ranked · $1.1 / $4.4

Base entry

Radar

o1-mini release history

Full release history

Radar confirmed these at the source. Use o1-mini in your work? Explore Radar to follow supported changes and choose your alerts.

Radar

Spec sheet

Each documented value carries its source. Missing fields stay visible as not sourced or not published, rather than disappearing from the page.

API model ID
Not publishedOpenAI o1-mini model documentation
Maximum output
Not sourced yet
Knowledge cutoff
Not sourced yet
Input modalities
Not sourced yet
Output modalities
Not sourced yet
Parameters
Not disclosed by the provider
Availability
Not sourced yet
Cloud regions
Not tracked yet
Lifecycle
Established
API capabilities
Tool calling, structured outputs, and batch support are not tracked yet
Prompt caching
Published at $0.55 per million cached input tokensOpenAI o1-mini model documentation
Self-host
Weights are not published
Rate limits
Not tracked yet

How to read this profile

The visual layer above carries the decisions. These notes preserve the model, ranking, coverage, and family context behind the numbers.

We track o1-mini, but the public leaderboard excludes this profile until enough non-generated benchmark coverage is available. Only published rows appear above.

o1-mini is a proprietary model with a 128K context window. It uses an explicit reasoning mode, which can improve complex problem solving while adding latency and token use.

Official exact values from OpenAI's simple-evals results table, row o1-mini. BenchLM stores mmlu, gpqa, simpleQa, humaneval, math500, mgsm, drop. Each value's source and evaluation setting is recorded in row-level source verification. Kept out of rankings because the published results cover few of the benchmarks BenchLM ranks on.

7 of 670 tracked benchmark slots currently have displayable evidence. Missing categories stay blank.

Last updated October 14, 2026. Runtime fields remain blank until a sourced snapshot exists.

Questions

How does o1-mini perform overall in AI benchmarks?

o1-mini has 7 source-displayable benchmark rows, but it does not qualify for a public overall rank. The available rows remain visible by category without being converted into a site-wide score. Missing evidence stays blank instead of being estimated from an earlier model.

Is o1-mini good for knowledge and understanding?

o1-mini has source-displayable benchmark coverage for knowledge and understanding, but the public category table does not assign it a rank there. The individual rows remain available for inspection. A missing category position means the evidence threshold was not met; it does not convert the model's unmeasured work into a zero.

Is o1-mini good for coding and programming?

o1-mini has source-displayable benchmark coverage for coding and programming, but the public category table does not assign it a rank there. The individual rows remain available for inspection. A missing category position means the evidence threshold was not met; it does not convert the model's unmeasured work into a zero.

Is o1-mini good for mathematics?

o1-mini has source-displayable benchmark coverage for mathematics, but the public category table does not assign it a rank there. The individual rows remain available for inspection. A missing category position means the evidence threshold was not met; it does not convert the model's unmeasured work into a zero.

Is o1-mini good for reasoning and logic?

o1-mini has source-displayable benchmark coverage for reasoning and logic, but the public category table does not assign it a rank there. The individual rows remain available for inspection. A missing category position means the evidence threshold was not met; it does not convert the model's unmeasured work into a zero.

Is o1-mini good for multilingual tasks?

o1-mini has source-displayable benchmark coverage for multilingual tasks, but the public category table does not assign it a rank there. The individual rows remain available for inspection. A missing category position means the evidence threshold was not met; it does not convert the model's unmeasured work into a zero.

Does o1-mini have full benchmark coverage on BenchLM?

No. o1-mini currently has 7 source-displayable rows across 670 tracked benchmark slots. The profile exposes published, non-generated evidence and leaves missing categories blank until an exact evaluation is available. Coverage describes how much was measured; it is not a penalty added to an individual benchmark result.

What is the context window size of o1-mini?

o1-mini has a documented context window of 128K. That figure is the maximum combined prompt and retained-conversation space reported for this exact model; it is not the maximum output length. The profile keeps output limits separate because providers often publish those limits independently.

Watch o1-mini in the weekly brief

Get one weekly email when material rank, price, availability, or benchmark evidence changes are worth revisiting.

Read a sample issue

Join 5,500+ readers.

Compare o1-mini with every tracked model931 comparisons