Skip to main content

Model comparison

Mistral Medium 3 vs o3

Data verified

Head-to-head evidence from 14 shared benchmark results across 6 categories. Overall scores shown here use BenchLM's provisional ranking lane.

45/100
Margin
9.0pts
winning →
OpenAI
54/100
0 category wins0 category wins

Evidence parity. Mistral Medium 3 and o3 share 14 comparable benchmark results. 0 of 8 categories are comparable. 0 results are unique to Mistral Medium 3; 3 to o3.

Updated July 14, 2026
Shared results
14
Mistral Medium 3 only
0
o3 only
3
Comparable categories
0 / 8

Benchmark data for Mistral Medium 3 and o3 is coming soon on BenchLM.

Confidence note. This is a partial-evidence comparison with 14 shared benchmark results across 6 evidence categories; 0 of 8 categories currently have scoreable aggregates for both models. Treat the verdict as directional until coverage is more balanced.

Why this result

BenchLM has partial data for these models, but not enough overlapping benchmark coverage to produce a fair score-level comparison yet.

o3 is priced at $2.00 input / $8.00 output per 1M tokens, versus $0.40 input / $2.00 output per 1M tokens for Mistral Medium 3. o3 has the larger context window at 200K, compared with 128K for Mistral Medium 3.

Category breakdown

Exact category averages are shown below. Not measured means BenchLM does not have enough sourced public coverage for that model and category.

Category scores and score margins for Mistral Medium 3 and o3
CategoryMistral Medium 3Δo3
MathMistral Medium 3Not measuredMarginNo overlapo314.5

Operational comparison

Runtime and commercial metrics are compared only when both models have a complete sourced value.

MetricMistral Medium 3o3Comparison
Input / output priceUSD per 1M tokensMistral Medium 3$0.4 input / $2 outputo3$2 input / $8 outputMistral Medium 3 has the lower combined listed price.
Generation speedtokens per secondMistral Medium 357 tok/so3118 tok/so3 has the higher measured throughput.
First-answer latencyseconds to first tokenMistral Medium 31.20 so35.38 sMistral Medium 3 reaches the first token sooner.
Context windowmaximum listed tokensMistral Medium 3128Ko3200Ko3 lists the larger context window.

Benchmark Deep Dive

Agentic
BenchmarkMistral Medium 3o3Result
Tau2-TelecomSource 24.3%80.7%o3 leads
Coding
BenchmarkMistral Medium 3o3Result
Terminal-Bench HardSource 3.8%37.1%o3 leads
AA-SciCodeSource 33.1%41.0%o3 leads
Reasoning
BenchmarkMistral Medium 3o3Result
AA-LCRSource 28.0%69.3%o3 leads
CritPtSource 0.0%1.1%o3 leads
Knowledge
BenchmarkMistral Medium 3o3Result
Artificial Analysis Intelligence IndexSource 12.5%30.4%o3 leads
AA-GPQA DiamondSource 57.8%82.7%o3 leads
AA-HLESource 4.3%20.0%o3 leads
AA-Omniscience IndexSource -31.5%-15.3%o3 leads
AA-Omniscience AccuracySource 18.3%38.4%o3 leads
AA-Omniscience Hallucination RateSource 60.9%87.1%Mistral Medium 3 leads
Math
BenchmarkMistral Medium 3o3Result
AA MATH-500Source 99.2%Not comparable
FrontierMath v2 (Tiers 1-3)Source 18.685%Not comparable
FrontierMath v2 (Tier 4)Source 2.083%Not comparable
Multimodal
BenchmarkMistral Medium 3o3Result
AA-MMMU-ProSource 53.0%70.1%o3 leads
Design Arena WebsiteSource 11141071Mistral Medium 3 leads
Inst. Following
BenchmarkMistral Medium 3o3Result
AA-IFBenchSource 39.3%71.4%o3 leads
Frequently Asked Questions (3)

Can I compare Mistral Medium 3 and o3 on BenchLM yet?

Not fully yet. BenchLM is tracking both models, but the sourced benchmark breakdown for this comparison is still coming soon.

Why does this comparison show “coming soon”?

BenchLM only shows category winners and benchmark-level calls when we have sourced results that can be compared fairly. For these models, the public benchmark coverage is not complete enough yet.

What data is available for Mistral Medium 3 and o3 today?

Mistral Medium 3: $0.40 input / $2.00 output per 1M tokens o3: $2.00 input / $8.00 output per 1M tokens Both model pages still include creator, context window, reasoning mode, and other metadata while benchmark coverage fills in.

Related Comparisons

Last updated: July 14, 2026

The AI models change fast. We track them for you.

A weekly brief for engineers and researchers covering new models, ranking shifts, and pricing changes.

Free. No spam. Unsubscribe anytime.