GPT-5.4 Pro vs Mistral Medium 3

Side-by-side benchmark comparison across agentic, coding, multimodal, knowledge, reasoning, and math workflows.

Benchmark data for one or both models is coming soon. This page currently shows metadata and pricing where BenchLM has it, and score-level comparisons will populate as public benchmark results land.

BenchLM does not have sourced benchmark coverage for Mistral Medium 3 yet. This comparison is currently limited to metadata such as context window, reasoning mode, and pricing where available.

GPT-5.4 Pro is priced at $30.00 input / $180.00 output per 1M tokens, versus $0.40 input / $2.00 output per 1M tokens for Mistral Medium 3. GPT-5.4 Pro has the larger context window at 1.05M, compared with 128K for Mistral Medium 3.

Quick Verdict

Benchmark data for GPT-5.4 Pro and Mistral Medium 3 is coming soon on BenchLM.

Agentic

Coming soon

Comparable scores for this category are coming soon. One or both models do not have sourced results here yet.

89.3%
BrowseComp
Coming soon

Coding

GPT-5.4 Pro

GPT-5.4 Pro

95

Mistral Medium 3

92.1

95%
HumanEval
92.1%

Multimodal & Grounded

Coming soon

Benchmark data for this category is coming soon.

Reasoning

Coming soon

Comparable scores for this category are coming soon. One or both models do not have sourced results here yet.

97%
SimpleQA
Coming soon
95%
MuSR
Coming soon

Knowledge

GPT-5.4 Pro

GPT-5.4 Pro

95.7

Mistral Medium 3

57.1

99%
MMLU
Coming soon
94.4%
GPQA
57.1%
97%
SuperGPQA
Coming soon
94%
OpenBookQA
Coming soon

Instruction Following

Coming soon

Benchmark data for this category is coming soon.

Multilingual

Coming soon

Benchmark data for this category is coming soon.

Mathematics

Coming soon

Comparable scores for this category are coming soon. One or both models do not have sourced results here yet.

99%
AIME 2023
Coming soon
99%
AIME 2024
Coming soon
99%
AIME 2025
Coming soon
96%
HMMT Feb 2023
Coming soon
98%
HMMT Feb 2024
Coming soon
97%
HMMT Feb 2025
Coming soon
97%
BRUMO 2025
Coming soon

Frequently Asked Questions

Can I compare GPT-5.4 Pro and Mistral Medium 3 on BenchLM yet?

Not fully yet. BenchLM is tracking both models, but the sourced benchmark breakdown for this comparison is still coming soon.

Why does this comparison show “coming soon”?

BenchLM only shows category winners and benchmark-level calls when we have sourced results that can be compared fairly. For these models, the public benchmark coverage is not complete enough yet.

What data is available for GPT-5.4 Pro and Mistral Medium 3 today?

GPT-5.4 Pro: $30.00 input / $180.00 output per 1M tokens Mistral Medium 3: $0.40 input / $2.00 output per 1M tokens Both model pages still include creator, context window, reasoning mode, and other metadata while benchmark coverage fills in.

Last updated: March 17, 2026

Weekly LLM Benchmark Digest

Get notified when new models drop, benchmark scores change, or the leaderboard shifts. One email per week.

Free. No spam. Unsubscribe anytime. We only store derived location metadata for consent routing.