benchlm.ai

Gemini 1.5 Pro vs o4-mini (high)

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

o4-mini (high) wins overall with a score of 65 vs 54 (11 point difference).o4-mini (high) wins 4 out of 4 categories.

Gemini 1.5 Pro

CreatorGoogle
TypeProprietary
Context2M
Score54

o4-mini (high)

CreatorOpenAI
TypeProprietary
Context200K
Score65

Knowledge

o4-mini (high)

Gemini 1.5 Pro

62.5

o4-mini (high)

80.5

64
MMLU
82
64
GPQA
82
62
SuperGPQA
80
60
OpenBookQA
78

Coding

o4-mini (high)

Gemini 1.5 Pro

56

o4-mini (high)

74

56
HumanEval
74

Mathematics

o4-mini (high)

Gemini 1.5 Pro

63

o4-mini (high)

82

64
AIME 2023
83
66
AIME 2024
85
65
AIME 2025
84
60
HMMT Feb 2023
79
62
HMMT Feb 2024
81
61
HMMT Feb 2025
80
63
BRUMO 2025
82

Reasoning

o4-mini (high)

Gemini 1.5 Pro

61

o4-mini (high)

79

62
SimpleQA
80
60
MuSR
78

Frequently Asked Questions

Which is better, Gemini 1.5 Pro or o4-mini (high)?

o4-mini (high) scores higher overall with 65 vs 54, a difference of 11 points across all benchmarks.

Which is better for knowledge tasks, Gemini 1.5 Pro or o4-mini (high)?

o4-mini (high) leads in knowledge tasks with an average score of 80.5 vs 62.5.

Which is better for coding, Gemini 1.5 Pro or o4-mini (high)?

o4-mini (high) leads in coding with an average score of 74 vs 56.

Which is better for math, Gemini 1.5 Pro or o4-mini (high)?

o4-mini (high) leads in math with an average score of 82 vs 63.

Which is better for reasoning, Gemini 1.5 Pro or o4-mini (high)?

o4-mini (high) leads in reasoning with an average score of 79 vs 61.

Related Comparisons

Gemini 1.5 Pro vs GPT-5.4Gemini 1.5 Pro vs Gemini 3.1 ProGemini 1.5 Pro vs Claude Opus 4.6Gemini 1.5 Pro vs GPT-5.3 CodexGemini 1.5 Pro vs Grok 4.1Gemini 1.5 Pro vs GPT-5.2