benchlm.ai

Gemini 2.5 Pro vs o1-preview

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

o1-preview wins overall with a score of 71 vs 65 (6 point difference).o1-preview wins 4 out of 4 categories.

Gemini 2.5 Pro

CreatorGoogle
TypeProprietary
Context2M
Score65

o1-preview

CreatorOpenAI
TypeProprietary
Context200K
Score71

Knowledge

o1-preview

Gemini 2.5 Pro

81.5

o1-preview

89

83
MMLU
92
83
GPQA
90
81
SuperGPQA
88
79
OpenBookQA
86

Coding

o1-preview

Gemini 2.5 Pro

75

o1-preview

86

75
HumanEval
86

Mathematics

o1-preview

Gemini 2.5 Pro

83

o1-preview

93

84
AIME 2023
94
86
AIME 2024
96
85
AIME 2025
95
80
HMMT Feb 2023
90
82
HMMT Feb 2024
92
81
HMMT Feb 2025
91
83
BRUMO 2025
93

Reasoning

o1-preview

Gemini 2.5 Pro

80

o1-preview

87

81
SimpleQA
88
79
MuSR
86

Frequently Asked Questions

Which is better, Gemini 2.5 Pro or o1-preview?

o1-preview scores higher overall with 71 vs 65, a difference of 6 points across all benchmarks.

Which is better for knowledge tasks, Gemini 2.5 Pro or o1-preview?

o1-preview leads in knowledge tasks with an average score of 89 vs 81.5.

Which is better for coding, Gemini 2.5 Pro or o1-preview?

o1-preview leads in coding with an average score of 86 vs 75.

Which is better for math, Gemini 2.5 Pro or o1-preview?

o1-preview leads in math with an average score of 93 vs 83.

Which is better for reasoning, Gemini 2.5 Pro or o1-preview?

o1-preview leads in reasoning with an average score of 87 vs 80.

Related Comparisons

Gemini 2.5 Pro vs GPT-5.4Gemini 2.5 Pro vs Gemini 3.1 ProGemini 2.5 Pro vs Claude Opus 4.6Gemini 2.5 Pro vs GPT-5.3 CodexGemini 2.5 Pro vs Grok 4.1Gemini 2.5 Pro vs GPT-5.2