benchlm.ai

Gemini 1.5 Pro vs o1-preview

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

o1-preview wins overall with a score of 71 vs 54 (17 point difference).o1-preview wins 4 out of 4 categories.

Gemini 1.5 Pro

CreatorGoogle
TypeProprietary
Context2M
Score54

o1-preview

CreatorOpenAI
TypeProprietary
Context200K
Score71

Knowledge

o1-preview

Gemini 1.5 Pro

62.5

o1-preview

89

64
MMLU
92
64
GPQA
90
62
SuperGPQA
88
60
OpenBookQA
86

Coding

o1-preview

Gemini 1.5 Pro

56

o1-preview

86

56
HumanEval
86

Mathematics

o1-preview

Gemini 1.5 Pro

63

o1-preview

93

64
AIME 2023
94
66
AIME 2024
96
65
AIME 2025
95
60
HMMT Feb 2023
90
62
HMMT Feb 2024
92
61
HMMT Feb 2025
91
63
BRUMO 2025
93

Reasoning

o1-preview

Gemini 1.5 Pro

61

o1-preview

87

62
SimpleQA
88
60
MuSR
86

Frequently Asked Questions

Which is better, Gemini 1.5 Pro or o1-preview?

o1-preview scores higher overall with 71 vs 54, a difference of 17 points across all benchmarks.

Which is better for knowledge tasks, Gemini 1.5 Pro or o1-preview?

o1-preview leads in knowledge tasks with an average score of 89 vs 62.5.

Which is better for coding, Gemini 1.5 Pro or o1-preview?

o1-preview leads in coding with an average score of 86 vs 56.

Which is better for math, Gemini 1.5 Pro or o1-preview?

o1-preview leads in math with an average score of 93 vs 63.

Which is better for reasoning, Gemini 1.5 Pro or o1-preview?

o1-preview leads in reasoning with an average score of 87 vs 61.

Related Comparisons

Gemini 1.5 Pro vs GPT-5.4Gemini 1.5 Pro vs Gemini 3.1 ProGemini 1.5 Pro vs Claude Opus 4.6Gemini 1.5 Pro vs GPT-5.3 CodexGemini 1.5 Pro vs Grok 4.1Gemini 1.5 Pro vs GPT-5.2