benchlm.ai

Gemma 3 27B vs o1-preview

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

o1-preview wins overall with a score of 71 vs 36 (35 point difference).o1-preview wins 4 out of 4 categories.

Gemma 3 27B

CreatorGoogle
TypeOpen Weight
Context32K
Score36

o1-preview

CreatorOpenAI
TypeProprietary
Context200K
Score71

Knowledge

o1-preview

Gemma 3 27B

42.8

o1-preview

89

45
MMLU
92
44
GPQA
90
42
SuperGPQA
88
40
OpenBookQA
86

Coding

o1-preview

Gemma 3 27B

37

o1-preview

86

37
HumanEval
86

Mathematics

o1-preview

Gemma 3 27B

44

o1-preview

93

45
AIME 2023
94
47
AIME 2024
96
46
AIME 2025
95
41
HMMT Feb 2023
90
43
HMMT Feb 2024
92
42
HMMT Feb 2025
91
44
BRUMO 2025
93

Reasoning

o1-preview

Gemma 3 27B

42

o1-preview

87

43
SimpleQA
88
41
MuSR
86

Frequently Asked Questions

Which is better, Gemma 3 27B or o1-preview?

o1-preview scores higher overall with 71 vs 36, a difference of 35 points across all benchmarks.

Which is better for knowledge tasks, Gemma 3 27B or o1-preview?

o1-preview leads in knowledge tasks with an average score of 89 vs 42.8.

Which is better for coding, Gemma 3 27B or o1-preview?

o1-preview leads in coding with an average score of 86 vs 37.

Which is better for math, Gemma 3 27B or o1-preview?

o1-preview leads in math with an average score of 93 vs 44.

Which is better for reasoning, Gemma 3 27B or o1-preview?

o1-preview leads in reasoning with an average score of 87 vs 42.

Related Comparisons

Gemma 3 27B vs GPT-5.4Gemma 3 27B vs Gemini 3.1 ProGemma 3 27B vs Claude Opus 4.6Gemma 3 27B vs GPT-5.3 CodexGemma 3 27B vs Grok 4.1Gemma 3 27B vs GPT-5.2