benchlm.ai

Claude 3 Haiku vs Gemma 3 27B

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

Claude 3 Haiku wins overall with a score of 46 vs 36 (10 point difference).Claude 3 Haiku wins 4 out of 4 categories.

Claude 3 Haiku

CreatorAnthropic
TypeProprietary
Context200K
Score46

Gemma 3 27B

CreatorGoogle
TypeOpen Weight
Context32K
Score36

Knowledge

Claude 3 Haiku

Claude 3 Haiku

54.5

Gemma 3 27B

42.8

56
MMLU
45
56
GPQA
44
54
SuperGPQA
42
52
OpenBookQA
40

Coding

Claude 3 Haiku

Claude 3 Haiku

48

Gemma 3 27B

37

48
HumanEval
37

Mathematics

Claude 3 Haiku

Claude 3 Haiku

55

Gemma 3 27B

44

56
AIME 2023
45
58
AIME 2024
47
57
AIME 2025
46
52
HMMT Feb 2023
41
54
HMMT Feb 2024
43
53
HMMT Feb 2025
42
55
BRUMO 2025
44

Reasoning

Claude 3 Haiku

Claude 3 Haiku

53

Gemma 3 27B

42

54
SimpleQA
43
52
MuSR
41

Frequently Asked Questions

Which is better, Claude 3 Haiku or Gemma 3 27B?

Claude 3 Haiku scores higher overall with 46 vs 36, a difference of 10 points across all benchmarks.

Which is better for knowledge tasks, Claude 3 Haiku or Gemma 3 27B?

Claude 3 Haiku leads in knowledge tasks with an average score of 54.5 vs 42.8.

Which is better for coding, Claude 3 Haiku or Gemma 3 27B?

Claude 3 Haiku leads in coding with an average score of 48 vs 37.

Which is better for math, Claude 3 Haiku or Gemma 3 27B?

Claude 3 Haiku leads in math with an average score of 55 vs 44.

Which is better for reasoning, Claude 3 Haiku or Gemma 3 27B?

Claude 3 Haiku leads in reasoning with an average score of 53 vs 42.

Related Comparisons

Claude 3 Haiku vs GPT-5.4Claude 3 Haiku vs Gemini 3.1 ProClaude 3 Haiku vs Claude Opus 4.6Claude 3 Haiku vs GPT-5.3 CodexClaude 3 Haiku vs Grok 4.1Claude 3 Haiku vs GPT-5.2