benchlm.ai

Claude 3 Haiku vs Gemini 1.5 Pro

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

Gemini 1.5 Pro wins overall with a score of 54 vs 46 (8 point difference).Gemini 1.5 Pro wins 4 out of 4 categories.

Claude 3 Haiku

CreatorAnthropic
TypeProprietary
Context200K
Score46

Gemini 1.5 Pro

CreatorGoogle
TypeProprietary
Context2M
Score54

Knowledge

Gemini 1.5 Pro

Claude 3 Haiku

54.5

Gemini 1.5 Pro

62.5

56
MMLU
64
56
GPQA
64
54
SuperGPQA
62
52
OpenBookQA
60

Coding

Gemini 1.5 Pro

Claude 3 Haiku

48

Gemini 1.5 Pro

56

48
HumanEval
56

Mathematics

Gemini 1.5 Pro

Claude 3 Haiku

55

Gemini 1.5 Pro

63

56
AIME 2023
64
58
AIME 2024
66
57
AIME 2025
65
52
HMMT Feb 2023
60
54
HMMT Feb 2024
62
53
HMMT Feb 2025
61
55
BRUMO 2025
63

Reasoning

Gemini 1.5 Pro

Claude 3 Haiku

53

Gemini 1.5 Pro

61

54
SimpleQA
62
52
MuSR
60

Frequently Asked Questions

Which is better, Claude 3 Haiku or Gemini 1.5 Pro?

Gemini 1.5 Pro scores higher overall with 54 vs 46, a difference of 8 points across all benchmarks.

Which is better for knowledge tasks, Claude 3 Haiku or Gemini 1.5 Pro?

Gemini 1.5 Pro leads in knowledge tasks with an average score of 62.5 vs 54.5.

Which is better for coding, Claude 3 Haiku or Gemini 1.5 Pro?

Gemini 1.5 Pro leads in coding with an average score of 56 vs 48.

Which is better for math, Claude 3 Haiku or Gemini 1.5 Pro?

Gemini 1.5 Pro leads in math with an average score of 63 vs 55.

Which is better for reasoning, Claude 3 Haiku or Gemini 1.5 Pro?

Gemini 1.5 Pro leads in reasoning with an average score of 61 vs 53.

Related Comparisons

Claude 3 Haiku vs GPT-5.4Claude 3 Haiku vs Gemini 3.1 ProClaude 3 Haiku vs Claude Opus 4.6Claude 3 Haiku vs GPT-5.3 CodexClaude 3 Haiku vs Grok 4.1Claude 3 Haiku vs GPT-5.2