benchlm.ai

Claude Haiku 4.5 vs Llama 4 Behemoth

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

Claude Haiku 4.5 wins overall with a score of 57 vs 39 (18 point difference).Claude Haiku 4.5 wins 4 out of 4 categories.

Claude Haiku 4.5

CreatorAnthropic
TypeProprietary
Context200K
Score57

Llama 4 Behemoth

CreatorMeta
TypeOpen Weight
Context32K
Score39

Knowledge

Claude Haiku 4.5

Claude Haiku 4.5

65.8

Llama 4 Behemoth

45.8

68
MMLU
48
67
GPQA
47
65
SuperGPQA
45
63
OpenBookQA
43

Coding

Claude Haiku 4.5

Claude Haiku 4.5

60

Llama 4 Behemoth

40

60
HumanEval
40

Mathematics

Claude Haiku 4.5

Claude Haiku 4.5

67

Llama 4 Behemoth

47

68
AIME 2023
48
70
AIME 2024
50
69
AIME 2025
49
64
HMMT Feb 2023
44
66
HMMT Feb 2024
46
65
HMMT Feb 2025
45
67
BRUMO 2025
47

Reasoning

Claude Haiku 4.5

Claude Haiku 4.5

64

Llama 4 Behemoth

45

65
SimpleQA
46
63
MuSR
44

Frequently Asked Questions

Which is better, Claude Haiku 4.5 or Llama 4 Behemoth?

Claude Haiku 4.5 scores higher overall with 57 vs 39, a difference of 18 points across all benchmarks.

Which is better for knowledge tasks, Claude Haiku 4.5 or Llama 4 Behemoth?

Claude Haiku 4.5 leads in knowledge tasks with an average score of 65.8 vs 45.8.

Which is better for coding, Claude Haiku 4.5 or Llama 4 Behemoth?

Claude Haiku 4.5 leads in coding with an average score of 60 vs 40.

Which is better for math, Claude Haiku 4.5 or Llama 4 Behemoth?

Claude Haiku 4.5 leads in math with an average score of 67 vs 47.

Which is better for reasoning, Claude Haiku 4.5 or Llama 4 Behemoth?

Claude Haiku 4.5 leads in reasoning with an average score of 64 vs 45.

Related Comparisons

Claude Haiku 4.5 vs GPT-5.4Claude Haiku 4.5 vs Gemini 3.1 ProClaude Haiku 4.5 vs Claude Opus 4.6Claude Haiku 4.5 vs GPT-5.3 CodexClaude Haiku 4.5 vs Grok 4.1Claude Haiku 4.5 vs GPT-5.2