Claude Haiku 4.5 vs Llama 3.1 405B

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

Llama 3.1 405B wins overall with a score of 58 vs 57 (1 point difference).Llama 3.1 405B wins 4 out of 4 categories.

Knowledge

Llama 3.1 405B

Claude Haiku 4.5

65.8

Llama 3.1 405B

68.5

68
MMLU
70
67
GPQA
70
65
SuperGPQA
68
63
OpenBookQA
66

Coding

Llama 3.1 405B

Claude Haiku 4.5

60

Llama 3.1 405B

62

60
HumanEval
62

Mathematics

Llama 3.1 405B

Claude Haiku 4.5

67

Llama 3.1 405B

69

68
AIME 2023
70
70
AIME 2024
72
69
AIME 2025
71
64
HMMT Feb 2023
66
66
HMMT Feb 2024
68
65
HMMT Feb 2025
67
67
BRUMO 2025
69

Reasoning

Llama 3.1 405B

Claude Haiku 4.5

64

Llama 3.1 405B

67

65
SimpleQA
68
63
MuSR
66

Frequently Asked Questions

Which is better, Claude Haiku 4.5 or Llama 3.1 405B?

Llama 3.1 405B scores higher overall with 58 vs 57, a difference of 1 points across all benchmarks.

Which is better for knowledge tasks, Claude Haiku 4.5 or Llama 3.1 405B?

Llama 3.1 405B leads in knowledge tasks with an average score of 68.5 vs 65.8.

Which is better for coding, Claude Haiku 4.5 or Llama 3.1 405B?

Llama 3.1 405B leads in coding with an average score of 62 vs 60.

Which is better for math, Claude Haiku 4.5 or Llama 3.1 405B?

Llama 3.1 405B leads in math with an average score of 69 vs 67.

Which is better for reasoning, Claude Haiku 4.5 or Llama 3.1 405B?

Llama 3.1 405B leads in reasoning with an average score of 67 vs 64.