benchlm.ai

Claude Sonnet 4.6 vs Llama 3.1 405B

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

Claude Sonnet 4.6 wins overall with a score of 80 vs 58 (22 point difference).Claude Sonnet 4.6 wins 4 out of 4 categories.

Claude Sonnet 4.6

CreatorAnthropic
TypeProprietary
Context1M
Score80

Llama 3.1 405B

CreatorMeta
TypeOpen Weight
Context128K
Score58

Knowledge

Claude Sonnet 4.6

Claude Sonnet 4.6

96

Llama 3.1 405B

68.5

99
MMLU
70
97
GPQA
70
95
SuperGPQA
68
93
OpenBookQA
66

Coding

Claude Sonnet 4.6

Claude Sonnet 4.6

93

Llama 3.1 405B

62

93
HumanEval
62

Mathematics

Claude Sonnet 4.6

Claude Sonnet 4.6

97.1

Llama 3.1 405B

69

99
AIME 2023
70
99
AIME 2024
72
98
AIME 2025
71
95
HMMT Feb 2023
66
97
HMMT Feb 2024
68
96
HMMT Feb 2025
67
96
BRUMO 2025
69

Reasoning

Claude Sonnet 4.6

Claude Sonnet 4.6

94

Llama 3.1 405B

67

95
SimpleQA
68
93
MuSR
66

Frequently Asked Questions

Which is better, Claude Sonnet 4.6 or Llama 3.1 405B?

Claude Sonnet 4.6 scores higher overall with 80 vs 58, a difference of 22 points across all benchmarks.

Which is better for knowledge tasks, Claude Sonnet 4.6 or Llama 3.1 405B?

Claude Sonnet 4.6 leads in knowledge tasks with an average score of 96 vs 68.5.

Which is better for coding, Claude Sonnet 4.6 or Llama 3.1 405B?

Claude Sonnet 4.6 leads in coding with an average score of 93 vs 62.

Which is better for math, Claude Sonnet 4.6 or Llama 3.1 405B?

Claude Sonnet 4.6 leads in math with an average score of 97.1 vs 69.

Which is better for reasoning, Claude Sonnet 4.6 or Llama 3.1 405B?

Claude Sonnet 4.6 leads in reasoning with an average score of 94 vs 67.

Related Comparisons

Claude Sonnet 4.6 vs GPT-5.4Claude Sonnet 4.6 vs Gemini 3.1 ProClaude Sonnet 4.6 vs Claude Opus 4.6Claude Sonnet 4.6 vs GPT-5.3 CodexClaude Sonnet 4.6 vs Grok 4.1Claude Sonnet 4.6 vs GPT-5.2