Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.
Claude 3.5 Sonnet wins overall with a score of 55 vs 48 (7 point difference).Claude 3.5 Sonnet wins 4 out of 4 categories.
Claude 3.5 Sonnet
63.5
Llama 3 70B
56.5
Claude 3.5 Sonnet
57
Llama 3 70B
50
Claude 3.5 Sonnet
64
Llama 3 70B
57
Claude 3.5 Sonnet
62
Llama 3 70B
55
Claude 3.5 Sonnet scores higher overall with 55 vs 48, a difference of 7 points across all benchmarks.
Claude 3.5 Sonnet leads in knowledge tasks with an average score of 63.5 vs 56.5.
Claude 3.5 Sonnet leads in coding with an average score of 57 vs 50.
Claude 3.5 Sonnet leads in math with an average score of 64 vs 57.
Claude 3.5 Sonnet leads in reasoning with an average score of 62 vs 55.