Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.
Llama 3.1 405B wins overall with a score of 58 vs 20 (38 point difference).Llama 3.1 405B wins 4 out of 4 categories.
Llama 3.1 405B
68.5
Mistral 8x7B v0.2
26.8
Llama 3.1 405B
62
Mistral 8x7B v0.2
21
Llama 3.1 405B
69
Mistral 8x7B v0.2
28
Llama 3.1 405B
67
Mistral 8x7B v0.2
26
Llama 3.1 405B scores higher overall with 58 vs 20, a difference of 38 points across all benchmarks.
Llama 3.1 405B leads in knowledge tasks with an average score of 68.5 vs 26.8.
Llama 3.1 405B leads in coding with an average score of 62 vs 21.
Llama 3.1 405B leads in math with an average score of 69 vs 28.
Llama 3.1 405B leads in reasoning with an average score of 67 vs 26.