Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.
Mistral 8x7B wins overall with a score of 52 vs 46 (6 point difference).Mistral 8x7B wins 4 out of 4 categories.
Claude 3 Haiku
54.5
Mistral 8x7B
62.8
Claude 3 Haiku
48
Mistral 8x7B
55
Claude 3 Haiku
55
Mistral 8x7B
64
Claude 3 Haiku
53
Mistral 8x7B
62
Mistral 8x7B scores higher overall with 52 vs 46, a difference of 6 points across all benchmarks.
Mistral 8x7B leads in knowledge tasks with an average score of 62.8 vs 54.5.
Mistral 8x7B leads in coding with an average score of 55 vs 48.
Mistral 8x7B leads in math with an average score of 64 vs 55.
Mistral 8x7B leads in reasoning with an average score of 62 vs 53.