Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.
Claude 3 Opus wins overall with a score of 51 vs 20 (31 point difference).Claude 3 Opus wins 4 out of 4 categories.
Claude 3 Opus
59.5
Mistral 8x7B v0.2
26.8
Claude 3 Opus
53
Mistral 8x7B v0.2
21
Claude 3 Opus
60
Mistral 8x7B v0.2
28
Claude 3 Opus
58
Mistral 8x7B v0.2
26
Claude 3 Opus scores higher overall with 51 vs 20, a difference of 31 points across all benchmarks.
Claude 3 Opus leads in knowledge tasks with an average score of 59.5 vs 26.8.
Claude 3 Opus leads in coding with an average score of 53 vs 21.
Claude 3 Opus leads in math with an average score of 60 vs 28.
Claude 3 Opus leads in reasoning with an average score of 58 vs 26.