Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.
Gemini 1.0 Pro wins overall with a score of 52 vs 20 (32 point difference).Gemini 1.0 Pro wins 4 out of 4 categories.
Gemini 1.0 Pro
60.5
Mistral 8x7B v0.2
26.8
Gemini 1.0 Pro
54
Mistral 8x7B v0.2
21
Gemini 1.0 Pro
61
Mistral 8x7B v0.2
28
Gemini 1.0 Pro
59
Mistral 8x7B v0.2
26
Gemini 1.0 Pro scores higher overall with 52 vs 20, a difference of 32 points across all benchmarks.
Gemini 1.0 Pro leads in knowledge tasks with an average score of 60.5 vs 26.8.
Gemini 1.0 Pro leads in coding with an average score of 54 vs 21.
Gemini 1.0 Pro leads in math with an average score of 61 vs 28.
Gemini 1.0 Pro leads in reasoning with an average score of 59 vs 26.