Gemini 1.5 Pro vs Qwen2.5-1M

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

Qwen2.5-1M wins overall with a score of 66 vs 54 (12 point difference).Qwen2.5-1M wins 4 out of 4 categories.

Knowledge

Qwen2.5-1M

Gemini 1.5 Pro

62.5

Qwen2.5-1M

81.8

64
MMLU
84
64
GPQA
83
62
SuperGPQA
81
60
OpenBookQA
79

Coding

Qwen2.5-1M

Gemini 1.5 Pro

56

Qwen2.5-1M

76

56
HumanEval
76

Mathematics

Qwen2.5-1M

Gemini 1.5 Pro

63

Qwen2.5-1M

84

64
AIME 2023
85
66
AIME 2024
87
65
AIME 2025
86
60
HMMT Feb 2023
81
62
HMMT Feb 2024
83
61
HMMT Feb 2025
82
63
BRUMO 2025
84

Reasoning

Qwen2.5-1M

Gemini 1.5 Pro

61

Qwen2.5-1M

80

62
SimpleQA
81
60
MuSR
79

Frequently Asked Questions

Which is better, Gemini 1.5 Pro or Qwen2.5-1M?

Qwen2.5-1M scores higher overall with 66 vs 54, a difference of 12 points across all benchmarks.

Which is better for knowledge tasks, Gemini 1.5 Pro or Qwen2.5-1M?

Qwen2.5-1M leads in knowledge tasks with an average score of 81.8 vs 62.5.

Which is better for coding, Gemini 1.5 Pro or Qwen2.5-1M?

Qwen2.5-1M leads in coding with an average score of 76 vs 56.

Which is better for math, Gemini 1.5 Pro or Qwen2.5-1M?

Qwen2.5-1M leads in math with an average score of 84 vs 63.

Which is better for reasoning, Gemini 1.5 Pro or Qwen2.5-1M?

Qwen2.5-1M leads in reasoning with an average score of 80 vs 61.