benchlm.ai

Grok 4.1 vs Qwen2.5-1M

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

Grok 4.1 wins overall with a score of 84 vs 66 (18 point difference).Grok 4.1 wins 4 out of 4 categories.

Grok 4.1

CreatorxAI
TypeProprietary
Context128K
Score84

Qwen2.5-1M

CreatorAlibaba
TypeOpen Weight
Context1M
Score66

Knowledge

Grok 4.1

Grok 4.1

96

Qwen2.5-1M

81.8

99
MMLU
84
97
GPQA
83
95
SuperGPQA
81
93
OpenBookQA
79

Coding

Grok 4.1

Grok 4.1

91

Qwen2.5-1M

76

91
HumanEval
76

Mathematics

Grok 4.1

Grok 4.1

97.1

Qwen2.5-1M

84

99
AIME 2023
85
99
AIME 2024
87
98
AIME 2025
86
95
HMMT Feb 2023
81
97
HMMT Feb 2024
83
96
HMMT Feb 2025
82
96
BRUMO 2025
84

Reasoning

Grok 4.1

Grok 4.1

94

Qwen2.5-1M

80

95
SimpleQA
81
93
MuSR
79

Frequently Asked Questions

Which is better, Grok 4.1 or Qwen2.5-1M?

Grok 4.1 scores higher overall with 84 vs 66, a difference of 18 points across all benchmarks.

Which is better for knowledge tasks, Grok 4.1 or Qwen2.5-1M?

Grok 4.1 leads in knowledge tasks with an average score of 96 vs 81.8.

Which is better for coding, Grok 4.1 or Qwen2.5-1M?

Grok 4.1 leads in coding with an average score of 91 vs 76.

Which is better for math, Grok 4.1 or Qwen2.5-1M?

Grok 4.1 leads in math with an average score of 97.1 vs 84.

Which is better for reasoning, Grok 4.1 or Qwen2.5-1M?

Grok 4.1 leads in reasoning with an average score of 94 vs 80.

Related Comparisons

Grok 4.1 vs GPT-5.4Grok 4.1 vs Gemini 3.1 ProGrok 4.1 vs Claude Opus 4.6Grok 4.1 vs GPT-5.3 CodexGrok 4.1 vs GPT-5.2Grok 4.1 vs GPT-5.2-Codex