benchlm.ai

Llama 4 Scout vs Qwen2.5-1M

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

Qwen2.5-1M wins overall with a score of 66 vs 38 (28 point difference).Qwen2.5-1M wins 4 out of 4 categories.

Llama 4 Scout

CreatorMeta
TypeOpen Weight
Context32K
Score38

Qwen2.5-1M

CreatorAlibaba
TypeOpen Weight
Context1M
Score66

Knowledge

Qwen2.5-1M

Llama 4 Scout

44.8

Qwen2.5-1M

81.8

47
MMLU
84
46
GPQA
83
44
SuperGPQA
81
42
OpenBookQA
79

Coding

Qwen2.5-1M

Llama 4 Scout

39

Qwen2.5-1M

76

39
HumanEval
76

Mathematics

Qwen2.5-1M

Llama 4 Scout

46

Qwen2.5-1M

84

47
AIME 2023
85
49
AIME 2024
87
48
AIME 2025
86
43
HMMT Feb 2023
81
45
HMMT Feb 2024
83
44
HMMT Feb 2025
82
46
BRUMO 2025
84

Reasoning

Qwen2.5-1M

Llama 4 Scout

44

Qwen2.5-1M

80

45
SimpleQA
81
43
MuSR
79

Frequently Asked Questions

Which is better, Llama 4 Scout or Qwen2.5-1M?

Qwen2.5-1M scores higher overall with 66 vs 38, a difference of 28 points across all benchmarks.

Which is better for knowledge tasks, Llama 4 Scout or Qwen2.5-1M?

Qwen2.5-1M leads in knowledge tasks with an average score of 81.8 vs 44.8.

Which is better for coding, Llama 4 Scout or Qwen2.5-1M?

Qwen2.5-1M leads in coding with an average score of 76 vs 39.

Which is better for math, Llama 4 Scout or Qwen2.5-1M?

Qwen2.5-1M leads in math with an average score of 84 vs 46.

Which is better for reasoning, Llama 4 Scout or Qwen2.5-1M?

Qwen2.5-1M leads in reasoning with an average score of 80 vs 44.

Related Comparisons

Llama 4 Scout vs GPT-5.4Llama 4 Scout vs Gemini 3.1 ProLlama 4 Scout vs Claude Opus 4.6Llama 4 Scout vs GPT-5.3 CodexLlama 4 Scout vs Grok 4.1Llama 4 Scout vs GPT-5.2