Nemotron-4 15B vs Qwen2.5-1M

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

Qwen2.5-1M wins overall with a score of 66 vs 45 (21 point difference).Qwen2.5-1M wins 4 out of 4 categories.

Knowledge

Qwen2.5-1M

Nemotron-4 15B

51.8

Qwen2.5-1M

81.8

54
MMLU
84
53
GPQA
83
51
SuperGPQA
81
49
OpenBookQA
79

Coding

Qwen2.5-1M

Nemotron-4 15B

46

Qwen2.5-1M

76

46
HumanEval
76

Mathematics

Qwen2.5-1M

Nemotron-4 15B

53

Qwen2.5-1M

84

54
AIME 2023
85
56
AIME 2024
87
55
AIME 2025
86
50
HMMT Feb 2023
81
52
HMMT Feb 2024
83
51
HMMT Feb 2025
82
53
BRUMO 2025
84

Reasoning

Qwen2.5-1M

Nemotron-4 15B

51

Qwen2.5-1M

80

52
SimpleQA
81
50
MuSR
79

Frequently Asked Questions

Which is better, Nemotron-4 15B or Qwen2.5-1M?

Qwen2.5-1M scores higher overall with 66 vs 45, a difference of 21 points across all benchmarks.

Which is better for knowledge tasks, Nemotron-4 15B or Qwen2.5-1M?

Qwen2.5-1M leads in knowledge tasks with an average score of 81.8 vs 51.8.

Which is better for coding, Nemotron-4 15B or Qwen2.5-1M?

Qwen2.5-1M leads in coding with an average score of 76 vs 46.

Which is better for math, Nemotron-4 15B or Qwen2.5-1M?

Qwen2.5-1M leads in math with an average score of 84 vs 53.

Which is better for reasoning, Nemotron-4 15B or Qwen2.5-1M?

Qwen2.5-1M leads in reasoning with an average score of 80 vs 51.