benchlm.ai

Grok 4.1 vs Nemotron-4 15B

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

Grok 4.1 wins overall with a score of 84 vs 45 (39 point difference).Grok 4.1 wins 4 out of 4 categories.

Grok 4.1

CreatorxAI
TypeProprietary
Context128K
Score84

Nemotron-4 15B

CreatorNVIDIA
TypeOpen Weight
Context32K
Score45

Knowledge

Grok 4.1

Grok 4.1

96

Nemotron-4 15B

51.8

99
MMLU
54
97
GPQA
53
95
SuperGPQA
51
93
OpenBookQA
49

Coding

Grok 4.1

Grok 4.1

91

Nemotron-4 15B

46

91
HumanEval
46

Mathematics

Grok 4.1

Grok 4.1

97.1

Nemotron-4 15B

53

99
AIME 2023
54
99
AIME 2024
56
98
AIME 2025
55
95
HMMT Feb 2023
50
97
HMMT Feb 2024
52
96
HMMT Feb 2025
51
96
BRUMO 2025
53

Reasoning

Grok 4.1

Grok 4.1

94

Nemotron-4 15B

51

95
SimpleQA
52
93
MuSR
50

Frequently Asked Questions

Which is better, Grok 4.1 or Nemotron-4 15B?

Grok 4.1 scores higher overall with 84 vs 45, a difference of 39 points across all benchmarks.

Which is better for knowledge tasks, Grok 4.1 or Nemotron-4 15B?

Grok 4.1 leads in knowledge tasks with an average score of 96 vs 51.8.

Which is better for coding, Grok 4.1 or Nemotron-4 15B?

Grok 4.1 leads in coding with an average score of 91 vs 46.

Which is better for math, Grok 4.1 or Nemotron-4 15B?

Grok 4.1 leads in math with an average score of 97.1 vs 53.

Which is better for reasoning, Grok 4.1 or Nemotron-4 15B?

Grok 4.1 leads in reasoning with an average score of 94 vs 51.

Related Comparisons

Grok 4.1 vs GPT-5.4Grok 4.1 vs Gemini 3.1 ProGrok 4.1 vs Claude Opus 4.6Grok 4.1 vs GPT-5.3 CodexGrok 4.1 vs GPT-5.2Grok 4.1 vs GPT-5.2-Codex