benchlm.ai

Grok 3 [Beta] vs Nemotron-4 15B

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

Nemotron-4 15B wins overall with a score of 45 vs 33 (12 point difference).Nemotron-4 15B wins 4 out of 4 categories.

Grok 3 [Beta]

CreatorxAI
TypeProprietary
Context128K
Score33

Nemotron-4 15B

CreatorNVIDIA
TypeOpen Weight
Context32K
Score45

Knowledge

Nemotron-4 15B

Grok 3 [Beta]

39.8

Nemotron-4 15B

51.8

42
MMLU
54
41
GPQA
53
39
SuperGPQA
51
37
OpenBookQA
49

Coding

Nemotron-4 15B

Grok 3 [Beta]

34

Nemotron-4 15B

46

34
HumanEval
46

Mathematics

Nemotron-4 15B

Grok 3 [Beta]

41

Nemotron-4 15B

53

42
AIME 2023
54
44
AIME 2024
56
43
AIME 2025
55
38
HMMT Feb 2023
50
40
HMMT Feb 2024
52
39
HMMT Feb 2025
51
41
BRUMO 2025
53

Reasoning

Nemotron-4 15B

Grok 3 [Beta]

39

Nemotron-4 15B

51

40
SimpleQA
52
38
MuSR
50

Frequently Asked Questions

Which is better, Grok 3 [Beta] or Nemotron-4 15B?

Nemotron-4 15B scores higher overall with 45 vs 33, a difference of 12 points across all benchmarks.

Which is better for knowledge tasks, Grok 3 [Beta] or Nemotron-4 15B?

Nemotron-4 15B leads in knowledge tasks with an average score of 51.8 vs 39.8.

Which is better for coding, Grok 3 [Beta] or Nemotron-4 15B?

Nemotron-4 15B leads in coding with an average score of 46 vs 34.

Which is better for math, Grok 3 [Beta] or Nemotron-4 15B?

Nemotron-4 15B leads in math with an average score of 53 vs 41.

Which is better for reasoning, Grok 3 [Beta] or Nemotron-4 15B?

Nemotron-4 15B leads in reasoning with an average score of 51 vs 39.

Related Comparisons

Grok 3 [Beta] vs GPT-5.4Grok 3 [Beta] vs Gemini 3.1 ProGrok 3 [Beta] vs Claude Opus 4.6Grok 3 [Beta] vs GPT-5.3 CodexGrok 3 [Beta] vs Grok 4.1Grok 3 [Beta] vs GPT-5.2