benchlm.ai

Grok 4 vs Nemotron Ultra 253B

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

Grok 4 wins overall with a score of 69 vs 40 (29 point difference).Grok 4 wins 4 out of 4 categories.

Grok 4

CreatorxAI
TypeProprietary
Context128K
Score69

Nemotron Ultra 253B

CreatorNVIDIA
TypeOpen Weight
Context32K
Score40

Knowledge

Grok 4

Grok 4

84.8

Nemotron Ultra 253B

46.8

87
MMLU
49
86
GPQA
48
84
SuperGPQA
46
82
OpenBookQA
44

Coding

Grok 4

Grok 4

79

Nemotron Ultra 253B

41

79
HumanEval
41

Mathematics

Grok 4

Grok 4

86.6

Nemotron Ultra 253B

48

87
AIME 2023
49
89
AIME 2024
51
88
AIME 2025
50
84
HMMT Feb 2023
45
86
HMMT Feb 2024
47
85
HMMT Feb 2025
46
87
BRUMO 2025
48

Reasoning

Grok 4

Grok 4

82

Nemotron Ultra 253B

46

83
SimpleQA
47
81
MuSR
45

Frequently Asked Questions

Which is better, Grok 4 or Nemotron Ultra 253B?

Grok 4 scores higher overall with 69 vs 40, a difference of 29 points across all benchmarks.

Which is better for knowledge tasks, Grok 4 or Nemotron Ultra 253B?

Grok 4 leads in knowledge tasks with an average score of 84.8 vs 46.8.

Which is better for coding, Grok 4 or Nemotron Ultra 253B?

Grok 4 leads in coding with an average score of 79 vs 41.

Which is better for math, Grok 4 or Nemotron Ultra 253B?

Grok 4 leads in math with an average score of 86.6 vs 48.

Which is better for reasoning, Grok 4 or Nemotron Ultra 253B?

Grok 4 leads in reasoning with an average score of 82 vs 46.

Related Comparisons

Grok 4 vs GPT-5.4Grok 4 vs Gemini 3.1 ProGrok 4 vs Claude Opus 4.6Grok 4 vs GPT-5.3 CodexGrok 4 vs Grok 4.1Grok 4 vs GPT-5.2