benchlm.ai

Grok 3 [Beta] vs Nemotron Ultra 253B

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

Nemotron Ultra 253B wins overall with a score of 40 vs 33 (7 point difference).Nemotron Ultra 253B wins 4 out of 4 categories.

Grok 3 [Beta]

CreatorxAI
TypeProprietary
Context128K
Score33

Nemotron Ultra 253B

CreatorNVIDIA
TypeOpen Weight
Context32K
Score40

Knowledge

Nemotron Ultra 253B

Grok 3 [Beta]

39.8

Nemotron Ultra 253B

46.8

42
MMLU
49
41
GPQA
48
39
SuperGPQA
46
37
OpenBookQA
44

Coding

Nemotron Ultra 253B

Grok 3 [Beta]

34

Nemotron Ultra 253B

41

34
HumanEval
41

Mathematics

Nemotron Ultra 253B

Grok 3 [Beta]

41

Nemotron Ultra 253B

48

42
AIME 2023
49
44
AIME 2024
51
43
AIME 2025
50
38
HMMT Feb 2023
45
40
HMMT Feb 2024
47
39
HMMT Feb 2025
46
41
BRUMO 2025
48

Reasoning

Nemotron Ultra 253B

Grok 3 [Beta]

39

Nemotron Ultra 253B

46

40
SimpleQA
47
38
MuSR
45

Frequently Asked Questions

Which is better, Grok 3 [Beta] or Nemotron Ultra 253B?

Nemotron Ultra 253B scores higher overall with 40 vs 33, a difference of 7 points across all benchmarks.

Which is better for knowledge tasks, Grok 3 [Beta] or Nemotron Ultra 253B?

Nemotron Ultra 253B leads in knowledge tasks with an average score of 46.8 vs 39.8.

Which is better for coding, Grok 3 [Beta] or Nemotron Ultra 253B?

Nemotron Ultra 253B leads in coding with an average score of 41 vs 34.

Which is better for math, Grok 3 [Beta] or Nemotron Ultra 253B?

Nemotron Ultra 253B leads in math with an average score of 48 vs 41.

Which is better for reasoning, Grok 3 [Beta] or Nemotron Ultra 253B?

Nemotron Ultra 253B leads in reasoning with an average score of 46 vs 39.

Related Comparisons

Grok 3 [Beta] vs GPT-5.4Grok 3 [Beta] vs Gemini 3.1 ProGrok 3 [Beta] vs Claude Opus 4.6Grok 3 [Beta] vs GPT-5.3 CodexGrok 3 [Beta] vs Grok 4.1Grok 3 [Beta] vs GPT-5.2