benchlm.ai

Nemotron Ultra 253B vs o4-mini (high)

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

o4-mini (high) wins overall with a score of 65 vs 40 (25 point difference).o4-mini (high) wins 4 out of 4 categories.

Nemotron Ultra 253B

CreatorNVIDIA
TypeOpen Weight
Context32K
Score40

o4-mini (high)

CreatorOpenAI
TypeProprietary
Context200K
Score65

Knowledge

o4-mini (high)

Nemotron Ultra 253B

46.8

o4-mini (high)

80.5

49
MMLU
82
48
GPQA
82
46
SuperGPQA
80
44
OpenBookQA
78

Coding

o4-mini (high)

Nemotron Ultra 253B

41

o4-mini (high)

74

41
HumanEval
74

Mathematics

o4-mini (high)

Nemotron Ultra 253B

48

o4-mini (high)

82

49
AIME 2023
83
51
AIME 2024
85
50
AIME 2025
84
45
HMMT Feb 2023
79
47
HMMT Feb 2024
81
46
HMMT Feb 2025
80
48
BRUMO 2025
82

Reasoning

o4-mini (high)

Nemotron Ultra 253B

46

o4-mini (high)

79

47
SimpleQA
80
45
MuSR
78

Frequently Asked Questions

Which is better, Nemotron Ultra 253B or o4-mini (high)?

o4-mini (high) scores higher overall with 65 vs 40, a difference of 25 points across all benchmarks.

Which is better for knowledge tasks, Nemotron Ultra 253B or o4-mini (high)?

o4-mini (high) leads in knowledge tasks with an average score of 80.5 vs 46.8.

Which is better for coding, Nemotron Ultra 253B or o4-mini (high)?

o4-mini (high) leads in coding with an average score of 74 vs 41.

Which is better for math, Nemotron Ultra 253B or o4-mini (high)?

o4-mini (high) leads in math with an average score of 82 vs 48.

Which is better for reasoning, Nemotron Ultra 253B or o4-mini (high)?

o4-mini (high) leads in reasoning with an average score of 79 vs 46.

Related Comparisons

Nemotron Ultra 253B vs GPT-5.4Nemotron Ultra 253B vs Gemini 3.1 ProNemotron Ultra 253B vs Claude Opus 4.6Nemotron Ultra 253B vs GPT-5.3 CodexNemotron Ultra 253B vs Grok 4.1Nemotron Ultra 253B vs GPT-5.2