benchlm.ai

Nemotron-4 15B vs Nemotron Ultra 253B

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

Nemotron-4 15B wins overall with a score of 45 vs 40 (5 point difference).Nemotron-4 15B wins 4 out of 4 categories.

Nemotron-4 15B

CreatorNVIDIA
TypeOpen Weight
Context32K
Score45

Nemotron Ultra 253B

CreatorNVIDIA
TypeOpen Weight
Context32K
Score40

Knowledge

Nemotron-4 15B

Nemotron-4 15B

51.8

Nemotron Ultra 253B

46.8

54
MMLU
49
53
GPQA
48
51
SuperGPQA
46
49
OpenBookQA
44

Coding

Nemotron-4 15B

Nemotron-4 15B

46

Nemotron Ultra 253B

41

46
HumanEval
41

Mathematics

Nemotron-4 15B

Nemotron-4 15B

53

Nemotron Ultra 253B

48

54
AIME 2023
49
56
AIME 2024
51
55
AIME 2025
50
50
HMMT Feb 2023
45
52
HMMT Feb 2024
47
51
HMMT Feb 2025
46
53
BRUMO 2025
48

Reasoning

Nemotron-4 15B

Nemotron-4 15B

51

Nemotron Ultra 253B

46

52
SimpleQA
47
50
MuSR
45

Frequently Asked Questions

Which is better, Nemotron-4 15B or Nemotron Ultra 253B?

Nemotron-4 15B scores higher overall with 45 vs 40, a difference of 5 points across all benchmarks.

Which is better for knowledge tasks, Nemotron-4 15B or Nemotron Ultra 253B?

Nemotron-4 15B leads in knowledge tasks with an average score of 51.8 vs 46.8.

Which is better for coding, Nemotron-4 15B or Nemotron Ultra 253B?

Nemotron-4 15B leads in coding with an average score of 46 vs 41.

Which is better for math, Nemotron-4 15B or Nemotron Ultra 253B?

Nemotron-4 15B leads in math with an average score of 53 vs 48.

Which is better for reasoning, Nemotron-4 15B or Nemotron Ultra 253B?

Nemotron-4 15B leads in reasoning with an average score of 51 vs 46.

Related Comparisons

Nemotron-4 15B vs GPT-5.4Nemotron-4 15B vs Gemini 3.1 ProNemotron-4 15B vs Claude Opus 4.6Nemotron-4 15B vs GPT-5.3 CodexNemotron-4 15B vs Grok 4.1Nemotron-4 15B vs GPT-5.2