benchlm.ai

Nemotron-4 15B vs o4-mini (high)

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

o4-mini (high) wins overall with a score of 65 vs 45 (20 point difference).o4-mini (high) wins 4 out of 4 categories.

Nemotron-4 15B

CreatorNVIDIA
TypeOpen Weight
Context32K
Score45

o4-mini (high)

CreatorOpenAI
TypeProprietary
Context200K
Score65

Knowledge

o4-mini (high)

Nemotron-4 15B

51.8

o4-mini (high)

80.5

54
MMLU
82
53
GPQA
82
51
SuperGPQA
80
49
OpenBookQA
78

Coding

o4-mini (high)

Nemotron-4 15B

46

o4-mini (high)

74

46
HumanEval
74

Mathematics

o4-mini (high)

Nemotron-4 15B

53

o4-mini (high)

82

54
AIME 2023
83
56
AIME 2024
85
55
AIME 2025
84
50
HMMT Feb 2023
79
52
HMMT Feb 2024
81
51
HMMT Feb 2025
80
53
BRUMO 2025
82

Reasoning

o4-mini (high)

Nemotron-4 15B

51

o4-mini (high)

79

52
SimpleQA
80
50
MuSR
78

Frequently Asked Questions

Which is better, Nemotron-4 15B or o4-mini (high)?

o4-mini (high) scores higher overall with 65 vs 45, a difference of 20 points across all benchmarks.

Which is better for knowledge tasks, Nemotron-4 15B or o4-mini (high)?

o4-mini (high) leads in knowledge tasks with an average score of 80.5 vs 51.8.

Which is better for coding, Nemotron-4 15B or o4-mini (high)?

o4-mini (high) leads in coding with an average score of 74 vs 46.

Which is better for math, Nemotron-4 15B or o4-mini (high)?

o4-mini (high) leads in math with an average score of 82 vs 53.

Which is better for reasoning, Nemotron-4 15B or o4-mini (high)?

o4-mini (high) leads in reasoning with an average score of 79 vs 51.

Related Comparisons

Nemotron-4 15B vs GPT-5.4Nemotron-4 15B vs Gemini 3.1 ProNemotron-4 15B vs Claude Opus 4.6Nemotron-4 15B vs GPT-5.3 CodexNemotron-4 15B vs Grok 4.1Nemotron-4 15B vs GPT-5.2