benchlm.ai

Nemotron-4 15B vs o1-preview

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

o1-preview wins overall with a score of 71 vs 45 (26 point difference).o1-preview wins 4 out of 4 categories.

Nemotron-4 15B

CreatorNVIDIA
TypeOpen Weight
Context32K
Score45

o1-preview

CreatorOpenAI
TypeProprietary
Context200K
Score71

Knowledge

o1-preview

Nemotron-4 15B

51.8

o1-preview

89

54
MMLU
92
53
GPQA
90
51
SuperGPQA
88
49
OpenBookQA
86

Coding

o1-preview

Nemotron-4 15B

46

o1-preview

86

46
HumanEval
86

Mathematics

o1-preview

Nemotron-4 15B

53

o1-preview

93

54
AIME 2023
94
56
AIME 2024
96
55
AIME 2025
95
50
HMMT Feb 2023
90
52
HMMT Feb 2024
92
51
HMMT Feb 2025
91
53
BRUMO 2025
93

Reasoning

o1-preview

Nemotron-4 15B

51

o1-preview

87

52
SimpleQA
88
50
MuSR
86

Frequently Asked Questions

Which is better, Nemotron-4 15B or o1-preview?

o1-preview scores higher overall with 71 vs 45, a difference of 26 points across all benchmarks.

Which is better for knowledge tasks, Nemotron-4 15B or o1-preview?

o1-preview leads in knowledge tasks with an average score of 89 vs 51.8.

Which is better for coding, Nemotron-4 15B or o1-preview?

o1-preview leads in coding with an average score of 86 vs 46.

Which is better for math, Nemotron-4 15B or o1-preview?

o1-preview leads in math with an average score of 93 vs 53.

Which is better for reasoning, Nemotron-4 15B or o1-preview?

o1-preview leads in reasoning with an average score of 87 vs 51.

Related Comparisons

Nemotron-4 15B vs GPT-5.4Nemotron-4 15B vs Gemini 3.1 ProNemotron-4 15B vs Claude Opus 4.6Nemotron-4 15B vs GPT-5.3 CodexNemotron-4 15B vs Grok 4.1Nemotron-4 15B vs GPT-5.2