Nemotron-4 15B vs o3

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

o3 wins overall with a score of 67 vs 45 (22 point difference).o3 wins 4 out of 4 categories.

Knowledge

o3

Nemotron-4 15B

51.8

o3

85.3

54
MMLU
86
53
GPQA
87
51
SuperGPQA
85
49
OpenBookQA
83

Coding

o3

Nemotron-4 15B

46

o3

78

46
HumanEval
78

Mathematics

o3

Nemotron-4 15B

53

o3

87

54
AIME 2023
88
56
AIME 2024
90
55
AIME 2025
89
50
HMMT Feb 2023
84
52
HMMT Feb 2024
86
51
HMMT Feb 2025
85
53
BRUMO 2025
87

Reasoning

o3

Nemotron-4 15B

51

o3

83

52
SimpleQA
84
50
MuSR
82

Frequently Asked Questions

Which is better, Nemotron-4 15B or o3?

o3 scores higher overall with 67 vs 45, a difference of 22 points across all benchmarks.

Which is better for knowledge tasks, Nemotron-4 15B or o3?

o3 leads in knowledge tasks with an average score of 85.3 vs 51.8.

Which is better for coding, Nemotron-4 15B or o3?

o3 leads in coding with an average score of 78 vs 46.

Which is better for math, Nemotron-4 15B or o3?

o3 leads in math with an average score of 87 vs 53.

Which is better for reasoning, Nemotron-4 15B or o3?

o3 leads in reasoning with an average score of 83 vs 51.