benchlm.ai

GPT-5.1-Codex-Max vs Nemotron-4 15B

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

GPT-5.1-Codex-Max wins overall with a score of 77 vs 45 (32 point difference).GPT-5.1-Codex-Max wins 4 out of 4 categories.

GPT-5.1-Codex-Max

CreatorOpenAI
TypeProprietary
Context400K
Score77

Nemotron-4 15B

CreatorNVIDIA
TypeOpen Weight
Context32K
Score45

Knowledge

GPT-5.1-Codex-Max

GPT-5.1-Codex-Max

95

Nemotron-4 15B

51.8

98
MMLU
54
96
GPQA
53
94
SuperGPQA
51
92
OpenBookQA
49

Coding

GPT-5.1-Codex-Max

GPT-5.1-Codex-Max

94

Nemotron-4 15B

46

94
HumanEval
46

Mathematics

GPT-5.1-Codex-Max

GPT-5.1-Codex-Max

97.1

Nemotron-4 15B

53

99
AIME 2023
54
99
AIME 2024
56
98
AIME 2025
55
95
HMMT Feb 2023
50
97
HMMT Feb 2024
52
96
HMMT Feb 2025
51
96
BRUMO 2025
53

Reasoning

GPT-5.1-Codex-Max

GPT-5.1-Codex-Max

93

Nemotron-4 15B

51

94
SimpleQA
52
92
MuSR
50

Frequently Asked Questions

Which is better, GPT-5.1-Codex-Max or Nemotron-4 15B?

GPT-5.1-Codex-Max scores higher overall with 77 vs 45, a difference of 32 points across all benchmarks.

Which is better for knowledge tasks, GPT-5.1-Codex-Max or Nemotron-4 15B?

GPT-5.1-Codex-Max leads in knowledge tasks with an average score of 95 vs 51.8.

Which is better for coding, GPT-5.1-Codex-Max or Nemotron-4 15B?

GPT-5.1-Codex-Max leads in coding with an average score of 94 vs 46.

Which is better for math, GPT-5.1-Codex-Max or Nemotron-4 15B?

GPT-5.1-Codex-Max leads in math with an average score of 97.1 vs 53.

Which is better for reasoning, GPT-5.1-Codex-Max or Nemotron-4 15B?

GPT-5.1-Codex-Max leads in reasoning with an average score of 93 vs 51.

Related Comparisons

GPT-5.1-Codex-Max vs GPT-5.4GPT-5.1-Codex-Max vs Gemini 3.1 ProGPT-5.1-Codex-Max vs Claude Opus 4.6GPT-5.1-Codex-Max vs GPT-5.3 CodexGPT-5.1-Codex-Max vs Grok 4.1GPT-5.1-Codex-Max vs GPT-5.2