benchlm.ai

GPT-5 (medium) vs Nemotron Ultra 253B

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

GPT-5 (medium) wins overall with a score of 70 vs 40 (30 point difference).GPT-5 (medium) wins 4 out of 4 categories.

GPT-5 (medium)

CreatorOpenAI
TypeProprietary
Context128K
Score70

Nemotron Ultra 253B

CreatorNVIDIA
TypeOpen Weight
Context32K
Score40

Knowledge

GPT-5 (medium)

GPT-5 (medium)

88

Nemotron Ultra 253B

46.8

91
MMLU
49
89
GPQA
48
87
SuperGPQA
46
85
OpenBookQA
44

Coding

GPT-5 (medium)

GPT-5 (medium)

83

Nemotron Ultra 253B

41

83
HumanEval
41

Mathematics

GPT-5 (medium)

GPT-5 (medium)

92

Nemotron Ultra 253B

48

93
AIME 2023
49
95
AIME 2024
51
94
AIME 2025
50
89
HMMT Feb 2023
45
91
HMMT Feb 2024
47
90
HMMT Feb 2025
46
92
BRUMO 2025
48

Reasoning

GPT-5 (medium)

GPT-5 (medium)

86

Nemotron Ultra 253B

46

87
SimpleQA
47
85
MuSR
45

Frequently Asked Questions

Which is better, GPT-5 (medium) or Nemotron Ultra 253B?

GPT-5 (medium) scores higher overall with 70 vs 40, a difference of 30 points across all benchmarks.

Which is better for knowledge tasks, GPT-5 (medium) or Nemotron Ultra 253B?

GPT-5 (medium) leads in knowledge tasks with an average score of 88 vs 46.8.

Which is better for coding, GPT-5 (medium) or Nemotron Ultra 253B?

GPT-5 (medium) leads in coding with an average score of 83 vs 41.

Which is better for math, GPT-5 (medium) or Nemotron Ultra 253B?

GPT-5 (medium) leads in math with an average score of 92 vs 48.

Which is better for reasoning, GPT-5 (medium) or Nemotron Ultra 253B?

GPT-5 (medium) leads in reasoning with an average score of 86 vs 46.

Related Comparisons

GPT-5 (medium) vs GPT-5.4GPT-5 (medium) vs Gemini 3.1 ProGPT-5 (medium) vs Claude Opus 4.6GPT-5 (medium) vs GPT-5.3 CodexGPT-5 (medium) vs Grok 4.1GPT-5 (medium) vs GPT-5.2