benchlm.ai

GPT-5 (medium) vs Nemotron 3 Ultra 500B

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

GPT-5 (medium) wins overall with a score of 70 vs 60 (10 point difference).GPT-5 (medium) wins 4 out of 4 categories.

GPT-5 (medium)

CreatorOpenAI
TypeProprietary
Context128K
Score70

Nemotron 3 Ultra 500B

CreatorNVIDIA
TypeOpen Weight
Context32K
Score60

Knowledge

GPT-5 (medium)

GPT-5 (medium)

88

Nemotron 3 Ultra 500B

71.8

91
MMLU
74
89
GPQA
73
87
SuperGPQA
71
85
OpenBookQA
69

Coding

GPT-5 (medium)

GPT-5 (medium)

83

Nemotron 3 Ultra 500B

66

83
HumanEval
66

Mathematics

GPT-5 (medium)

GPT-5 (medium)

92

Nemotron 3 Ultra 500B

73

93
AIME 2023
74
95
AIME 2024
76
94
AIME 2025
75
89
HMMT Feb 2023
70
91
HMMT Feb 2024
72
90
HMMT Feb 2025
71
92
BRUMO 2025
73

Reasoning

GPT-5 (medium)

GPT-5 (medium)

86

Nemotron 3 Ultra 500B

70

87
SimpleQA
71
85
MuSR
69

Frequently Asked Questions

Which is better, GPT-5 (medium) or Nemotron 3 Ultra 500B?

GPT-5 (medium) scores higher overall with 70 vs 60, a difference of 10 points across all benchmarks.

Which is better for knowledge tasks, GPT-5 (medium) or Nemotron 3 Ultra 500B?

GPT-5 (medium) leads in knowledge tasks with an average score of 88 vs 71.8.

Which is better for coding, GPT-5 (medium) or Nemotron 3 Ultra 500B?

GPT-5 (medium) leads in coding with an average score of 83 vs 66.

Which is better for math, GPT-5 (medium) or Nemotron 3 Ultra 500B?

GPT-5 (medium) leads in math with an average score of 92 vs 73.

Which is better for reasoning, GPT-5 (medium) or Nemotron 3 Ultra 500B?

GPT-5 (medium) leads in reasoning with an average score of 86 vs 70.

Related Comparisons

GPT-5 (medium) vs GPT-5.4GPT-5 (medium) vs Gemini 3.1 ProGPT-5 (medium) vs Claude Opus 4.6GPT-5 (medium) vs GPT-5.3 CodexGPT-5 (medium) vs Grok 4.1GPT-5 (medium) vs GPT-5.2