benchlm.ai

GPT-OSS 20B vs Nemotron 3 Ultra 500B

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

Nemotron 3 Ultra 500B wins overall with a score of 60 vs 22 (38 point difference).Nemotron 3 Ultra 500B wins 4 out of 4 categories.

GPT-OSS 20B

CreatorOpenAI
TypeOpen Weight
Context128K
Score22

Nemotron 3 Ultra 500B

CreatorNVIDIA
TypeOpen Weight
Context32K
Score60

Knowledge

Nemotron 3 Ultra 500B

GPT-OSS 20B

28.8

Nemotron 3 Ultra 500B

71.8

31
MMLU
74
30
GPQA
73
28
SuperGPQA
71
26
OpenBookQA
69

Coding

Nemotron 3 Ultra 500B

GPT-OSS 20B

23

Nemotron 3 Ultra 500B

66

23
HumanEval
66

Mathematics

Nemotron 3 Ultra 500B

GPT-OSS 20B

30

Nemotron 3 Ultra 500B

73

31
AIME 2023
74
33
AIME 2024
76
32
AIME 2025
75
27
HMMT Feb 2023
70
29
HMMT Feb 2024
72
28
HMMT Feb 2025
71
30
BRUMO 2025
73

Reasoning

Nemotron 3 Ultra 500B

GPT-OSS 20B

28

Nemotron 3 Ultra 500B

70

29
SimpleQA
71
27
MuSR
69

Frequently Asked Questions

Which is better, GPT-OSS 20B or Nemotron 3 Ultra 500B?

Nemotron 3 Ultra 500B scores higher overall with 60 vs 22, a difference of 38 points across all benchmarks.

Which is better for knowledge tasks, GPT-OSS 20B or Nemotron 3 Ultra 500B?

Nemotron 3 Ultra 500B leads in knowledge tasks with an average score of 71.8 vs 28.8.

Which is better for coding, GPT-OSS 20B or Nemotron 3 Ultra 500B?

Nemotron 3 Ultra 500B leads in coding with an average score of 66 vs 23.

Which is better for math, GPT-OSS 20B or Nemotron 3 Ultra 500B?

Nemotron 3 Ultra 500B leads in math with an average score of 73 vs 30.

Which is better for reasoning, GPT-OSS 20B or Nemotron 3 Ultra 500B?

Nemotron 3 Ultra 500B leads in reasoning with an average score of 70 vs 28.

Related Comparisons

GPT-OSS 20B vs GPT-5.4GPT-OSS 20B vs Gemini 3.1 ProGPT-OSS 20B vs Claude Opus 4.6GPT-OSS 20B vs GPT-5.3 CodexGPT-OSS 20B vs Grok 4.1GPT-OSS 20B vs GPT-5.2