benchlm.ai

Nemotron Ultra 253B vs Qwen3 235B 2507

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

Nemotron Ultra 253B wins overall with a score of 40 vs 30 (10 point difference).Nemotron Ultra 253B wins 4 out of 4 categories.

Nemotron Ultra 253B

CreatorNVIDIA
TypeOpen Weight
Context32K
Score40

Qwen3 235B 2507

CreatorAlibaba
TypeOpen Weight
Context128K
Score30

Knowledge

Nemotron Ultra 253B

Nemotron Ultra 253B

46.8

Qwen3 235B 2507

36.8

49
MMLU
39
48
GPQA
38
46
SuperGPQA
36
44
OpenBookQA
34

Coding

Nemotron Ultra 253B

Nemotron Ultra 253B

41

Qwen3 235B 2507

31

41
HumanEval
31

Mathematics

Nemotron Ultra 253B

Nemotron Ultra 253B

48

Qwen3 235B 2507

38

49
AIME 2023
39
51
AIME 2024
41
50
AIME 2025
40
45
HMMT Feb 2023
35
47
HMMT Feb 2024
37
46
HMMT Feb 2025
36
48
BRUMO 2025
38

Reasoning

Nemotron Ultra 253B

Nemotron Ultra 253B

46

Qwen3 235B 2507

36

47
SimpleQA
37
45
MuSR
35

Frequently Asked Questions

Which is better, Nemotron Ultra 253B or Qwen3 235B 2507?

Nemotron Ultra 253B scores higher overall with 40 vs 30, a difference of 10 points across all benchmarks.

Which is better for knowledge tasks, Nemotron Ultra 253B or Qwen3 235B 2507?

Nemotron Ultra 253B leads in knowledge tasks with an average score of 46.8 vs 36.8.

Which is better for coding, Nemotron Ultra 253B or Qwen3 235B 2507?

Nemotron Ultra 253B leads in coding with an average score of 41 vs 31.

Which is better for math, Nemotron Ultra 253B or Qwen3 235B 2507?

Nemotron Ultra 253B leads in math with an average score of 48 vs 38.

Which is better for reasoning, Nemotron Ultra 253B or Qwen3 235B 2507?

Nemotron Ultra 253B leads in reasoning with an average score of 46 vs 36.

Related Comparisons

Nemotron Ultra 253B vs GPT-5.4Nemotron Ultra 253B vs Gemini 3.1 ProNemotron Ultra 253B vs Claude Opus 4.6Nemotron Ultra 253B vs GPT-5.3 CodexNemotron Ultra 253B vs Grok 4.1Nemotron Ultra 253B vs GPT-5.2