Llama 3.1 405B vs Nemotron Ultra 253B

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

Llama 3.1 405B wins overall with a score of 58 vs 40 (18 point difference).Llama 3.1 405B wins 4 out of 4 categories.

Knowledge

Llama 3.1 405B

Llama 3.1 405B

68.5

Nemotron Ultra 253B

46.8

70
MMLU
49
70
GPQA
48
68
SuperGPQA
46
66
OpenBookQA
44

Coding

Llama 3.1 405B

Llama 3.1 405B

62

Nemotron Ultra 253B

41

62
HumanEval
41

Mathematics

Llama 3.1 405B

Llama 3.1 405B

69

Nemotron Ultra 253B

48

70
AIME 2023
49
72
AIME 2024
51
71
AIME 2025
50
66
HMMT Feb 2023
45
68
HMMT Feb 2024
47
67
HMMT Feb 2025
46
69
BRUMO 2025
48

Reasoning

Llama 3.1 405B

Llama 3.1 405B

67

Nemotron Ultra 253B

46

68
SimpleQA
47
66
MuSR
45

Frequently Asked Questions

Which is better, Llama 3.1 405B or Nemotron Ultra 253B?

Llama 3.1 405B scores higher overall with 58 vs 40, a difference of 18 points across all benchmarks.

Which is better for knowledge tasks, Llama 3.1 405B or Nemotron Ultra 253B?

Llama 3.1 405B leads in knowledge tasks with an average score of 68.5 vs 46.8.

Which is better for coding, Llama 3.1 405B or Nemotron Ultra 253B?

Llama 3.1 405B leads in coding with an average score of 62 vs 41.

Which is better for math, Llama 3.1 405B or Nemotron Ultra 253B?

Llama 3.1 405B leads in math with an average score of 69 vs 48.

Which is better for reasoning, Llama 3.1 405B or Nemotron Ultra 253B?

Llama 3.1 405B leads in reasoning with an average score of 67 vs 46.