benchlm.ai

Llama 4 Maverick vs Nemotron Ultra 253B

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

Nemotron Ultra 253B wins overall with a score of 40 vs 37 (3 point difference).Nemotron Ultra 253B wins 4 out of 4 categories.

Llama 4 Maverick

CreatorMeta
TypeOpen Weight
Context32K
Score37

Nemotron Ultra 253B

CreatorNVIDIA
TypeOpen Weight
Context32K
Score40

Knowledge

Nemotron Ultra 253B

Llama 4 Maverick

43.8

Nemotron Ultra 253B

46.8

46
MMLU
49
45
GPQA
48
43
SuperGPQA
46
41
OpenBookQA
44

Coding

Nemotron Ultra 253B

Llama 4 Maverick

38

Nemotron Ultra 253B

41

38
HumanEval
41

Mathematics

Nemotron Ultra 253B

Llama 4 Maverick

45

Nemotron Ultra 253B

48

46
AIME 2023
49
48
AIME 2024
51
47
AIME 2025
50
42
HMMT Feb 2023
45
44
HMMT Feb 2024
47
43
HMMT Feb 2025
46
45
BRUMO 2025
48

Reasoning

Nemotron Ultra 253B

Llama 4 Maverick

43

Nemotron Ultra 253B

46

44
SimpleQA
47
42
MuSR
45

Frequently Asked Questions

Which is better, Llama 4 Maverick or Nemotron Ultra 253B?

Nemotron Ultra 253B scores higher overall with 40 vs 37, a difference of 3 points across all benchmarks.

Which is better for knowledge tasks, Llama 4 Maverick or Nemotron Ultra 253B?

Nemotron Ultra 253B leads in knowledge tasks with an average score of 46.8 vs 43.8.

Which is better for coding, Llama 4 Maverick or Nemotron Ultra 253B?

Nemotron Ultra 253B leads in coding with an average score of 41 vs 38.

Which is better for math, Llama 4 Maverick or Nemotron Ultra 253B?

Nemotron Ultra 253B leads in math with an average score of 48 vs 45.

Which is better for reasoning, Llama 4 Maverick or Nemotron Ultra 253B?

Nemotron Ultra 253B leads in reasoning with an average score of 46 vs 43.

Related Comparisons

Llama 4 Maverick vs GPT-5.4Llama 4 Maverick vs Gemini 3.1 ProLlama 4 Maverick vs Claude Opus 4.6Llama 4 Maverick vs GPT-5.3 CodexLlama 4 Maverick vs Grok 4.1Llama 4 Maverick vs GPT-5.2