benchlm.ai

Gemini 1.5 Pro vs Nemotron Ultra 253B

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

Gemini 1.5 Pro wins overall with a score of 54 vs 40 (14 point difference).Gemini 1.5 Pro wins 4 out of 4 categories.

Gemini 1.5 Pro

CreatorGoogle
TypeProprietary
Context2M
Score54

Nemotron Ultra 253B

CreatorNVIDIA
TypeOpen Weight
Context32K
Score40

Knowledge

Gemini 1.5 Pro

Gemini 1.5 Pro

62.5

Nemotron Ultra 253B

46.8

64
MMLU
49
64
GPQA
48
62
SuperGPQA
46
60
OpenBookQA
44

Coding

Gemini 1.5 Pro

Gemini 1.5 Pro

56

Nemotron Ultra 253B

41

56
HumanEval
41

Mathematics

Gemini 1.5 Pro

Gemini 1.5 Pro

63

Nemotron Ultra 253B

48

64
AIME 2023
49
66
AIME 2024
51
65
AIME 2025
50
60
HMMT Feb 2023
45
62
HMMT Feb 2024
47
61
HMMT Feb 2025
46
63
BRUMO 2025
48

Reasoning

Gemini 1.5 Pro

Gemini 1.5 Pro

61

Nemotron Ultra 253B

46

62
SimpleQA
47
60
MuSR
45

Frequently Asked Questions

Which is better, Gemini 1.5 Pro or Nemotron Ultra 253B?

Gemini 1.5 Pro scores higher overall with 54 vs 40, a difference of 14 points across all benchmarks.

Which is better for knowledge tasks, Gemini 1.5 Pro or Nemotron Ultra 253B?

Gemini 1.5 Pro leads in knowledge tasks with an average score of 62.5 vs 46.8.

Which is better for coding, Gemini 1.5 Pro or Nemotron Ultra 253B?

Gemini 1.5 Pro leads in coding with an average score of 56 vs 41.

Which is better for math, Gemini 1.5 Pro or Nemotron Ultra 253B?

Gemini 1.5 Pro leads in math with an average score of 63 vs 48.

Which is better for reasoning, Gemini 1.5 Pro or Nemotron Ultra 253B?

Gemini 1.5 Pro leads in reasoning with an average score of 61 vs 46.

Related Comparisons

Gemini 1.5 Pro vs GPT-5.4Gemini 1.5 Pro vs Gemini 3.1 ProGemini 1.5 Pro vs Claude Opus 4.6Gemini 1.5 Pro vs GPT-5.3 CodexGemini 1.5 Pro vs Grok 4.1Gemini 1.5 Pro vs GPT-5.2