Model comparison
DeepSeek V4 Flash Base vs Nemotron 3 Ultra
Head-to-head evidence from 2 shared benchmark results across 2 categories. Overall scores shown here use the public BenchAlign v5 ranking lane.
Verified leaderboard positions: DeepSeek V4 Flash Base unranked; Nemotron 3 Ultra #24
Evidence parity. DeepSeek V4 Flash Base and Nemotron 3 Ultra share 2 comparable benchmark results. 2 of 8 categories are comparable. 22 results are unique to DeepSeek V4 Flash Base; 37 to Nemotron 3 Ultra.
Updated July 16, 2026- Shared results
- 2
- DeepSeek V4 Flash Base only
- 22
- Nemotron 3 Ultra only
- 37
- Comparable categories
- 2 / 8
Pick Nemotron 3 Ultra if you want the stronger benchmark profile. DeepSeek V4 Flash Base only becomes the better choice if knowledge is the priority or you would rather avoid the extra latency and token burn of a reasoning model.
Confidence note. This is a partial-evidence comparison with 2 shared benchmark results across 2 evidence categories; 2 of 8 categories currently have scoreable aggregates for both models. Treat the verdict as directional until coverage is more balanced.
Why this result
Nemotron 3 Ultra is clearly ahead on the provisional aggregate, 60 to 40. The gap is large enough that you do not need to squint at the spreadsheet to see the difference.
Nemotron 3 Ultra's sharpest advantage is in reasoning, where it averages 61.9 against 44.7. The single biggest benchmark swing on the page is MMLU-Pro, 68.3% to 86.8%. DeepSeek V4 Flash Base does hit back in knowledge, so the answer changes if that is the part of the workload you care about most.
Nemotron 3 Ultra is the reasoning model in the pair, while DeepSeek V4 Flash Base is not. That usually helps on harder chain-of-thought-heavy tests, but it can also mean more latency and more token spend in real use.
Category breakdown
Exact category averages are shown below. Not measured means BenchLM does not have enough sourced public coverage for that model and category.
| Category | DeepSeek V4 Flash Base | Δ | Nemotron 3 Ultra |
|---|---|---|---|
| Reasoning | DeepSeek V4 Flash Base44.7 | Margin→ 17.2 | Nemotron 3 Ultra61.9 |
| Knowledge | DeepSeek V4 Flash Base56.5 | Margin← 2.3 | Nemotron 3 Ultra54.2 |
| Agentic | DeepSeek V4 Flash BaseNot measured | MarginNo overlap | Nemotron 3 Ultra51.3 |
| Coding | DeepSeek V4 Flash BaseNot measured | MarginNo overlap | Nemotron 3 Ultra58.3 |
| Multilingual | DeepSeek V4 Flash BaseNot measured | MarginNo overlap | Nemotron 3 Ultra83.0 |
| Inst. Following | DeepSeek V4 Flash BaseNot measured | MarginNo overlap | Nemotron 3 Ultra81.7 |
Decisive benchmark drivers
The largest measured benchmark gaps in this matchup, with exact reported values.
More
- Source ↗
MMLU-Pro
KnowledgeA 68.3%B 86.8%Winner: Nemotron 3 UltraΔ 18.5MMLU-Pro: DeepSeek V4 Flash Base scored 68.3%; Nemotron 3 Ultra scored 86.8%. Nemotron 3 Ultra wins this benchmark. - Source ↗
LongBench v2
ReasoningA 44.7%B 61.9%Winner: Nemotron 3 UltraΔ 17.2LongBench v2: DeepSeek V4 Flash Base scored 44.7%; Nemotron 3 Ultra scored 61.9%. Nemotron 3 Ultra wins this benchmark.
Operational comparison
Runtime and commercial metrics are compared only when both models have a complete sourced value.
| Metric | DeepSeek V4 Flash Base | Nemotron 3 Ultra | Comparison |
|---|---|---|---|
| Input / output priceUSD per 1M tokens | DeepSeek V4 Flash BaseNot available | Nemotron 3 Ultra$0 input / $0 output | A complete price comparison is not available. |
| Generation speedtokens per second | DeepSeek V4 Flash BaseNot available | Nemotron 3 UltraNot available | A complete speed comparison is not available. |
| First-answer latencyseconds to first token | DeepSeek V4 Flash BaseNot available | Nemotron 3 UltraNot available | A complete latency comparison is not available. |
| Context windowmaximum listed tokens | DeepSeek V4 Flash Base1M | Nemotron 3 Ultra1M | Listed context windows are equal. |
Benchmark Deep Dive
Agentic12 benchmarks
| Benchmark | DeepSeek V4 Flash Base | Nemotron 3 Ultra | Result |
|---|---|---|---|
| Terminal-Bench 2.0Source | — | 56.4% | Not comparable |
| PinchBenchSource | — | 90.0% | Not comparable |
| BrowseCompSource | — | 44.4% | Not comparable |
| τ³-bench resultsSource | — | 70.9% | Not comparable |
| GDPval-AASource | — | 33.2% | Not comparable |
| HLE w/ toolsSource | — | 37.4% | Not comparable |
| AA Agentic IndexSource | — | 27.4% | Not comparable |
| τ²-bench resultsSource | — | 83.3% | Not comparable |
| GDPval-AASource | — | 1164 | Not comparable |
| AA BriefcaseSource | — | 870 | Not comparable |
| AA EnterpriseOps-GymSource | — | 28.9% | Not comparable |
| AA Harvey LABSource | — | 3.3% | Not comparable |
Coding10 benchmarks
| Benchmark | DeepSeek V4 Flash Base | Nemotron 3 Ultra | Result |
|---|---|---|---|
| BigCodeBenchSource | 56.8% | — | Not comparable |
| HumanEvalSource | 69.5% | — | Not comparable |
| SWE-bench VerifiedSource | — | 71.9% | Not comparable |
| SWE MultilingualSource | — | 67.7% | Not comparable |
| LiveCodeBench v6Source | — | 89.0% | Not comparable |
| SciCodeSource | — | 44.6% | Not comparable |
| Terminal-Bench 2.0Source | — | 56.4% | Not comparable |
| AA Coding IndexSource | — | 49.3% | Not comparable |
| Terminal-Bench HardSource | — | 36.4% | Not comparable |
| AA-SciCodeSource | — | 39.9% | Not comparable |
ReasoningNemotron 3 Ultra wins8 benchmarks
| Benchmark | DeepSeek V4 Flash Base | Nemotron 3 Ultra | Result |
|---|---|---|---|
| BBHSource | 86.9% | — | Not comparable |
| DROPSource | 88.6% | — | Not comparable |
| HellaSwagSource | 85.7% | — | Not comparable |
| WinoGrandeSource | 79.5% | — | Not comparable |
| CLUEWSCSource | 82.2% | — | Not comparable |
| LongBench v2Source | 44.7% | 61.9% | Nemotron 3 Ultra leads |
| AA-LCRSource | — | 67.0% | Not comparable |
| CritPtSource | — | 3.1% | Not comparable |
KnowledgeDeepSeek V4 Flash Base wins23 benchmarks
| Benchmark | DeepSeek V4 Flash Base | Nemotron 3 Ultra | Result |
|---|---|---|---|
| AGIEvalSource | 82.6% | — | Not comparable |
| MMLUSource | 88.7% | — | Not comparable |
| MMLU-ReduxSource | 89.4% | — | Not comparable |
| MMLU-ProSource | 68.3% | 86.8% | Nemotron 3 Ultra leads |
| MMMLUSource | 88.8% | — | Not comparable |
| C-EvalSource | 92.1% | — | Not comparable |
| CMMLUSource | 90.4% | — | Not comparable |
| MultiLoKoSource | 42.2% | — | Not comparable |
| SimpleQASource | 30.1% | — | Not comparable |
| SuperGPQASource | 46.5% | — | Not comparable |
| FACTS ParametricSource | 33.9% | — | Not comparable |
| TriviaQASource | 82.8% | — | Not comparable |
| GPQASource | — | 87% | Not comparable |
| GPQA-DSource | — | 87.0% | Not comparable |
| HLESource | — | 26.7% | Not comparable |
| HLE w/o toolsSource | — | 26.7% | Not comparable |
| AA-Omniscience AccuracySource | — | 21.6% | Not comparable |
| Artificial Analysis Intelligence IndexSource | — | 37.8% | Not comparable |
| AA-GPQA DiamondSource | — | 86.7% | Not comparable |
| AA-HLESource | — | 26.6% | Not comparable |
| AA-Omniscience IndexSource | — | -0.8% | Not comparable |
| AA-Omniscience Hallucination RateSource | — | 28.5% | Not comparable |
| AA Openness IndexSource | — | 83.3% | Not comparable |
Math3 benchmarks
Multilingual2 benchmarks
Multimodal1 benchmarks
| Benchmark | DeepSeek V4 Flash Base | Nemotron 3 Ultra | Result |
|---|---|---|---|
| Design Arena WebsiteSource | — | 1132 | Not comparable |
Frequently Asked Questions (3)
Which is better, DeepSeek V4 Flash Base or Nemotron 3 Ultra?
Nemotron 3 Ultra is ahead on BenchLM's provisional leaderboard, 60 to 40. The biggest single separator in this matchup is MMLU-Pro, where the scores are 68.3% and 86.8%.
Which is better for knowledge tasks, DeepSeek V4 Flash Base or Nemotron 3 Ultra?
DeepSeek V4 Flash Base has the edge for knowledge tasks in this comparison, averaging 56.5 versus 54.2. Inside this category, MMLU-Pro is the benchmark that creates the most daylight between them.
Which is better for reasoning, DeepSeek V4 Flash Base or Nemotron 3 Ultra?
Nemotron 3 Ultra has the edge for reasoning in this comparison, averaging 61.9 versus 44.7. Inside this category, LongBench v2 is the benchmark that creates the most daylight between them.
Related Comparisons
Explore More
The AI models change fast. We track them for you.
A weekly brief for engineers and researchers covering new models, ranking shifts, and pricing changes.
Free. No spam. Unsubscribe anytime.