Model comparison
Hy3 Preview vs Nemotron 3 Ultra
Head-to-head evidence from 21 shared benchmark results across 5 categories. Overall scores shown here use the public BenchAlign v5 ranking lane.
Verified leaderboard positions: Hy3 Preview unranked; Nemotron 3 Ultra #24
Evidence parity. Hy3 Preview and Nemotron 3 Ultra share 21 comparable benchmark results. 4 of 8 categories are comparable. 1 result is unique to Hy3 Preview; 18 to Nemotron 3 Ultra.
Updated July 16, 2026- Shared results
- 21
- Hy3 Preview only
- 1
- Nemotron 3 Ultra only
- 18
- Comparable categories
- 4 / 8
Pick Nemotron 3 Ultra if you want the stronger benchmark profile. Hy3 Preview only becomes the better choice if agentic is the priority.
Confidence note. This is a partial-evidence comparison with 21 shared benchmark results across 5 evidence categories; 4 of 8 categories currently have scoreable aggregates for both models. Treat the verdict as directional until coverage is more balanced.
Why this result
Nemotron 3 Ultra is clearly ahead on the provisional aggregate, 60 to 53. The gap is large enough that you do not need to squint at the spreadsheet to see the difference.
Nemotron 3 Ultra's sharpest advantage is in knowledge, where it averages 54.2 against 33.8. The single biggest benchmark swing on the page is IFBench, 63.1% to 81.7%. Hy3 Preview does hit back in agentic, so the answer changes if that is the part of the workload you care about most.
Nemotron 3 Ultra gives you the larger context window at 1M, compared with 256K for Hy3 Preview.
Category breakdown
Exact category averages are shown below. Not measured means BenchLM does not have enough sourced public coverage for that model and category.
| Category | Hy3 Preview | Δ | Nemotron 3 Ultra |
|---|---|---|---|
| Knowledge | Hy3 Preview33.8 | Margin→ 20.4 | Nemotron 3 Ultra54.2 |
| Inst. Following | Hy3 Preview63.1 | Margin→ 18.6 | Nemotron 3 Ultra81.7 |
| Agentic | Hy3 Preview54.4 | Margin← 3.1 | Nemotron 3 Ultra51.3 |
| Coding | Hy3 Preview57.8 | Margin→ 0.5 | Nemotron 3 Ultra58.3 |
| Reasoning | Hy3 PreviewNot measured | MarginNo overlap | Nemotron 3 Ultra61.9 |
| Multilingual | Hy3 PreviewNot measured | MarginNo overlap | Nemotron 3 Ultra83.0 |
Decisive benchmark drivers
The largest measured benchmark gaps in this matchup, with exact reported values.
More
- Source ↗
IFBench
Inst. FollowingA 63.1%B 81.7%Winner: Nemotron 3 UltraΔ 18.6IFBench: Hy3 Preview scored 63.1%; Nemotron 3 Ultra scored 81.7%. Nemotron 3 Ultra wins this benchmark. - Source ↗
SciCode
CodingA 41.2%B 44.6%Winner: Nemotron 3 UltraΔ 3.4SciCode: Hy3 Preview scored 41.2%; Nemotron 3 Ultra scored 44.6%. Nemotron 3 Ultra wins this benchmark. - Source ↗
SWE-bench Verified
CodingA 74.4%B 71.9%Winner: Hy3 PreviewΔ 2.5SWE-bench Verified: Hy3 Preview scored 74.4%; Nemotron 3 Ultra scored 71.9%. Hy3 Preview wins this benchmark. - Source ↗
Terminal-Bench 2.0
AgenticA 54.4%B 56.4%Winner: Nemotron 3 UltraΔ 2Terminal-Bench 2.0: Hy3 Preview scored 54.4%; Nemotron 3 Ultra scored 56.4%. Nemotron 3 Ultra wins this benchmark. - Source ↗
HLE
KnowledgeA 25.5%B 26.7%Winner: Nemotron 3 UltraΔ 1.2HLE: Hy3 Preview scored 25.5%; Nemotron 3 Ultra scored 26.7%. Nemotron 3 Ultra wins this benchmark.
Operational comparison
Runtime and commercial metrics are compared only when both models have a complete sourced value.
| Metric | Hy3 Preview | Nemotron 3 Ultra | Comparison |
|---|---|---|---|
| Input / output priceUSD per 1M tokens | Hy3 Preview$0 input / $0 output | Nemotron 3 Ultra$0 input / $0 output | Listed prices are equal. |
| Generation speedtokens per second | Hy3 PreviewNot available | Nemotron 3 UltraNot available | A complete speed comparison is not available. |
| First-answer latencyseconds to first token | Hy3 PreviewNot available | Nemotron 3 UltraNot available | A complete latency comparison is not available. |
| Context windowmaximum listed tokens | Hy3 Preview256K | Nemotron 3 Ultra1M | Nemotron 3 Ultra lists the larger context window. |
Benchmark Deep Dive
AgenticHy3 Preview wins13 benchmarks
| Benchmark | Hy3 Preview | Nemotron 3 Ultra | Result |
|---|---|---|---|
| Terminal-Bench 2.0Source | 54.4% | 56.4% | Nemotron 3 Ultra leads |
| Gert LabsSource | 36.91% | — | Not comparable |
| AA Agentic IndexSource | 30.7% | 27.4% | Hy3 Preview leads |
| GDPval-AASource | 35.7% | 33.2% | Hy3 Preview leads |
| GDPval-AASource | 1214 | 1164 | Hy3 Preview leads |
| PinchBenchSource | — | 90.0% | Not comparable |
| BrowseCompSource | — | 44.4% | Not comparable |
| τ³-bench resultsSource | — | 70.9% | Not comparable |
| HLE w/ toolsSource | — | 37.4% | Not comparable |
| τ²-bench resultsSource | — | 83.3% | Not comparable |
| AA BriefcaseSource | — | 870 | Not comparable |
| AA EnterpriseOps-GymSource | — | 28.9% | Not comparable |
| AA Harvey LABSource | — | 3.3% | Not comparable |
CodingNemotron 3 Ultra wins8 benchmarks
| Benchmark | Hy3 Preview | Nemotron 3 Ultra | Result |
|---|---|---|---|
| SWE-bench VerifiedSource | 74.4% | 71.9% | Hy3 Preview leads |
| Terminal-Bench 2.0Source | 54.4% | 56.4% | Nemotron 3 Ultra leads |
| SciCodeSource | 41.2% | 44.6% | Nemotron 3 Ultra leads |
| AA-SciCodeSource | 47.6% | 39.9% | Hy3 Preview leads |
| AA Coding IndexSource | 58.8% | 49.3% | Hy3 Preview leads |
| SWE MultilingualSource | — | 67.7% | Not comparable |
| LiveCodeBench v6Source | — | 89.0% | Not comparable |
| Terminal-Bench HardSource | — | 36.4% | Not comparable |
Reasoning3 benchmarks
KnowledgeNemotron 3 Ultra wins12 benchmarks
| Benchmark | Hy3 Preview | Nemotron 3 Ultra | Result |
|---|---|---|---|
| Artificial Analysis Intelligence IndexSource | 41.2% | 37.8% | Hy3 Preview leads |
| GPQASource | 87.2% | 87% | Hy3 Preview leads |
| GPQA-DSource | 87.2% | 87.0% | Hy3 Preview leads |
| HLESource | 25.5% | 26.7% | Nemotron 3 Ultra leads |
| AA-Omniscience AccuracySource | 31.5% | 21.6% | Hy3 Preview leads |
| AA-Omniscience Hallucination RateSource | 73.0% | 28.5% | Nemotron 3 Ultra leads |
| AA-GPQA DiamondSource | 89.7% | 86.7% | Hy3 Preview leads |
| AA-HLESource | 31.6% | 26.6% | Hy3 Preview leads |
| AA-Omniscience IndexSource | -18.5% | -0.8% | Nemotron 3 Ultra leads |
| HLE w/o toolsSource | — | 26.7% | Not comparable |
| MMLU-ProSource | — | 86.8% | Not comparable |
| AA Openness IndexSource | — | 83.3% | Not comparable |
Multilingual1 benchmarks
| Benchmark | Hy3 Preview | Nemotron 3 Ultra | Result |
|---|---|---|---|
| MMLU-ProXSource | — | 83% | Not comparable |
Multimodal1 benchmarks
| Benchmark | Hy3 Preview | Nemotron 3 Ultra | Result |
|---|---|---|---|
| Design Arena WebsiteSource | — | 1132 | Not comparable |
Frequently Asked Questions (5)
Which is better, Hy3 Preview or Nemotron 3 Ultra?
Nemotron 3 Ultra is ahead on BenchLM's provisional leaderboard, 60 to 53. The biggest single separator in this matchup is IFBench, where the scores are 63.1% and 81.7%.
Which is better for knowledge tasks, Hy3 Preview or Nemotron 3 Ultra?
Nemotron 3 Ultra has the edge for knowledge tasks in this comparison, averaging 54.2 versus 33.8. Inside this category, AA-Omniscience Hallucination Rate is the benchmark that creates the most daylight between them.
Which is better for coding, Hy3 Preview or Nemotron 3 Ultra?
Nemotron 3 Ultra has the edge for coding in this comparison, averaging 58.3 versus 57.8. Inside this category, AA Coding Index is the benchmark that creates the most daylight between them.
Which is better for agentic tasks, Hy3 Preview or Nemotron 3 Ultra?
Hy3 Preview has the edge for agentic tasks in this comparison, averaging 54.4 versus 51.3. Inside this category, GDPval-AA is the benchmark that creates the most daylight between them.
Which is better for instruction following, Hy3 Preview or Nemotron 3 Ultra?
Nemotron 3 Ultra has the edge for instruction following in this comparison, averaging 81.7 versus 63.1. Inside this category, IFBench is the benchmark that creates the most daylight between them.
Related Comparisons
Explore More
The AI models change fast. We track them for you.
A weekly brief for engineers and researchers covering new models, ranking shifts, and pricing changes.
Free. No spam. Unsubscribe anytime.