Skip to main content
BenchLM
Data

RULER at a 64K-token context (RULER (64K))

We show this table for reference; we do not rank on it.

Data verified

Synthetic long-context benchmark of retrieval, multi-hop tracing, aggregation and question answering, scored at a 64K-token context.

Benchmark score on RULER (64K) — October 29, 2026

We compile the RULER (64K) rows from provider self-reports. The table contains 2 models. Nemotron 3.5 Bolt E4B BF16 has the highest published score at 86.99%, but the available coverage and evaluation setups do not establish a market leader. We do not use these results to rank models overall.

2 modelsReasoningRefreshingDisplay onlyUpdated October 29, 2026

Benchmark score table (2 models)

Benchmark score results for RULER (64K)
RankModel / configurationScoreParameters (B)Open / closed
1Nemotron 3.5 Bolt E4B BF16NVIDIA
86.99%
Not reportedOpen
2Nemotron 3.5 Bolt E4BNVIDIA
85.76%
Not reportedOpen

How to read this leaderboard

Operator receipt: 2 sourced rows are currently displayable on this page; the highest published score among these 2 models is Nemotron 3.5 Bolt E4B BF16 at 86.99%, which does not establish a market leader.

Honest limit: One context length only. Only NVIDIA-run results are stored so far, from one harness. Display-only and excluded from weighted ranking.

About RULER (64K)

Year

2024

Tasks

Synthetic long-context tasks

Format

Overall accuracy at 64K

Difficulty

Long-context retrieval and reasoning

NVIDIA reports it for Nemotron 3.5 Bolt E4B (October 23, 2026), run in its NeMo Gym harness, as overall accuracy at 64K with reasoning off. The RULER context-length report compares 128K values, so 64K launch reports stay on this key.

Freshness and provenance

Version

RULER (64K) 2024

Refresh cadence

Annual

Staleness state

Refreshing

Question availability

Public benchmark set

RefreshingDisplay only

BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.

Questions

What does RULER (64K) measure?

Synthetic long-context benchmark of retrieval, multi-hop tracing, aggregation and question answering, scored at a 64K-token context.

Which model scores highest on RULER (64K)?

Nemotron 3.5 Bolt E4B BF16 by NVIDIA currently leads with a score of 86.99% on RULER (64K).

How many models are evaluated on RULER (64K)?

2 AI models have published results on RULER (64K) in the BenchLM catalog.

Last updated: October 29, 2026 · BenchLM version RULER (64K) 2024

Know when it’s worth switching models

The model to choose, the cheaper alternative, and the release we would wait on.

Read a sample issue

Join 6,100+ subscribers.

One email each week. Unsubscribe anytime.