Skip to main content
BenchLM
Data

RULER at 128K context (RULER (128K))

We show this table for reference; we do not rank on it.

Data verified

Synthetic long-context benchmark of retrieval, multi-hop tracing, aggregation and question answering, scored at a 128K-token context.

Benchmark score on RULER (128K) — October 29, 2026

We compile the RULER (128K) rows from provider self-reports. LFM3-1.7B is the only currently displayable sourced row, at 65.56%. We do not use these results to rank models overall.

1 modelReasoningRefreshingDisplay onlyUpdated October 29, 2026

Benchmark score table (1 model)

Benchmark score results for RULER (128K)
RankModel / configurationScoreParameters (B)Open / closed
1LFM3-1.7BLiquidAI
65.56%
Not reportedOpen

How to read this leaderboard

Operator receipt: 1 sourced row is currently displayable on this page; the only currently displayable sourced row is LFM3-1.7B at 65.56%.

Honest limit: Only Liquid AI-run results are stored so far, from one launch table. Display-only and excluded from weighted ranking.

About RULER (128K)

Year

2024

Tasks

Synthetic long-context tasks

Format

Overall accuracy

Difficulty

Long-context retrieval and tracing

Liquid AI reports it for LFM3-1.7B (October 27, 2026), served with vLLM at full context. Kept apart from the 64K RULER lane because scores fall as context grows.

Freshness and provenance

Version

RULER (128K) 2024

Refresh cadence

Annual

Staleness state

Refreshing

Question availability

Public benchmark set

RefreshingDisplay only

BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.

Questions

What does RULER (128K) measure?

Synthetic long-context benchmark of retrieval, multi-hop tracing, aggregation and question answering, scored at a 128K-token context.

Which model scores highest on RULER (128K)?

LFM3-1.7B by LiquidAI currently leads with a score of 65.56% on RULER (128K).

How many models are evaluated on RULER (128K)?

1 AI models have published results on RULER (128K) in the BenchLM catalog.

Last updated: October 29, 2026 · BenchLM version RULER (128K) 2024

Know when it’s worth switching models

The model to choose, the cheaper alternative, and the release we would wait on.

Read a sample issue

Join 6,100+ subscribers.

One email each week. Unsubscribe anytime.