Skip to main content

Vals Public Benefits Bench v1.1 (Public Benefits Bench v1.1)

Can AI help people navigate SNAP benefits?

Data verified

How BenchLM shows Public Benefits Bench v1.1

BenchLM mirrors the public Vals AI Public Benefits Bench v1.1 leaderboard captured from https://www.vals.ai/benchmarks/public-benefits-bench and updated by Vals on July 9, 2026. The snapshot preserves overall scores, uncertainty, latency, cost-per-test metadata, and task-level scores where Vals publishes them.

Public Benefits Bench v1.1 is display only on BenchLM. Vals proprietary or Vals-hosted aggregate views are useful context, but BenchLM does not use them as weighted ranking inputs or as a replacement for benchmark-native source records.

16 Vals rows1 task viewsprivate datasetTasks: OverallDisplay only

Public Benefits Bench v1.1 score on Public Benefits Bench v1.1 — July 9, 2026

BenchLM mirrors the published public benefits bench v1.1 score view for Public Benefits Bench v1.1. Claude Opus 4.8 leads the public snapshot at 68.13% , followed by GPT-5.6 Sol (66.51%) and Claude Sonnet 5 (66.03%). BenchLM does not use these results to rank models overall.

16 modelsExternal benchmark mirrorsCurrentDisplay onlyUpdated July 9, 2026

The published Public Benefits Bench v1.1 snapshot is tightly clustered at the top: Claude Opus 4.8 sits at 68.13%, while the third row is only 2.10 points behind. The broader top-10 spread is 7.24 points, so many of the published scores sit in a relatively narrow band.

16 models have been evaluated on Public Benefits Bench v1.1. The benchmark falls in the External benchmark mirrors category. BenchLM tracks this category separately from its weighted global scoring system, so these results are best compared on the dedicated Korean benchmark views. Public Benefits Bench v1.1 is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.

About Public Benefits Bench v1.1

Year

2026

Tasks

SNAP public-benefits navigation tasks

Format

Accuracy score

Difficulty

Public-benefits policy navigation

BenchLM mirrors the public Vals AI Public Benefits Bench v1.1 leaderboard as display-only external evidence. The captured snapshot preserves overall scores, task-level scores where Vals publishes them, uncertainty, latency, and cost-per-test metadata. It is excluded from BenchLM weighted rankings.

BenchLM freshness & provenance

Version

Public Benefits Bench v1.1 2026

Refresh cadence

Quarterly

Staleness state

Current

Question availability

Public benchmark set

CurrentDisplay only

BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.

Public Benefits Bench v1.1 score table (16 models)

1
Claude Opus 4.8anthropic/claude-opus-4-8
68.13%
2
GPT-5.6 Solopenai/gpt-5.6-sol
66.51%
3
Claude Sonnet 5anthropic/claude-sonnet-5
66.03%
4
MiniMax M3minimax/MiniMax-M3
64.14%
5
DeepSeek V4 Prodeepseek/deepseek-v4-pro
62.92%
6
Claude Sonnet 4.6anthropic/claude-sonnet-4-6
62.45%
7
GPT-5.6 Terraopenai/gpt-5.6-terra
62.38%
8
GLM 5.1zai/glm-5.1
61.84%
9
Muse Spark 1 1meta/muse_spark_1_1
61.30%
10
GPT-5.5openai/gpt-5.5
60.89%
11
Gemini 3.5 Flashgoogle/gemini-3.5-flash
59.47%
12
Kimi K2.6kimi/kimi-k2.6
56.63%
13
Claude Haiku 4.5anthropic/claude-haiku-4-5-20251001
54.26%
14
Gemini 3.1 Pro Previewgoogle/gemini-3.1-pro-preview
53.79%
15
Grok 4.3grok/grok-4.3
51.69%
16
Grok 4.1 Fast Reasoninggrok/grok-4-1-fast-reasoning
44.79%

FAQ

What does Public Benefits Bench v1.1 measure?

Can AI help people navigate SNAP benefits?

Which model leads the published Public Benefits Bench v1.1 snapshot?

Claude Opus 4.8 currently leads the published Public Benefits Bench v1.1 snapshot with 68.13% public benefits bench v1.1 score. BenchLM shows this benchmark for display only and does not use it in overall rankings.

How many models are evaluated on Public Benefits Bench v1.1?

16 AI models are included in BenchLM's mirrored Public Benefits Bench v1.1 snapshot, based on the public leaderboard captured on July 9, 2026.

Last updated: July 9, 2026 · mirrored from the public benchmark leaderboard

The AI models change fast. We track them for you.

For engineers, researchers, and the plain curious — a weekly brief on new models, ranking shifts, and pricing changes.

Free. No spam. Unsubscribe anytime.