Vals ProgramBench (ProgramBench)
We show this table for reference; we do not rank on it.
Can language models rebuild programs from scratch?
Vals ProgramBench mirror score on ProgramBench — September 27, 2026
We mirror the published vals programbench mirror score view for ProgramBench. Claude Opus 5.5 leads the public snapshot at 18.50%, followed by Claude Fable 5.1 (7.00%) and GPT-6 Astra (5.50%). We do not use these results to rank models overall.
Claude Opus 5.5
Anthropic
Claude Fable 5.1
Anthropic
GPT-6 Astra
OpenAI
max reasoning
53 modelsCodingCurrentDisplay onlyUpdated September 27, 2026
Vals ProgramBench mirror score table (53 models)
ScoreHow Vals ProgramBench mirror is shown here
BenchLM mirrors the public Vals AI Vals ProgramBench mirror leaderboard captured from https://www.vals.ai/benchmarks/programbench and updated by Vals on September 27, 2026. The snapshot preserves overall scores, uncertainty, latency, cost-per-test metadata, and task-level scores where Vals publishes them.
Vals ProgramBench mirror is display only on BenchLM. Vals proprietary or Vals-hosted aggregate views are useful context, but BenchLM does not use them as weighted ranking inputs or as a replacement for benchmark-native source records.
Snapshot
The published ProgramBench snapshot places Claude Opus 5.5 first at 18.50%. The third row is 13.00 points behind. The broader top-10 range is 17.50 points, so the table still separates the published systems.
53 models have been evaluated on ProgramBench. The benchmark falls in the Coding category. We keep external benchmark mirrors separate from the weighted global scoring system, so these results remain source-specific evidence. ProgramBench is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.
About ProgramBench
Year
2026
Tasks
Program reconstruction tasks
Format
Accuracy score
Difficulty
Cleanroom software engineering
BenchLM mirrors the public Vals AI ProgramBench leaderboard as display-only external evidence. The captured snapshot preserves overall scores, task-level scores where Vals publishes them, uncertainty, latency, and cost-per-test metadata. It is excluded from BenchLM weighted rankings.
Freshness and provenance
Version
ProgramBench 2026
Refresh cadence
Quarterly
Staleness state
Current
Question availability
Public benchmark set
BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.
Questions
What does ProgramBench measure?
Can language models rebuild programs from scratch?
Which model leads the published ProgramBench snapshot?
Claude Opus 5.5 currently leads the published ProgramBench snapshot with 18.50% vals programbench mirror score. BenchLM shows this benchmark for display only and does not use it in overall rankings.
How many models are evaluated on ProgramBench?
The September 27, 2026 snapshot contains 53 AI models.
Know when it’s worth switching models
The model to choose, the cheaper alternative, and the release we would wait on.
Read a sample issueJoin 2,000+ readers.
One email each week. Unsubscribe anytime.