Vals ProgramBench (ProgramBench)
Can language models rebuild programs from scratch?
Data verifiedHow BenchLM shows Vals ProgramBench mirror
BenchLM mirrors the public Vals AI Vals ProgramBench mirror leaderboard captured from https://www.vals.ai/benchmarks/programbench and updated by Vals on July 8, 2026. The snapshot preserves overall scores, uncertainty, latency, cost-per-test metadata, and task-level scores where Vals publishes them.
Vals ProgramBench mirror is display only on BenchLM. Vals proprietary or Vals-hosted aggregate views are useful context, but BenchLM does not use them as weighted ranking inputs or as a replacement for benchmark-native source records.
Vals ProgramBench mirror score on ProgramBench — July 8, 2026
BenchLM mirrors the published vals programbench mirror score view for ProgramBench. Claude Fable 5 leads the public snapshot at 2.00% , followed by GPT-5.6 Sol (1.50%) and Claude Opus 4.8 (1.00%). BenchLM does not use these results to rank models overall.
Claude Fable 5
Anthropic
anthropic/claude-fable-5
GPT-5.6 Sol
OpenAI
openai/gpt-5.6-sol
Claude Opus 4.8
Anthropic
anthropic/claude-opus-4-8
The published ProgramBench snapshot is tightly clustered at the top: Claude Fable 5 sits at 2.00%, while the third row is only 1.00 points behind. The broader top-10 spread is 2.00 points, so many of the published scores sit in a relatively narrow band.
27 models have been evaluated on ProgramBench. The benchmark falls in the External benchmark mirrors category. BenchLM tracks this category separately from its weighted global scoring system, so these results are best compared on the dedicated Korean benchmark views. ProgramBench is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.
About ProgramBench
Year
2026
Tasks
Program reconstruction tasks
Format
Accuracy score
Difficulty
Cleanroom software engineering
BenchLM mirrors the public Vals AI ProgramBench leaderboard as display-only external evidence. The captured snapshot preserves overall scores, task-level scores where Vals publishes them, uncertainty, latency, and cost-per-test metadata. It is excluded from BenchLM weighted rankings.
BenchLM freshness & provenance
Version
ProgramBench 2026
Refresh cadence
Quarterly
Staleness state
Current
Question availability
Public benchmark set
BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.
Vals ProgramBench mirror score table (27 models)
FAQ
What does ProgramBench measure?
Can language models rebuild programs from scratch?
Which model leads the published ProgramBench snapshot?
Claude Fable 5 currently leads the published ProgramBench snapshot with 2.00% vals programbench mirror score. BenchLM shows this benchmark for display only and does not use it in overall rankings.
How many models are evaluated on ProgramBench?
27 AI models are included in BenchLM's mirrored ProgramBench snapshot, based on the public leaderboard captured on July 8, 2026.
The AI models change fast. We track them for you.
For engineers, researchers, and the plain curious — a weekly brief on new models, ranking shifts, and pricing changes.
Free. No spam. Unsubscribe anytime.