Vals AI automated theorem-proving benchmark.
BenchLM mirrors the public Vals AI ProofBench leaderboard captured from https://www.vals.ai/benchmarks/proof_bench and updated by Vals on May 16, 2026. The snapshot preserves overall scores, uncertainty, latency, cost-per-test metadata, and task-level scores where Vals publishes them.
ProofBench is display only on BenchLM. Vals proprietary or Vals-hosted aggregate views are useful context, but BenchLM does not use them as weighted ranking inputs or as a replacement for benchmark-native source records.
BenchLM mirrors the published proofbench score view for ProofBench. Aristotle leads the public snapshot at 71.00% , followed by GPT-5.4 (56.00%) and Claude Opus 4.7 (54.00%). BenchLM does not use these results to rank models overall.
Aristotle
Harmonic
aristotle/aristotle
GPT-5.4
OpenAI
openai/gpt-5.4-2026-03-05
Claude Opus 4.7
Anthropic
anthropic/claude-opus-4-7
The published ProofBench snapshot is tightly clustered at the top: Aristotle sits at 71.00%, while the third row is only 17.00 points behind. The broader top-10 spread is 48.78 points, so the benchmark still separates strong models even when the leaders cluster.
32 models have been evaluated on ProofBench. The benchmark falls in the External benchmark mirrors category. BenchLM tracks this category separately from its weighted global scoring system, so these results are best compared on the dedicated Korean benchmark views. ProofBench is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.
Year
2026
Tasks
Automated theorem proving
Format
Accuracy score
Difficulty
Formal proof reasoning
BenchLM mirrors Vals ProofBench as a display-only math and proof benchmark.
Version
ProofBench 2026
Refresh cadence
Quarterly
Staleness state
Current
Question availability
Public benchmark set
BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.
Vals AI automated theorem-proving benchmark.
Aristotle currently leads the published ProofBench snapshot with 71.00% proofbench score. BenchLM shows this benchmark for display only and does not use it in overall rankings.
32 AI models are included in BenchLM's mirrored ProofBench snapshot, based on the public leaderboard captured on May 16, 2026.
For engineers, researchers, and the plain curious — a weekly brief on new models, ranking shifts, and pricing changes.
Free. No spam. Unsubscribe anytime.