Terminal-Bench 2.1, Vals AI run (Terminal-Bench 2.1 (Vals))
Vals AI’s independent run of the Terminal-Bench 2.1 terminal-task suite with published easy, medium, and hard splits.
Current release
Terminal-Bench 4.0 is the current release. It changes task resources and the task set, so its freshly run scores are not directly comparable with this Terminal-Bench 2.x table.
View Terminal-Bench 4.0How BenchLM shows Vals Terminal-Bench 2.1 mirror
BenchLM mirrors the public Vals AI Vals Terminal-Bench 2.1 mirror leaderboard captured from https://www.vals.ai/benchmarks/terminal-bench-2-1 and updated by Vals on September 10, 2026. The snapshot preserves overall scores, uncertainty, latency, cost-per-test metadata, and task-level scores where Vals publishes them.
Vals Terminal-Bench 2.1 mirror is display only on BenchLM. Vals proprietary or Vals-hosted aggregate views are useful context, but BenchLM does not use them as weighted ranking inputs or as a replacement for benchmark-native source records.
Snapshot
Vals Terminal-Bench 2.1 mirror score on Terminal-Bench 2.1 (Vals) — September 10, 2026
We mirror the published vals terminal-bench 2.1 mirror score view for Terminal-Bench 2.1 (Vals). GPT-6 Astra leads the public snapshot at 87.3%, followed by GPT-5.6 Sol (85.8%) and Claude Fable 5.1 (85.0%). We do not use these results to rank models overall.
GPT-6 Astra
OpenAI
max reasoning
GPT-5.6 Sol
OpenAI
max reasoning
Claude Fable 5.1
Anthropic
64 modelsAgenticCurrentDisplay onlyUpdated September 10, 2026
Vals Terminal-Bench 2.1 mirror score table (64 models)
ScoreThe published Terminal-Bench 2.1 (Vals) snapshot places GPT-6 Astra first at 87.3%. The third row is 2.2 points behind. The broader top-10 range is 9.0 points, so many of the published results sit in a relatively narrow band.
64 models have been evaluated on Terminal-Bench 2.1 (Vals). The benchmark falls in the Agentic category. This category carries a 22% weight in BenchLM.ai's overall scoring system. Terminal-Bench 2.1 (Vals) is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.
About Terminal-Bench 2.1 (Vals)
Year
2026
Tasks
Difficult terminal tasks
Format
Task success rate
Difficulty
Frontier agentic
BenchLM mirrors the Vals AI board on a dedicated key so a provider-run row on the canonical key is never overwritten. Vals publishes per-task accuracy with standard error, latency, and cost for every model it runs. Admitted as independent third-party evidence in methodology v5.5 (2026-09-04).
BenchLM freshness & provenance
Version
Terminal-Bench 2.1 (Vals) 2026
Refresh cadence
Quarterly
Staleness state
Current
Question availability
Public benchmark set
BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.
FAQ
What does Terminal-Bench 2.1 (Vals) measure?
Vals AI’s independent run of the Terminal-Bench 2.1 terminal-task suite with published easy, medium, and hard splits.
Which model leads the published Terminal-Bench 2.1 (Vals) snapshot?
GPT-6 Astra currently leads the published Terminal-Bench 2.1 (Vals) snapshot with 87.3% vals terminal-bench 2.1 mirror score. BenchLM shows this benchmark for display only and does not use it in overall rankings.
How many models are evaluated on Terminal-Bench 2.1 (Vals)?
The September 10, 2026 snapshot contains 64 AI models.
Know when it’s worth switching models
The model to choose, the cheaper alternative, and the release we would wait on.
Read a sample issueJoin 2,000+ readers.
One email each week. Unsubscribe anytime.