Benchmark profile
AutomationBench
An agent benchmark for completing automation workflows in reproducible task environments.
Data verifiedBenchmark score on AutomationBench — July 29, 2026
BenchLM mirrors the published score view for AutomationBench. Kimi K3 leads the public snapshot at 30.8% , followed by Claude Opus 5 (26.0%). BenchLM does not use these results to rank models overall.
Kimi K3
Moonshot AI
kimi-3
Claude Opus 5
Anthropic
claude-opus-5
Benchmark score table (2 models)
ScoreAbout AutomationBench
Year
2026
Tasks
600 public automation tasks
Format
Agent task-completion score
Difficulty
Long-horizon automation
Moonshot evaluates the 600-task public subset while following the official GitHub setup. BenchLM stores this provider-run result separately from Artificial Analysis AutomationBench-AA.
BenchLM freshness & provenance
Version
AutomationBench 2026
Refresh cadence
Quarterly
Staleness state
Current
Question availability
Public benchmark set
BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.
FAQ
What does AutomationBench measure?
An agent benchmark for completing automation workflows in reproducible task environments.
Which model scores highest on AutomationBench?
Kimi K3 by Moonshot AI currently leads with a score of 30.8% on AutomationBench.
How many models are evaluated on AutomationBench?
2 AI models have been evaluated on AutomationBench on BenchLM.
Compare Top Models on AutomationBench
Know when it’s worth switching models
The model to choose, the cheaper alternative, and the release we would wait on.
Read a sample issueJoin 2,000+ readers.
One email each week. Unsubscribe anytime.