Artificial Analysis AutomationBench (AA AutomationBench)
An independently evaluated automation benchmark from Artificial Analysis.
Top models on AA AutomationBench — October 29, 2026
As of October 29, 2026, Gemini 4 Carbon leads the AA AutomationBench leaderboard with 77.8% , followed by Gemini 4 Argon (77.5%) and Kimi K3.1 Pro (73.3%).
Gemini 4 Carbon
Gemini 4 Argon
Kimi K3.1 Pro
Moonshot AI
24 modelsAgentic2% of Agentic reference weightCurrentUpdated October 29, 2026
Leaderboard (24 models)
| Rank | Model / configuration | Score | Parameters (B) | Open / closed |
|---|---|---|---|---|
| 1 | Gemini 4 CarbonGoogle | 77.8% | Not reported | Closed |
| 2 | Gemini 4 ArgonGoogle | 77.5% | Not reported | Closed |
| 3 | Kimi K3.1 ProMoonshot AI | 73.3% | Not reported | Pending |
| 4 | MiniMax M3.1 FlashMiniMax | 72.5% | Not reported | Closed |
| 5 | Claude Sonnet 5.5Anthropic | 71.8% | Not reported | Closed |
| 6 | Claude Opus 5.5Anthropic | 69.5% | Not reported | Closed |
| 7 | GPT-6 AstraOpenAI | 68.5% | Not reported | Closed |
| 8 | Grok 4.7xAI | 65.6% | Not reported | Closed |
| 9 | GPT-6.1 SolOpenAI | 64.9% | Not reported | Closed |
| 10 | GLM-5.3Z.AI | 62.2% | Not reported | Open |
| 11 | GPT-6.1 TerraOpenAI | 60.2% | Not reported | Closed |
| 12 | Gemini 3.8 FlashGoogle | 59.9% | Not reported | Closed |
| 13 | Mistral Large 4Mistral | 59.9% | Not reported | Open |
| 14 | Claude Fable 5.1Anthropic | 59.4% | Not reported | Closed |
| 15 | MiMo-V2.6-ProXiaomi | 58.6% | Not reported | Open |
| 16 | GPT-6 LunaOpenAI | 53.2% | Not reported | Closed |
| 17 | Step 5 PreviewStepFun | 51.0% | Not reported | Open |
| 18 | Muse Spark OpenMeta | 49.7% | Not reported | Open |
| 19 | Beam 1.0 501B-A23BReflection AI | 48.5% | Not reported | Open |
| 20 | Qwen3.8-27BAlibaba | 48.2% | Not reported | Open |
| 21 | Muse Wonder FullMeta | 45.4% | Not reported | Closed |
| 22 | Muse WonderMeta | 39.1% | Not reported | Closed |
| 23 | Claude Haiku 5.5Anthropic | 35.4% | Not reported | Closed |
| 24 | InklingThinking Machines Lab | 5.0% | Not reported | Open |
According to BenchLM.ai, Gemini 4 Carbon leads the AA AutomationBench benchmark with a score of 77.8%, followed by Gemini 4 Argon (77.5%) and Kimi K3.1 Pro (73.3%). The scores show moderate spread, with meaningful differences between the top tier and mid-tier models.
24 models have been evaluated on AA AutomationBench. The benchmark falls in the Agentic category. BenchAlign v5.8 gives AA AutomationBench 2% of the Agentic reference weight, so it moves the Agentic leaderboard and the overall ranking. Reference weights are relative weights in the calibrated model, not fixed shares of a score.
About AA AutomationBench
Year
2026
Tasks
Business-process automation tasks
Format
Task success rate
Difficulty
Agentic automation
Stored as its own agentic row.
Freshness and provenance
Version
AA AutomationBench 2026
Refresh cadence
Quarterly
Staleness state
Current
Question availability
Public benchmark set
BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.
Questions
What does AA AutomationBench measure?
An independently evaluated automation benchmark from Artificial Analysis.
Which model scores highest on AA AutomationBench?
Gemini 4 Carbon by Google currently leads with a score of 77.8% on AA AutomationBench.
How many models are evaluated on AA AutomationBench?
24 AI models have published results on AA AutomationBench in the BenchLM catalog.
Compare top models on AA AutomationBench
Know when it’s worth switching models
The model to choose, the cheaper alternative, and the release we would wait on.
Read a sample issueJoin 6,100+ subscribers.
One email each week. Unsubscribe anytime.