Artificial Analysis AutomationBench (AA AutomationBench)

Name: Artificial Analysis AutomationBench
Creator: BenchLM

An independently evaluated automation benchmark from Artificial Analysis.

Data verified July 9, 2026

Benchmark score on AA AutomationBench — July 9, 2026

BenchLM mirrors the published score view for AA AutomationBench. Grok 4.5 leads the public snapshot at 51.4% , followed by Claude Opus 4.8 (48.5%) and Gemini 3.5 Flash (42.6%). BenchLM does not use these results to rank models overall.

1Closed

Grok 4.5

xAI

grok-4-5

51.4%

Overall —Context 500K

2Closed

Claude Opus 4.8

Anthropic

claude-opus-4-8

48.5%

Overall 85Context 1M

3Closed

Gemini 3.5 Flash

Google

gemini-3-5-flash

42.6%

Overall 80Context 1M

11 modelsAgenticCurrentDisplay onlyUpdated July 9, 2026

The published AA AutomationBench snapshot is tightly clustered at the top: Grok 4.5 sits at 51.4%, while the third row is only 8.8 points behind. The broader top-10 spread is 31.0 points, so the benchmark still separates strong models even when the leaders cluster.

11 models have been evaluated on AA AutomationBench. The benchmark falls in the Agentic category. This category carries a 22% weight in BenchLM.ai's overall scoring system. AA AutomationBench is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.

About AA AutomationBench

Year

2026

Tasks

Business-process automation tasks

Format

Task success rate

Difficulty

Agentic automation

Stored as a display-only agentic row.

Artificial Analysis AutomationBench Benchmark Leaderboard

BenchLM freshness & provenance

Version

AA AutomationBench 2026

Refresh cadence

Quarterly

Staleness state

Current

Question availability

Public benchmark set

CurrentDisplay only

BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.