Skip to main content
BenchLM

Artificial Analysis ITBench-AA (AA ITBench)

We show this table for reference; we do not rank on it.

Data verified 34 confirmed releases in the last 30 daysFollow model changes

An independently evaluated IT-operations benchmark from Artificial Analysis.

Benchmark score on AA ITBench — September 27, 2026

We compile the AA ITBench rows from secondary reports. GPT-5.6 Sol leads the table at 56.2%, followed by GPT-5.6 Terra (51.0%) and Kimi K3 (47.7%). We do not use these results to rank models overall.

1Proprietary

GPT-5.6 Sol

OpenAI

56.2%
Overall 78.49Context 1.05M
2Proprietary

GPT-5.6 Terra

OpenAI

51.0%
Overall 72.58Context 1.05M
3Proprietary

Kimi K3

Moonshot AI

47.7%
Overall 71.87Context 1.05M

8 modelsAgenticCurrentDisplay onlyUpdated September 27, 2026

Benchmark score table (8 models)

Score
1
GPT-5.6 SolOpenAI · Closed
56.2%
2
GPT-5.6 TerraOpenAI · Closed
51.0%
3
Kimi K3Moonshot AI · Closed
47.7%
4
Claude Opus 4.7 (Adaptive)Anthropic · Closed
46.7%
5
GPT-5.5OpenAI · Closed
45.8%
6
GLM-5.2Z.AI · Open weight
42.7%
7
Qwen3.7 MaxAlibaba · Closed
42.5%
8
GPT-5.6 LunaOpenAI · Closed
40.3%

Among the reported AA ITBench rows, GPT-5.6 Sol is first at 56.2%. The third row is 8.5 points behind. The broader top-10 range is 15.9 points, so the table still separates the published systems.

8 models have been evaluated on AA ITBench. The benchmark falls in the Agentic category. AA ITBench is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.

About AA ITBench

Year

2026

Tasks

IT incident-response tasks

Format

Task success rate

Difficulty

Enterprise IT operations

Stored as a display-only agentic row.

Artificial Analysis ITBench-AA Benchmark Leaderboard

Freshness and provenance

Version

AA ITBench 2026

Refresh cadence

Quarterly

Staleness state

Current

Question availability

Public benchmark set

CurrentDisplay only

BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.

Questions

What does AA ITBench measure?

An independently evaluated IT-operations benchmark from Artificial Analysis.

Which model scores highest on AA ITBench?

GPT-5.6 Sol by OpenAI currently leads with a score of 56.2% on AA ITBench.

How many models are evaluated on AA ITBench?

8 AI models have been evaluated on AA ITBench on BenchLM.

Compare top models on AA ITBench

GPT-5.6 Sol vs GPT-5.6 TerraGPT-5.6 Terra vs Kimi K3Kimi K3 vs Claude Opus 4.7 (Adaptive)Claude Opus 4.7 (Adaptive) vs GPT-5.5
Last updated: September 27, 2026 · BenchLM version AA ITBench 2026

Know when it’s worth switching models

The model to choose, the cheaper alternative, and the release we would wait on.

Read a sample issue

Join 2,000+ readers.

One email each week. Unsubscribe anytime.