Skip to main content
benchlm.ai

Artificial Analysis ITBench-AA (AA ITBench)

An independently evaluated IT-operations benchmark from Artificial Analysis.

Data verified

Benchmark score on AA ITBench — July 9, 2026

BenchLM mirrors the published score view for AA ITBench. GPT-5.6 Sol leads the public snapshot at 56.2% , followed by GPT-5.6 Terra (51.0%) and GPT-5.5 (45.8%). BenchLM does not use these results to rank models overall.

1Closed

GPT-5.6 Sol

OpenAI

gpt-5-6-sol

56.2%
Overall —Context 1M
2Closed

GPT-5.6 Terra

OpenAI

gpt-5-6-terra

51.0%
Overall —Context 1M
3Closed

GPT-5.5

OpenAI

gpt-5-5

45.8%
Overall 78Context 1M
13 modelsAgenticCurrentDisplay onlyUpdated July 9, 2026

The published AA ITBench snapshot is tightly clustered at the top: GPT-5.6 Sol sits at 56.2%, while the third row is only 10.4 points behind. The broader top-10 spread is 23.5 points, so the benchmark still separates strong models even when the leaders cluster.

13 models have been evaluated on AA ITBench. The benchmark falls in the Agentic category. This category carries a 22% weight in BenchLM.ai's overall scoring system. AA ITBench is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.

About AA ITBench

Year

2026

Tasks

IT incident-response tasks

Format

Task success rate

Difficulty

Enterprise IT operations

Stored as a display-only agentic row.

Artificial Analysis ITBench-AA Benchmark Leaderboard

BenchLM freshness & provenance

Version

AA ITBench 2026

Refresh cadence

Quarterly

Staleness state

Current

Question availability

Public benchmark set

CurrentDisplay only

BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.

Benchmark score table (13 models)

1
GPT-5.6 Solgpt-5-6-sol
56.2%
2
GPT-5.6 Terragpt-5-6-terra
51.0%
3
GPT-5.5gpt-5-5
45.8%
4
GLM-5.2glm-5-2
42.7%
5
Qwen3.7 Maxqwen3-7-max
42.5%
6
Gemini 3.5 Flashgemini-3-5-flash
40.3%
7
GPT-5.6 Lunagpt-5-6-luna
40.3%
8
MiMo-V2.5-Promimo-v2-5-pro
38.2%
9
Gemma 4 31Bgemma-4-31b
37.3%
10
Grok 4.3grok-4-3
32.7%
11
Kimi K2.6kimi-2-6
31.2%
12
Gemini 3.1 Progemini-3-1-pro
30.3%
13
GPT-OSS 120Bgpt-oss-120b
5.6%

FAQ

What does AA ITBench measure?

An independently evaluated IT-operations benchmark from Artificial Analysis.

Which model scores highest on AA ITBench?

GPT-5.6 Sol by OpenAI currently leads with a score of 56.2% on AA ITBench.

How many models are evaluated on AA ITBench?

13 AI models have been evaluated on AA ITBench on BenchLM.

Compare Top Models on AA ITBench

GPT-5.6 Sol vs GPT-5.6 TerraGPT-5.6 Terra vs GPT-5.5GPT-5.5 vs GLM-5.2GLM-5.2 vs Qwen3.7 Max
Last updated: July 9, 2026 · BenchLM version AA ITBench 2026

The AI models change fast. We track them for you.

For engineers, researchers, and the plain curious — a weekly brief on new models, ranking shifts, and pricing changes.

Free. No spam. Unsubscribe anytime.