Benchmark profile
Artificial Analysis Coding Agent Index (AA Coding Agents)
A display-only Artificial Analysis leaderboard for coding-agent systems, combining agent harnesses, host models, and execution settings across software-engineering benchmarks.
How BenchLM shows AA Coding Agents
BenchLM mirrors the Artificial Analysis Coding Agent Index v1.1 page as a display-only agent leaderboard. The source compares coding-agent variants across DeepSWE, Terminal-Bench v2, SWE-Atlas-QnA and reports the average pass@1 index alongside cost, token, and execution-time metadata.
AA Coding Agents is separate from BenchLM model-only rankings. Its rows combine an agent harness, a host model, execution settings, and provider routing, so BenchLM treats the index as external system evidence rather than a weighted base-model benchmark. Component benchmark availability can vary by row in the source payload.
Index score on AA Coding Agents — June 2026 page snapshot
BenchLM mirrors the published index score view for AA Coding Agents. Codex - GPT-5.6 Sol (xhigh) leads the public snapshot at 78.7% , followed by Codex - GPT-5.6 Terra (max) (77.4%) and Codex - GPT-5.6 Sol (high) (77.1%). BenchLM does not use these results to rank models overall.
Codex - GPT-5.6 Sol (xhigh)
OpenAI
23131223cbd1673ff63406697313e5e9
Codex - GPT-5.6 Terra (max)
OpenAI
31952ee91dced2ebc94053b6853ce465
Codex - GPT-5.6 Sol (high)
OpenAI
e4e91fc59821e5edba191d0d0f5aa796
Index score table (34 models)
ScoreThe published AA Coding Agents snapshot is tightly clustered at the top: Codex - GPT-5.6 Sol (xhigh) sits at 78.7%, while the third row is only 1.6 points behind. The broader top-10 spread is 7.6 points, so many of the published scores sit in a relatively narrow band.
34 models have been evaluated on AA Coding Agents. The benchmark falls in the Coding category. This category carries a 20% weight in BenchLM.ai's overall scoring system. AA Coding Agents is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.
About AA Coding Agents
Year
2026
Tasks
Composite over DeepSWE, Terminal-Bench v2, and SWE-Atlas-QnA
Format
Average pass@1 index
Difficulty
Real-world coding-agent workflows
BenchLM mirrors the Artificial Analysis Coding Agent Index v1.1 page as a display-only external leaderboard. The source combines DeepSWE, Terminal-Bench v2, and SWE-Atlas-QnA component scores and publishes cost, token, and execution-time metadata. Rows are coding-agent systems rather than pure base-model results.
BenchLM freshness & provenance
Version
AA Coding Agents 2026
Refresh cadence
Quarterly
Staleness state
Current
Question availability
Public benchmark set
BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.
FAQ
What does AA Coding Agents measure?
A display-only Artificial Analysis leaderboard for coding-agent systems, combining agent harnesses, host models, and execution settings across software-engineering benchmarks.
Which model leads the published AA Coding Agents snapshot?
Codex - GPT-5.6 Sol (xhigh) currently leads the published AA Coding Agents snapshot with 78.7% index score. BenchLM shows this benchmark for display only and does not use it in overall rankings.
How many models are evaluated on AA Coding Agents?
34 AI models are included in BenchLM's mirrored AA Coding Agents snapshot, based on the public leaderboard captured on June 2026 page snapshot.
The AI models change fast. We track them for you.
A weekly brief for engineers and researchers covering new models, ranking shifts, and pricing changes.
Free. No spam. Unsubscribe anytime.