# Agents' Last Exam v1.1, CLI subset (Agents' Last Exam (CLI))

> The command-line subset of Agents' Last Exam v1.1: 86 of the release's 122 agent tasks.

Canonical page: https://benchlm.ai/benchmarks/agentslastexamcli

- Category: [Agentic](/agentic)
- Last updated: October 29, 2026

## About Agents' Last Exam (CLI)

- Year: 2026
- Tasks: 86 CLI agent tasks
- Format: Provider-reported task score
- Difficulty: Advanced agentic work
- Paper: [Kimi K3.1 Pro Tech Blog: Advancing Open Intelligence](https://www.kimi.ai/blog/kimi-k3-1-pro)

Moonshot reports the CLI subset beside the full set and assigns zero to runs that bypass a task's stated requirements, such as retrieving answers online instead of doing the required analysis. BenchLM stores the subset on its own key.

Agents' Last Exam (CLI) is currently displayed on BenchLM for reference, but it is excluded from the weighted scoring formula.

## Leaderboard (1 models)

| Rank | Model | Creator | Score |
|------|-------|---------|-------|
| 1 | [Kimi K3.1 Pro](/models/kimi-3-1-pro) | Moonshot AI | 44.2% |

## FAQ

### What does Agents' Last Exam (CLI) measure?

The command-line subset of Agents' Last Exam v1.1: 86 of the release's 122 agent tasks.

### Which model scores highest on Agents' Last Exam (CLI)?

Kimi K3.1 Pro by Moonshot AI currently leads with a score of 44.2% on Agents' Last Exam (CLI).

### How many models are evaluated on Agents' Last Exam (CLI)?

1 AI models have published results on Agents' Last Exam (CLI) in the BenchLM catalog.

### Does Agents' Last Exam (CLI) affect BenchLM's overall score?

Not directly. Agents' Last Exam (CLI) is still displayed on BenchLM for reference, but it is excluded from the weighted scoring formula.