# AndroidWorld

> A mobile GUI agent benchmark for completing Android app workflows and on-device tasks.

Canonical page: https://benchlm.ai/benchmarks/androidworld

- Category: [Agentic](/agentic)
- Last updated: September 22, 2026

## About AndroidWorld

- Year: 2026
- Tasks: Android app workflows
- Format: Interactive mobile-agent evaluation
- Difficulty: Complex mobile task completion
- Paper: [GLM-5V-Turbo](https://docs.z.ai/guides/vlm/glm-5v-turbo)

BenchLM tracks AndroidWorld as a display-only benchmark reference when providers publish exact values alongside broader GUI-agent summaries.

AndroidWorld is currently displayed on BenchLM for reference, but it is excluded from the weighted scoring formula.

## Leaderboard (9 models)

| Rank | Model | Creator | Score |
|------|-------|---------|-------|
| 1 | [Qwen3.8-Omni-Flash](/models/qwen3-8-omni-flash) | Alibaba | 87.1% |
| 2 | [Qwen3.8 Max](/models/qwen3-8-max) | Alibaba | 85.3% |
| 3 | [Qwen3.8-Flash-Next](/models/qwen3-8-flash-next) | Alibaba | 84.5% |
| 4 | [Qwen3.8-27B](/models/qwen3-8-27b) | Alibaba | 81.9% |
| 5 | [Qwen3.7 Plus](/models/qwen3-7-plus) | Alibaba | 81.0% |
| 6 | [Holo3.1-35B-A3B](/models/holo3-1-35b-a3b) | H Company | 79.3% |
| 7 | [Holo3.1-4B](/models/holo3-1-4b) | H Company | 71.0% |
| 8 | [Holo3.1-9B](/models/holo3-1-9b) | H Company | 71.0% |
| 9 | [Qwen3.6-27B](/models/qwen3-6-27b) | Alibaba | 70.3% |

## FAQ

### What does AndroidWorld measure?

A mobile GUI agent benchmark for completing Android app workflows and on-device tasks.

### Which model scores highest on AndroidWorld?

Qwen3.8-Omni-Flash by Alibaba currently leads with a score of 87.1% on AndroidWorld.

### How many models are evaluated on AndroidWorld?

9 AI models have been evaluated on AndroidWorld on BenchLM.

### Does AndroidWorld affect BenchLM's overall score?

Not directly. AndroidWorld is still displayed on BenchLM for reference, but it is excluded from the weighted scoring formula.

## Compare Top Models on AndroidWorld

- [Qwen3.8-Omni-Flash vs Qwen3.8 Max](/compare/qwen3-8-max-vs-qwen3-8-omni-flash)
- [Qwen3.8 Max vs Qwen3.8-Flash-Next](/compare/qwen3-8-flash-next-vs-qwen3-8-max)
- [Qwen3.8-Flash-Next vs Qwen3.8-27B](/compare/qwen3-8-27b-vs-qwen3-8-flash-next)
- [Qwen3.8-27B vs Qwen3.7 Plus](/compare/qwen3-7-plus-vs-qwen3-8-27b)