Skip to main content
BenchLM

AndroidWorld

We show this table for reference; we do not rank on it.

Data verified 40 confirmed releases in the last 30 daysFollow model changes

A mobile GUI agent benchmark for completing Android app workflows and on-device tasks.

Benchmark score on AndroidWorld — September 22, 2026

We compile the AndroidWorld rows from provider self-reports. Qwen3.8-Omni-Flash leads the table at 87.1%, followed by Qwen3.8 Max (85.3%) and Qwen3.8-Flash-Next (84.5%). We do not use these results to rank models overall.

1Proprietary

Qwen3.8-Omni-Flash

Alibaba

87.1%
Context 1M
2Open weights

Qwen3.8 Max

Alibaba

85.3%
Overall 72.02Context 1M
3Open weights

Qwen3.8-Flash-Next

Alibaba

84.5%
Overall 60.67Context 262K

9 modelsAgenticCurrentDisplay onlyUpdated September 22, 2026

Benchmark score table (9 models)

Score
1
Qwen3.8-Omni-FlashAlibaba · Closed
87.1%
2
Qwen3.8 MaxAlibaba · Open weight
85.3%
3
Qwen3.8-Flash-NextAlibaba · Open weight
84.5%
4
Qwen3.8-27BAlibaba · Open weight
81.9%
5
Qwen3.7 PlusAlibaba · Closed
81.0%
6
Holo3.1-35B-A3BH Company · Open weight
79.3%
7
Holo3.1-4BH Company · Open weight
71.0%
8
Holo3.1-9BH Company · Open weight
71.0%
9
Qwen3.6-27BAlibaba · Open weight
70.3%

Among the reported AndroidWorld rows, Qwen3.8-Omni-Flash is first at 87.1%. The third row is 2.6 points behind. The broader top-10 range is 16.8 points, so the table still separates the published systems.

9 models have been evaluated on AndroidWorld. The benchmark falls in the Agentic category. AndroidWorld is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.

About AndroidWorld

Year

2026

Tasks

Android app workflows

Format

Interactive mobile-agent evaluation

Difficulty

Complex mobile task completion

BenchLM tracks AndroidWorld as a display-only benchmark reference when providers publish exact values alongside broader GUI-agent summaries.

GLM-5V-Turbo

Freshness and provenance

Version

AndroidWorld 2026

Refresh cadence

Quarterly

Staleness state

Current

Question availability

Public benchmark set

CurrentDisplay only

BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.

Questions

What does AndroidWorld measure?

A mobile GUI agent benchmark for completing Android app workflows and on-device tasks.

Which model scores highest on AndroidWorld?

Qwen3.8-Omni-Flash by Alibaba currently leads with a score of 87.1% on AndroidWorld.

How many models are evaluated on AndroidWorld?

9 AI models have been evaluated on AndroidWorld on BenchLM.

Compare top models on AndroidWorld

Qwen3.8-Omni-Flash vs Qwen3.8 MaxQwen3.8 Max vs Qwen3.8-Flash-NextQwen3.8-Flash-Next vs Qwen3.8-27BQwen3.8-27B vs Qwen3.7 Plus
Last updated: September 22, 2026 · BenchLM version AndroidWorld 2026

Know when it’s worth switching models

The model to choose, the cheaper alternative, and the release we would wait on.

Read a sample issue

Join 2,000+ readers.

One email each week. Unsubscribe anytime.