Skip to main content
Radar

Five or fewer confirmed AI changes, with original sources, on mornings when something changed.A free source-linked morning brief.

Start the free Radar Brief
BenchLM

AndroidWorld

A mobile GUI agent benchmark for completing Android app workflows and on-device tasks.

Data verified 25 confirmed releases in the last 30 daysStart the free Radar Brief

Benchmark score on AndroidWorld — August 29, 2026

We mirror the published score view for AndroidWorld. Qwen3.8 Max leads the public snapshot at 85.3%, followed by Qwen3.8-Flash-Next (84.5%) and Qwen3.8-27B (81.9%). We do not use these results to rank models overall.

1Open

Qwen3.8 Max

Alibaba

85.3%
Overall 79.22Context 1M
2Open

Qwen3.8-Flash-Next

Alibaba

84.5%
Overall 61.32Context 262K
3Open

Qwen3.8-27B

Alibaba

81.9%
Overall 72.51Context 262K
8 modelsAgenticCurrentDisplay onlyUpdated August 29, 2026

Benchmark score table (8 models)

Score
1
Qwen3.8 MaxAlibaba · Open weight
85.3%
2
Qwen3.8-Flash-NextAlibaba · Open weight
84.5%
3
Qwen3.8-27BAlibaba · Open weight
81.9%
4
Qwen3.7 PlusAlibaba · Closed
81.0%
5
Holo3.1-35B-A3BH Company · Open weight
79.3%
6
Holo3.1-4BH Company · Open weight
71.0%
7
Holo3.1-9BH Company · Open weight
71.0%
8
Qwen3.6-27BAlibaba · Open weight
70.3%

The published AndroidWorld snapshot places Qwen3.8 Max first at 85.3%. The third row is 3.4 points behind. The broader top-10 range is 15.0 points, so the table still separates the published systems.

8 models have been evaluated on AndroidWorld. The benchmark falls in the Agentic category. This category carries a 22% weight in BenchLM.ai's overall scoring system. AndroidWorld is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.

About AndroidWorld

Year

2026

Tasks

Android app workflows

Format

Interactive mobile-agent evaluation

Difficulty

Complex mobile task completion

BenchLM tracks AndroidWorld as a display-only benchmark reference when providers publish exact values alongside broader GUI-agent summaries.

GLM-5V-Turbo

BenchLM freshness & provenance

Version

AndroidWorld 2026

Refresh cadence

Quarterly

Staleness state

Current

Question availability

Public benchmark set

CurrentDisplay only

BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.

FAQ

What does AndroidWorld measure?

A mobile GUI agent benchmark for completing Android app workflows and on-device tasks.

Which model scores highest on AndroidWorld?

Qwen3.8 Max by Alibaba currently leads with a score of 85.3% on AndroidWorld.

How many models are evaluated on AndroidWorld?

8 AI models have been evaluated on AndroidWorld on BenchLM.

Compare Top Models on AndroidWorld

Qwen3.8 Max vs Qwen3.8-Flash-NextQwen3.8-Flash-Next vs Qwen3.8-27BQwen3.8-27B vs Qwen3.7 PlusQwen3.7 Plus vs Holo3.1-35B-A3B
Last updated: August 29, 2026 · BenchLM version AndroidWorld 2026

Know when it’s worth switching models

The model to choose, the cheaper alternative, and the release we would wait on.

Read a sample issue

Join 2,000+ readers.

One email each week. Unsubscribe anytime.