A mobile GUI agent benchmark for completing Android app workflows and on-device tasks.
BenchLM mirrors the published score view for AndroidWorld. Qwen3.6-27B leads the public snapshot at 70.3%. BenchLM does not use these results to rank models overall.
Year
2026
Tasks
Android app workflows
Format
Interactive mobile-agent evaluation
Difficulty
Complex mobile task completion
BenchLM tracks AndroidWorld as a display-only benchmark reference when providers publish exact values alongside broader GUI-agent summaries.
Version
AndroidWorld 2026
Refresh cadence
Quarterly
Staleness state
Current
Question availability
Public benchmark set
BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.
A mobile GUI agent benchmark for completing Android app workflows and on-device tasks.
Qwen3.6-27B by Alibaba currently leads with a score of 70.3% on AndroidWorld.
1 AI models have been evaluated on AndroidWorld on BenchLM.
For engineers, researchers, and the plain curious — a weekly brief on new models, ranking shifts, and pricing changes.
Free. No spam. Unsubscribe anytime.