# OpenHarmony Bench v1.0 (OpenHarmony Bench)

> An app-level coding benchmark that asks DevEco Code configurations to implement observable behavior in buildable OpenHarmony ArkTS applications.

Canonical page: https://benchlm.ai/benchmarks/openharmonybench

- Category: [Coding](/coding)
- Last updated: October 17, 2026

## About OpenHarmony Bench

- Year: 2026
- Tasks: 153 app-development and bug-fix tasks
- Format: Task completion through DevEco Code
- Difficulty: End-to-end OpenHarmony application development
- Paper: [OpenHarmony Bench: Evaluating LLMs and Coding Agents on OpenHarmony App Development](https://arxiv.org/abs/2608.16022)

The v1.0 snapshot contains 153 top-level tasks and 242 executable feature checks across 42 repositories. Each leaderboard row averages three full-suite DevEco Code runs. We store Task Completion as display-only model-plus-agent evidence; build rates, duration, token use, and run ranges remain in the source snapshot.

OpenHarmony Bench is currently displayed on BenchLM for reference, but it is excluded from the weighted scoring formula.

## Leaderboard (13 models)

| Rank | Model | Creator | Score |
|------|-------|---------|-------|
| 1 | [Qwen3.8 Max](/models/qwen3-8-max) | Alibaba | 60.8% |
| 2 | [GLM-5.3](/models/glm-5-3) | Z.AI | 60.8% |
| 3 | [DeepSeek V4.1 Flash 1017](/models/deepseek-v4-1-flash) | DeepSeek | 60.3% |
| 4 | [DeepSeek V4 Pro 0813](/models/deepseek-v4-pro-0813) | DeepSeek | 59.0% |
| 5 | [GLM-5.2](/models/glm-5-2) | Z.AI | 58.4% |
| 6 | [Kimi K3](/models/kimi-k3) | Moonshot AI | 57.3% |
| 7 | [GLM-5.3-Flash](/models/glm-5-3-flash) | Z.AI | 57.3% |
| 8 | [Qwen3.8 Max Preview](/models/qwen3-8-max-preview) | Alibaba | 56.0% |
| 9 | [DeepSeek V4 Flash 0731](/models/deepseek-v4-flash-0731) | DeepSeek | 53.8% |
| 10 | [Qwen3.7 Max](/models/qwen3-7-max) | Alibaba | 53.4% |
| 11 | [GLM-5.1](/models/glm-5-1) | Z.AI | 52.3% |
| 12 | [Kimi K2.7 Code](/models/kimi-k2-7-code) | Moonshot AI | 52.1% |
| 13 | [MiniMax M3](/models/minimax-m3) | MiniMax | 48.4% |

## FAQ

### What does OpenHarmony Bench measure?

An app-level coding benchmark that asks DevEco Code configurations to implement observable behavior in buildable OpenHarmony ArkTS applications.

### Which model scores highest on OpenHarmony Bench?

Qwen3.8 Max by Alibaba currently leads with a score of 60.8% on OpenHarmony Bench.

### How many models are evaluated on OpenHarmony Bench?

13 AI models have published results on OpenHarmony Bench in the BenchLM catalog.

### Does OpenHarmony Bench affect BenchLM's overall score?

Not directly. OpenHarmony Bench is still displayed on BenchLM for reference, but it is excluded from the weighted scoring formula.

## Compare Top Models on OpenHarmony Bench

- [Qwen3.8 Max vs GLM-5.3](/compare/glm-5-3-vs-qwen3-8-max)
- [GLM-5.3 vs DeepSeek V4.1 Flash 1017](/compare/deepseek-v4-1-flash-vs-glm-5-3)
- [DeepSeek V4.1 Flash 1017 vs DeepSeek V4 Pro 0813](/compare/deepseek-v4-1-flash-vs-deepseek-v4-pro-0813)
- [DeepSeek V4 Pro 0813 vs GLM-5.2](/compare/deepseek-v4-pro-0813-vs-glm-5-2)