MLVU mean average (MLVU (M-Avg))

We show this table for reference; we do not rank on it.

Data verified September 27, 202634 confirmed releases in the last 30 daysFollow model changes

A multi-task video understanding benchmark averaged across MLVU categories.

Benchmark score on MLVU (M-Avg) — September 27, 2026

We compile the MLVU (M-Avg) rows from provider self-reports. Qwen3.8 Max leads the table at 90.8%, followed by Qwen3.7 Plus (87.4%) and Qwen3.6-27B (86.6%). We do not use these results to rank models overall.

1Open weights

Qwen3.8 Max

Alibaba

90.8%

Overall 71.8Context 1M

2Proprietary

Qwen3.7 Plus

Alibaba

87.4%

Overall 55.78Context 1M

3Open weights

Qwen3.6-27B

Alibaba

86.6%

Overall 46.49Context 262K

4 modelsMultimodal & GroundedCurrentDisplay onlyUpdated September 27, 2026

Benchmark score table (4 models)

Score

Qwen3.8 MaxAlibaba · Open weight

90.8%

Qwen3.7 PlusAlibaba · Closed

87.4%

Qwen3.6-27BAlibaba · Open weight

86.6%

Qwen3.6-35B-A3BAlibaba · Open weight

86.2%

Among the reported MLVU (M-Avg) rows, Qwen3.8 Max is first at 90.8%. The third row is 4.2 points behind. The broader top-10 range is 4.6 points, so many of the published results sit in a relatively narrow band.

4 models have been evaluated on MLVU (M-Avg). The benchmark falls in the Multimodal & Grounded category. MLVU (M-Avg) is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.

About MLVU (M-Avg)

Year

2026

Tasks

General video understanding

Format

Video QA and understanding

Difficulty

Broad multimodal video reasoning

MLVU captures general-purpose video understanding rather than a single narrow skill. BenchLM tracks the mean-average summary row so provider comparison tables can be compared directly.

Qwen3.6 launch benchmarks

Freshness and provenance

Version

MLVU (M-Avg) 2026

Refresh cadence

Quarterly

Staleness state

Current

Question availability

Public benchmark set

CurrentDisplay only

BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.

Questions

What does MLVU (M-Avg) measure?

A multi-task video understanding benchmark averaged across MLVU categories.

Which model scores highest on MLVU (M-Avg)?

Qwen3.8 Max by Alibaba currently leads with a score of 90.8% on MLVU (M-Avg).

How many models are evaluated on MLVU (M-Avg)?

4 AI models have been evaluated on MLVU (M-Avg) on BenchLM.

Compare top models on MLVU (M-Avg)

Qwen3.8 Max vs Qwen3.7 Plus Qwen3.7 Plus vs Qwen3.6-27B Qwen3.6-27B vs Qwen3.6-35B-A3B

Last updated: September 27, 2026 · BenchLM version MLVU (M-Avg) 2026

Know when it’s worth switching models

The model to choose, the cheaper alternative, and the release we would wait on.

Read a sample issue

Join 2,000+ readers.

One email each week. Unsubscribe anytime.