Video-MME with subtitle (Video-MME (with subtitle))
We show this table for reference; we do not rank on it.
A video understanding benchmark that allows subtitle access when answering multimodal questions about videos.
Benchmark score on Video-MME (with subtitle) — September 27, 2026
We compile the Video-MME (with subtitle) rows from provider self-reports. Qwen3.8 Max leads the table at 90.4%, followed by Qwen3.7 Plus (88.0%) and Qwen3.6-27B (87.7%). We do not use these results to rank models overall.
Qwen3.8 Max
Alibaba
Qwen3.7 Plus
Alibaba
Qwen3.6-27B
Alibaba
6 modelsMultimodal & GroundedCurrentDisplay onlyUpdated September 27, 2026
Benchmark score table (6 models)
ScoreAmong the reported Video-MME (with subtitle) rows, Qwen3.8 Max is first at 90.4%. The third row is 2.7 points behind. The broader top-10 range is 5.0 points, so many of the published results sit in a relatively narrow band.
6 models have been evaluated on Video-MME (with subtitle). The benchmark falls in the Multimodal & Grounded category. Video-MME (with subtitle) is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.
About Video-MME (with subtitle)
Year
2026
Tasks
Video understanding
Format
Video QA with subtitle context
Difficulty
Multimodal video reasoning
The subtitle-enabled Video-MME setting measures how well a model combines video perception with textual cues from subtitles rather than relying on frames alone.
Freshness and provenance
Version
Video-MME (with subtitle) 2026
Refresh cadence
Quarterly
Staleness state
Current
Question availability
Public benchmark set
BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.
Questions
What does Video-MME (with subtitle) measure?
A video understanding benchmark that allows subtitle access when answering multimodal questions about videos.
Which model scores highest on Video-MME (with subtitle)?
Qwen3.8 Max by Alibaba currently leads with a score of 90.4% on Video-MME (with subtitle).
How many models are evaluated on Video-MME (with subtitle)?
6 AI models have been evaluated on Video-MME (with subtitle) on BenchLM.
Compare top models on Video-MME (with subtitle)
Know when it’s worth switching models
The model to choose, the cheaper alternative, and the release we would wait on.
Read a sample issueJoin 2,000+ readers.
One email each week. Unsubscribe anytime.