A video understanding benchmark that allows subtitle access when answering multimodal questions about videos.
BenchLM mirrors the published score view for Video-MME (with subtitle). Qwen3.6-27B leads the public snapshot at 87.7% , followed by MiMo-V2.5 (87.7%) and Qwen3.6-35B-A3B (86.6%). BenchLM does not use these results to rank models overall.
Qwen3.6-27B
Alibaba
MiMo-V2.5
Xiaomi
Qwen3.6-35B-A3B
Alibaba
The published Video-MME (with subtitle) snapshot is tightly clustered at the top: Qwen3.6-27B sits at 87.7%, while the third row is only 1.1 points behind. The broader top-10 spread is 1.1 points, so many of the published scores sit in a relatively narrow band.
3 models have been evaluated on Video-MME (with subtitle). The benchmark falls in the Multimodal & Grounded category. This category carries a 12% weight in BenchLM.ai's overall scoring system. Video-MME (with subtitle) is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.
Year
2026
Tasks
Video understanding
Format
Video QA with subtitle context
Difficulty
Multimodal video reasoning
The subtitle-enabled Video-MME setting measures how well a model combines video perception with textual cues from subtitles rather than relying on frames alone.
Version
Video-MME (with subtitle) 2026
Refresh cadence
Quarterly
Staleness state
Current
Question availability
Public benchmark set
BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.
A video understanding benchmark that allows subtitle access when answering multimodal questions about videos.
Qwen3.6-27B by Alibaba currently leads with a score of 87.7% on Video-MME (with subtitle).
3 AI models have been evaluated on Video-MME (with subtitle) on BenchLM.
For engineers, researchers, and the plain curious — a weekly brief on new models, ranking shifts, and pricing changes.
Free. No spam. Unsubscribe anytime.