A stricter Video-MME setting that removes subtitle help and tests video understanding from visual and audio context alone.
BenchLM mirrors the published score view for Video-MME (w/o subtitle). Qwen3.6-35B-A3B leads the public snapshot at 82.5%. BenchLM does not use these results to rank models overall.
Year
2026
Tasks
Video understanding
Format
Video QA without subtitle context
Difficulty
Multimodal video reasoning
This row isolates raw video understanding by removing subtitle cues. It is a better proxy for whether a model can parse action, scene changes, and temporal context from the media itself.
Version
Video-MME (w/o subtitle) 2026
Refresh cadence
Quarterly
Staleness state
Current
Question availability
Public benchmark set
BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.
A stricter Video-MME setting that removes subtitle help and tests video understanding from visual and audio context alone.
Qwen3.6-35B-A3B by Alibaba currently leads with a score of 82.5% on Video-MME (w/o subtitle).
1 AI models have been evaluated on Video-MME (w/o subtitle) on BenchLM.
For engineers, researchers, and the plain curious — a weekly brief on new models, ranking shifts, and pricing changes.
Free. No spam. Unsubscribe anytime.