A video understanding benchmark that allows subtitle access when answering multimodal questions about videos.
As of March 2026, Gemini 3 Pro leads the Video-MME (with subtitle) leaderboard with 88.4% , followed by Qwen3.6 Plus (87.8%) and Qwen3.5 397B (87.5%).
Gemini 3 Pro
Qwen3.6 Plus
Alibaba
Qwen3.5 397B
Alibaba
According to BenchLM.ai, Gemini 3 Pro leads the Video-MME (with subtitle) benchmark with a score of 88.4%, followed by Qwen3.6 Plus (87.8%) and Qwen3.5 397B (87.5%). The top models are clustered within 0.9 points, suggesting this benchmark is nearing saturation for frontier models.
6 models have been evaluated on Video-MME (with subtitle). The benchmark falls in the Multimodal & Grounded category. This category carries a 12% weight in BenchLM.ai's overall scoring system. Video-MME (with subtitle) is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.
Year
2026
Tasks
Video understanding
Format
Video QA with subtitle context
Difficulty
Multimodal video reasoning
The subtitle-enabled Video-MME setting measures how well a model combines video perception with textual cues from subtitles rather than relying on frames alone.
Qwen3.6 launch benchmarksVersion
Video-MME (with subtitle) 2026
Refresh cadence
Quarterly
Staleness state
Current
Question availability
Public benchmark set
BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.
A video understanding benchmark that allows subtitle access when answering multimodal questions about videos.
Gemini 3 Pro by Google currently leads with a score of 88.4% on Video-MME (with subtitle).
6 AI models have been evaluated on Video-MME (with subtitle) on BenchLM.
Get notified when new models drop, benchmark scores change, or the leaderboard shifts. One email per week.
Free. No spam. Unsubscribe anytime. We only store derived location metadata for consent routing.