A grounded visual reasoning benchmark focused on evidence-based question answering over real images.
As of March 2026, Gemini 3 Pro leads the ERQA leaderboard with 70.5% , followed by Qwen3.5 397B (67.5%) and Qwen3.6 Plus (65.7%).
Gemini 3 Pro
Qwen3.5 397B
Alibaba
Qwen3.6 Plus
Alibaba
According to BenchLM.ai, Gemini 3 Pro leads the ERQA benchmark with a score of 70.5%, followed by Qwen3.5 397B (67.5%) and Qwen3.6 Plus (65.7%). There is significant spread across the leaderboard, making this benchmark effective at differentiating model capabilities.
5 models have been evaluated on ERQA. The benchmark falls in the Multimodal & Grounded category. This category carries a 12% weight in BenchLM.ai's overall scoring system. ERQA is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.
Year
2026
Tasks
Evidence-based visual QA
Format
Grounded image reasoning
Difficulty
Grounded multimodal reasoning
ERQA is useful as a grounded reasoning check because it emphasizes answer correctness tied to visual evidence rather than fluent but ungrounded descriptions.
Qwen3.6 launch benchmarksVersion
ERQA 2026
Refresh cadence
Quarterly
Staleness state
Current
Question availability
Public benchmark set
BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.
A grounded visual reasoning benchmark focused on evidence-based question answering over real images.
Gemini 3 Pro by Google currently leads with a score of 70.5% on ERQA.
5 AI models have been evaluated on ERQA on BenchLM.
Get notified when new models drop, benchmark scores change, or the leaderboard shifts. One email per week.
Free. No spam. Unsubscribe anytime. We only store derived location metadata for consent routing.