InfographicVQA (InfoVQA)

We show this table for reference; we do not rank on it.

InfographicVQA asks questions about infographic images. These two own-provider InfoVQA test reports name the split but do not disclose the metric or scorer; their printed scores remain separate source facts.

Evaluation results published by Zyphra. Two original Zyphra InfoVQA test reports; metric/scorer not disclosed.

How to read these InfoVQA reports

Read with care: the benchmark is not marked current.

Saturation Different source configurations: Separate original-provider cohorts are shown below. Undisclosed metrics and different report setups do not support a shared performance ranking or a pooled score.
Who produced the rows Mirrored table: Selected rows come from the original reports linked in each source cohort. BenchLM did not rerun these evaluations.
Freshness and weight Display only: Dated provider reports, refreshed reviewed pinned original-provider artifacts. Display only; it does not move rankings. Original upstream task; no task contents mirrored.

Row statuses come from the verification registry; saturation and freshness from the benchmark lifecycle. A provider self-report is displayable evidence, not an independent run.

Zyphra: ZAYA1-VL-8B model card

Zyphra harness based on VLMEvalKit; metric/scorer and run settings not disclosed.

Source repository modified: 2026-05-17; this is not an evaluation date.

Zyphra: ZAYA1-VL-8B model card: own-provider aggregate scores
Source model	Reported score	Metric/scorer	Split	Original provider source	Parameters (B)	Open / closed
ZAYA1-VL-8BSource column: ZAYA1-VL-8B(0.7B / 8B)	74.0	Metric/scorer not disclosed	test	Zyphra reportPinned official model-card Performance table; own-model column only	Not reported	Unknown

Zyphra: Zamba2-VL-7B model card

Zyphra harness based on VLMEvalKit; metric/scorer and run settings not disclosed.

Source repository modified: 2026-05-24; this is not an evaluation date.

Zyphra: Zamba2-VL-7B model card: own-provider aggregate scores
Source model	Reported score	Metric/scorer	Split	Original provider source	Parameters (B)	Open / closed
Zamba2-VL-7B	74.8	Metric/scorer not disclosed	test	Zyphra reportPinned official model-card Performance table; own-model column only	Not reported	Unknown

Only each provider's own model rows are included. Undisclosed metrics keep the source's printed number without an accuracy, ANLS, or percentage interpretation. Scorer revisions, individual run dates, exact evaluated checkpoints, image processing, and evaluated question counts remain unknown. Separate cohorts do not establish a shared protocol or a cross-cohort rank. These reports do not affect overall or category scores.

How we show these InfoVQA reports

This page retains 2 selected rows across original provider reports about their own models. Comparison-model columns from those reports are excluded. Source model identities remain separate from catalog profiles.

Each cohort keeps its original split, printed score, source, and disclosed setup. The source revision or report publication date is separate from an evaluation date. Unknown settings remain unreported, and the scores do not enter overall or category rankings.

Snapshot

Own-provider rowsSeparate cohortsDisplay only

Zyphra ZAYA1-VL-8B model card Zyphra Zamba2-VL-7B model card Original benchmark task

About InfoVQA

Year

2021

Format

Provider-reported scores; metric/scorer not disclosed

Zyphra reports ZAYA1-VL-8B and Zamba2-VL-7B on InfoVQA test in separate model cards. The cards name a Zyphra harness based on VLMEvalKit but provide no scorer identity, exact evaluated checkpoint, sample count, or individual run date. No ANLS or percentage interpretation is applied to these values.

Public benchmark source

Freshness and provenance

Version

Selected May 2026 Zyphra model cards; test split

Refresh cadence

Reviewed pinned original-provider artifacts

Staleness state

Dated provider reports

Question availability

Original upstream task; no task contents mirrored

Dated provider reportsDisplay only

BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.

Questions

What does InfoVQA measure?

Can these source results be compared directly?

Separate original-provider cohorts are shown below. Undisclosed metrics and different report setups do not support a shared performance ranking or a pooled score. BenchLM shows this benchmark for display only and does not use it in overall rankings.

How many source reports are shown?

This snapshot shows 2 selected source reports. Each row retains its original source and disclosed setup.

Can these InfoVQA values be labeled ANLS?

The original model cards do not name ANLS or another scorer for these rows. A reference to a VLMEvalKit-based harness does not identify the provider's exact scoring implementation. The table therefore shows the printed score with an undisclosed-metric label and does not convert it into an accuracy or percentage claim.

Last updated: May 2026 source revisions; checked October 1, 2026 · retained from pinned original source reports

Know when it’s worth switching models

The model to choose, the cheaper alternative, and the release we would wait on.

Read a sample issue

Join 5,600+ readers.

One email each week. Unsubscribe anytime.