Skip to main content
BenchLM
Data

FACTS Grounding V1

We show this table for reference; we do not rank on it.

Data verified

The archived FACTS Grounding V1 protocol tests factual responses grounded in supplied documents. Its original judge setup and results remain separate from Grounding V2.

Evaluation results published by Google DeepMind, Google Research, and Kaggle. How Kaggle Benchmarks reruns tests.

The exact version 1 page declares Apache 2.0. We retain aggregate measurements, attribution, and source links. No tasks, questions, answers, documents, or other underlying dataset contents are included. Original article terms.

Published score (%) on FACTS Grounding V1 — Archived version 1

We mirror the published published score (%) view for FACTS Grounding V1. Llama 3 - Grounded Language Model has the highest reported value at 89.4%. These archived version 1 protocols remain separate from the current version 2 boards. The complete official download includes configurations hidden by default source filters. Source identities are preserved, and these measurements do not enter overall or category rankings. We do not use these results to rank models overall.

35 source rowsReasoningCurrentDisplay onlyUpdated Archived version 1

Published score (%) table (35 source rows)

Published score (%) results for FACTS Grounding V1
RankModel / configurationScoreParameters (B)Open / closed
1Llama 3 - Grounded Language ModelCreator not reportedArchived Kaggle benchmark v1; Task revision 1; Evaluated 2025-08-20
89.4%
Not reportedUnknown
2Gemini 2.5 ProCreator not reportedArchived Kaggle benchmark v1; Task revision 1; Evaluated 2025-06-06
87.8%
Not reportedUnknown
3GPT-5Creator not reportedArchived Kaggle benchmark v1; Task revision 1; Evaluated 2025-08-11
87.4%
Not reportedUnknown
4Gemini 2.5 FlashCreator not reportedArchived Kaggle benchmark v1; Task revision 1; Evaluated 2025-07-14
86.4%
Not reportedUnknown
5Gemini 2.0 FlashCreator not reportedArchived Kaggle benchmark v1; Task revision 1; Evaluated 2025-05-08
85.6%
Not reportedUnknown
6Claude 3.5 SonnetCreator not reportedArchived Kaggle benchmark v1; Task revision 1; Evaluated 2025-05-08
83.3%
Not reportedUnknown
7Gemini 2.0 Flash LiteCreator not reportedArchived Kaggle benchmark v1; Task revision 1; Evaluated 2025-06-20
83.2%
Not reportedUnknown
8DeepSeek-R1Creator not reportedArchived Kaggle benchmark v1; Task revision 1; Evaluated 2025-06-04
82.4%
Not reportedUnknown
9Gemini 1.5 FlashCreator not reportedArchived Kaggle benchmark v1; Task revision 1; Evaluated 2025-05-16
82.4%
Not reportedUnknown
10Gemini 1.5 ProCreator not reportedArchived Kaggle benchmark v1; Task revision 1; Evaluated 2025-05-08
81.2%
Not reportedUnknown
11Gemma 3 27BCreator not reportedArchived Kaggle benchmark v1; Task revision 1; Evaluated 2025-05-08
80.6%
Not reportedUnknown
12Gemma 3 12BCreator not reportedArchived Kaggle benchmark v1; Task revision 1; Evaluated 2025-05-08
80.5%
Not reportedUnknown
13Gemini 1.5 Flash 8BCreator not reportedArchived Kaggle benchmark v1; Task revision 1; Evaluated 2025-05-16
79.7%
Not reportedUnknown
14Claude Sonnet 4Creator not reportedArchived Kaggle benchmark v1; Task revision 1; Evaluated 2025-05-23
79.1%
Not reportedUnknown
15Claude 3.7 SonnetCreator not reportedArchived Kaggle benchmark v1; Task revision 1; Evaluated 2025-05-08
78.8%
Not reportedUnknown
16o1Creator not reportedArchived Kaggle benchmark v1; Task revision 1; Evaluated 2025-05-08
78.8%
Not reportedUnknown
17Claude 3.5 HaikuCreator not reportedArchived Kaggle benchmark v1; Task revision 1; Evaluated 2025-05-08
78.1%
Not reportedUnknown
18Claude Opus 4Creator not reportedArchived Kaggle benchmark v1; Task revision 1; Evaluated 2025-05-23
77.7%
Not reportedUnknown
19o3 miniCreator not reportedArchived Kaggle benchmark v1; Task revision 1; Evaluated 2025-05-08
77.6%
Not reportedUnknown
20Grok 2Creator not reportedArchived Kaggle benchmark v1; Task revision 1; Evaluated 2025-05-08
76.2%
Not reportedUnknown
21GPT-4oCreator not reportedArchived Kaggle benchmark v1; Task revision 1; Evaluated 2025-05-08
75.9%
Not reportedUnknown
22Grok 3Creator not reportedArchived Kaggle benchmark v1; Task revision 1; Evaluated 2025-05-29
75.7%
Not reportedUnknown
23Grok 3 MiniCreator not reportedArchived Kaggle benchmark v1; Task revision 1; Evaluated 2025-05-26
75.0%
Not reportedUnknown
24GPT-4.1Creator not reportedArchived Kaggle benchmark v1; Task revision 1; Evaluated 2025-05-08
74.5%
Not reportedUnknown
25Mistral Large 2Creator not reportedArchived Kaggle benchmark v1; Task revision 1; Evaluated 2025-05-08
72.6%
Not reportedUnknown
26Mixtral 8x22BCreator not reportedArchived Kaggle benchmark v1; Task revision 1; Evaluated 2025-05-08
70.1%
Not reportedUnknown
27o3Creator not reportedArchived Kaggle benchmark v1; Task revision 1; Evaluated 2025-05-08
69.6%
Not reportedUnknown
28GPT-4o miniCreator not reportedArchived Kaggle benchmark v1; Task revision 1; Evaluated 2025-05-08
68.4%
Not reportedUnknown
29Gemma 3 4BCreator not reportedArchived Kaggle benchmark v1; Task revision 1; Evaluated 2025-05-08
64.8%
Not reportedUnknown
30DeepSeek-V3Creator not reportedArchived Kaggle benchmark v1; Task revision 1; Evaluated 2025-05-08
63.9%
Not reportedUnknown
31o1 miniCreator not reportedArchived Kaggle benchmark v1; Task revision 1; Evaluated 2025-05-08
62.1%
Not reportedUnknown
32o4 miniCreator not reportedArchived Kaggle benchmark v1; Task revision 1; Evaluated 2025-05-08
62.1%
Not reportedUnknown
33CodestralCreator not reportedArchived Kaggle benchmark v1; Task revision 1; Evaluated 2025-05-08
59.7%
Not reportedUnknown
34Ministral 8BCreator not reportedArchived Kaggle benchmark v1; Task revision 1; Evaluated 2025-05-08
56.1%
Not reportedUnknown
35Ministral 3BCreator not reportedArchived Kaggle benchmark v1; Task revision 1; Evaluated 2025-05-08
52.2%
Not reportedUnknown

How to read FACTS Grounding V1

FACTS Grounding V1 tests responses to requests accompanied by documents of up to 32,000 tokens. Its 1,719 examples are split into 860 public and 859 private examples. The original protocol uses an ensemble of three model judges and filters responses for eligibility before assessing factual grounding.

The version 1 download supplies overall, public, and private scores. Version 2 changes the evaluation setup, so the archived scores remain separate. This board measures support from the supplied document; it does not establish factual accuracy outside that document.

The download was acquired on the recorded retrieval date. Per-result evaluation timestamps are publisher dates, not evidence of when this leaderboard snapshot was first available.

These archived version 1 protocols remain separate from the current version 2 boards. The complete official download includes configurations hidden by default source filters. Source identities are preserved, and these measurements do not enter overall or category rankings.

These archived version 1 protocols remain separate from the current version 2 boards. The complete official download includes configurations hidden by default source filters. Source identities are preserved, and these measurements do not enter overall or category rankings. The table retains each source configuration and its reported value.

35 source rows are shown for FACTS Grounding V1. The benchmark falls in the Reasoning category. We keep external benchmark mirrors separate from the weighted global scoring system, so these results remain source-specific evidence. FACTS Grounding V1 is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.

About FACTS Grounding V1

Year

2025

Tasks

1,719 examples: 860 public and 859 private

Format

Document-grounded answering with an ensemble of three judges

FACTS Grounding V1 tests responses to requests accompanied by documents of up to 32,000 tokens. Its 1,719 examples are split into 860 public and 859 private examples. The original protocol uses an ensemble of three model judges and filters responses for eligibility before assessing factual grounding. The version 1 download supplies overall, public, and private scores. Version 2 changes the evaluation setup, so the archived scores remain separate. This board measures support from the supplied document; it does not establish factual accuracy outside that document. These archived version 1 protocols remain separate from the current version 2 boards. The complete official download includes configurations hidden by default source filters. Source identities are preserved, and these measurements do not enter overall or category rankings.

Freshness and provenance

Version

FACTS Grounding V1 2025

Refresh cadence

Quarterly

Staleness state

Current

Question availability

Public benchmark set

CurrentDisplay only

BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.

Questions

What does FACTS Grounding V1 measure?

The archived FACTS Grounding V1 protocol tests factual responses grounded in supplied documents. Its original judge setup and results remain separate from Grounding V2.

Which source row has the highest reported FACTS Grounding V1 value?

Llama 3 - Grounded Language Model has the highest reported FACTS Grounding V1 value at 89.4%. These archived version 1 protocols remain separate from the current version 2 boards. The complete official download includes configurations hidden by default source filters. Source identities are preserved, and these measurements do not enter overall or category rankings. BenchLM shows this benchmark for display only and does not use it in overall rankings.

How many models are evaluated on FACTS Grounding V1?

The Archived version 1 snapshot contains 35 AI models.

Last updated: Archived version 1 · mirrored from the public benchmark leaderboard

Know when it’s worth switching models

The model to choose, the cheaper alternative, and the release we would wait on.

Read a sample issue

Join 6,100+ subscribers.

One email each week. Unsubscribe anytime.