# FACTS Search V1

> The archived FACTS Search V1 protocol measures factual answering with Brave Search and a Gemini 2.0 Flash grader. Its scores remain separate from Search V2.

Canonical page: https://benchlm.ai/benchmarks/facts-search-v1

- Category: [Agentic](/agentic)
- Last updated: Archived version 1

Evaluation results published by [Google DeepMind, Google Research, and Kaggle](https://www.kaggle.com/benchmarks/google/facts-search/versions/1). undefined

The exact version 1 page declares Apache 2.0. We retain aggregate measurements, attribution, and source links. No tasks, questions, answers, documents, or other underlying dataset contents are included. [Original article terms](https://www.apache.org/licenses/LICENSE-2.0).

FACTS Search V1 gives the model a shared Brave Search tool for up to seven agent turns. A Gemini 2.0 Flash grader compares the final answer with the question and reference answer. Version 2 changes the grader, so its results belong to a separate board.

The download supplies Score, public and private scores, hedging rate, average searches, attempted accuracy, and F1. We display the published Score and retain the other measurements separately. The source describes an F1 measure, but its distinct Score and F1 fields are not treated as interchangeable.

The download was acquired on the recorded retrieval date. Per-result evaluation timestamps are publisher dates, not evidence of when this leaderboard snapshot was first available.

These archived version 1 protocols remain separate from the current version 2 boards. The complete official download includes configurations hidden by default source filters. Source identities are preserved, and these measurements do not enter overall or category rankings.

These archived version 1 protocols remain separate from the current version 2 boards. The complete official download includes configurations hidden by default source filters. Source identities are preserved, and these measurements do not enter overall or category rankings.

- [Official archived Kaggle leaderboard](https://www.kaggle.com/benchmarks/google/facts-search/versions/1)
- [Official version 1 leaderboard JSON](https://www.kaggle.com/api/v1/benchmarks/google/facts-search/versions/1/leaderboard)
- [Evaluation method](https://www.kaggle.com/benchmarks/google/facts-search/versions/1)
- [Benchmark-page Apache 2.0 declaration](https://www.apache.org/licenses/LICENSE-2.0)

## About FACTS Search V1

- Year: 2025
- Tasks: Search-assisted factual questions; public and held-out sets
- Format: Tool-assisted answering with an automated grader
- Paper: [FACTS Search V1 methodology](https://www.kaggle.com/benchmarks/google/facts-search/versions/1)

FACTS Search V1 gives the model a shared Brave Search tool for up to seven agent turns. A Gemini 2.0 Flash grader compares the final answer with the question and reference answer. Version 2 changes the grader, so its results belong to a separate board. The download supplies Score, public and private scores, hedging rate, average searches, attempted accuracy, and F1. We display the published Score and retain the other measurements separately. The source describes an F1 measure, but its distinct Score and F1 fields are not treated as interchangeable. These archived version 1 protocols remain separate from the current version 2 boards. The complete official download includes configurations hidden by default source filters. Source identities are preserved, and these measurements do not enter overall or category rankings.

FACTS Search V1 is currently displayed on BenchLM for reference, but it is excluded from the weighted scoring formula.

## Leaderboard (31 source rows)

| Rank | Model | Configuration | Creator | Score |
|------|-------|---------------|---------|-------|
| 1 | [Gemini 3.1 Pro Preview](https://www.kaggle.com/benchmarks/google/facts-search/versions/1) | Archived Kaggle benchmark v1; Task revision 1; Evaluation date unreported | — | 85.6% |
| 2 | [GPT-5.5](https://www.kaggle.com/benchmarks/google/facts-search/versions/1) | Archived Kaggle benchmark v1; Task revision 1; Evaluation date unreported | — | 85.0% |
| 3 | [Gemini 3 Flash Preview](https://www.kaggle.com/benchmarks/google/facts-search/versions/1) | Archived Kaggle benchmark v1; Task revision 1; Evaluation date unreported | — | 81.0% |
| 4 | [Claude Opus 4.8](https://www.kaggle.com/benchmarks/google/facts-search/versions/1) | Archived Kaggle benchmark v1; Task revision 1; Evaluation date unreported | — | 80.3% |
| 5 | [Claude Opus 4.7](https://www.kaggle.com/benchmarks/google/facts-search/versions/1) | Archived Kaggle benchmark v1; Task revision 1; Evaluation date unreported | — | 78.8% |
| 6 | [GPT-5](https://www.kaggle.com/benchmarks/google/facts-search/versions/1) | Archived Kaggle benchmark v1; Task revision 1; Evaluated 2025-11-24 | — | 77.7% |
| 7 | [Grok 4.1 Fast Reasoning](https://www.kaggle.com/benchmarks/google/facts-search/versions/1) | Archived Kaggle benchmark v1; Task revision 1; Evaluated 2025-11-24 | — | 77.4% |
| 8 | [Claude Opus 4.6](https://www.kaggle.com/benchmarks/google/facts-search/versions/1) | Archived Kaggle benchmark v1; Task revision 1; Evaluation date unreported | — | 76.7% |
| 9 | [Claude Sonnet 4.6](https://www.kaggle.com/benchmarks/google/facts-search/versions/1) | Archived Kaggle benchmark v1; Task revision 1; Evaluation date unreported | — | 76.4% |
| 10 | [Grok 4](https://www.kaggle.com/benchmarks/google/facts-search/versions/1) | Archived Kaggle benchmark v1; Task revision 1; Evaluated 2025-11-25 | — | 75.3% |
| 11 | [o3](https://www.kaggle.com/benchmarks/google/facts-search/versions/1) | Archived Kaggle benchmark v1; Task revision 1; Evaluated 2025-11-24 | — | 74.8% |
| 12 | [Claude Opus 4.5](https://www.kaggle.com/benchmarks/google/facts-search/versions/1) | Archived Kaggle benchmark v1; Task revision 1; Evaluated 2025-11-25 | — | 73.2% |
| 13 | [GPT-5.2](https://www.kaggle.com/benchmarks/google/facts-search/versions/1) | Archived Kaggle benchmark v1; Task revision 1; Evaluation date unreported | — | 72.2% |
| 14 | [Claude Sonnet 4.5 (thinking)](https://www.kaggle.com/benchmarks/google/facts-search/versions/1) | Archived Kaggle benchmark v1; Task revision 1; Evaluated 2025-11-25 | — | 69.8% |
| 15 | [Gemma 4 31B](https://www.kaggle.com/benchmarks/google/facts-search/versions/1) | Archived Kaggle benchmark v1; Task revision 1; Evaluation date unreported | — | 68.9% |
| 16 | [GPT-5 mini](https://www.kaggle.com/benchmarks/google/facts-search/versions/1) | Archived Kaggle benchmark v1; Task revision 1; Evaluated 2025-11-24 | — | 67.9% |
| 17 | [grok-4-fast-reasoning](https://www.kaggle.com/benchmarks/google/facts-search/versions/1) | Archived Kaggle benchmark v1; Task revision 1; Evaluated 2025-11-24 | — | 67.3% |
| 18 | [Gemini 3.1 Flash-Lite Preview](https://www.kaggle.com/benchmarks/google/facts-search/versions/1) | Archived Kaggle benchmark v1; Task revision 1; Evaluation date unreported | — | 66.8% |
| 19 | [Claude Sonnet 4](https://www.kaggle.com/benchmarks/google/facts-search/versions/1) | Archived Kaggle benchmark v1; Task revision 1; Evaluated 2025-11-24 | — | 66.3% |
| 20 | [o4 mini](https://www.kaggle.com/benchmarks/google/facts-search/versions/1) | Archived Kaggle benchmark v1; Task revision 1; Evaluated 2025-11-24 | — | 66.2% |
| 21 | [Claude Opus 4.1](https://www.kaggle.com/benchmarks/google/facts-search/versions/1) | Archived Kaggle benchmark v1; Task revision 1; Evaluated 2025-11-24 | — | 65.0% |
| 22 | [GPT-4.1](https://www.kaggle.com/benchmarks/google/facts-search/versions/1) | Archived Kaggle benchmark v1; Task revision 1; Evaluated 2025-11-24 | — | 64.6% |
| 23 | [Gemini 2.5 Pro](https://www.kaggle.com/benchmarks/google/facts-search/versions/1) | Archived Kaggle benchmark v1; Task revision 1; Evaluated 2025-11-24 | — | 63.9% |
| 24 | [Gemini 3.5 Flash](https://www.kaggle.com/benchmarks/google/facts-search/versions/1) | Archived Kaggle benchmark v1; Task revision 1; Evaluation date unreported | — | 62.6% |
| 25 | [GPT-5.1](https://www.kaggle.com/benchmarks/google/facts-search/versions/1) | Archived Kaggle benchmark v1; Task revision 1; Evaluated 2025-11-24 | — | 62.4% |
| 26 | [Gemini 2.5 Flash](https://www.kaggle.com/benchmarks/google/facts-search/versions/1) | Archived Kaggle benchmark v1; Task revision 1; Evaluated 2025-11-25 | — | 60.0% |
| 27 | [GPT-4o](https://www.kaggle.com/benchmarks/google/facts-search/versions/1) | Archived Kaggle benchmark v1; Task revision 1; Evaluated 2025-11-25 | — | 56.8% |
| 28 | [Gemma 4 26B A4B](https://www.kaggle.com/benchmarks/google/facts-search/versions/1) | Archived Kaggle benchmark v1; Task revision 1; Evaluation date unreported | — | 56.7% |
| 29 | [gpt-oss-120b](https://www.kaggle.com/benchmarks/google/facts-search/versions/1) | Archived Kaggle benchmark v1; Task revision 1; Evaluated 2025-11-24 | — | 44.5% |
| 30 | [Gemma 3 27B](https://www.kaggle.com/benchmarks/google/facts-search/versions/1) | Archived Kaggle benchmark v1; Task revision 1; Evaluation date unreported | — | 41.4% |
| 31 | [gpt-oss-20b](https://www.kaggle.com/benchmarks/google/facts-search/versions/1) | Archived Kaggle benchmark v1; Task revision 1; Evaluated 2025-11-25 | — | 34.8% |

## FAQ

### What does FACTS Search V1 measure?

The archived FACTS Search V1 protocol measures factual answering with Brave Search and a Gemini 2.0 Flash grader. Its scores remain separate from Search V2.

### Which source row has the highest reported FACTS Search V1 value?

Gemini 3.1 Pro Preview has the highest reported FACTS Search V1 value at 85.6%. These archived version 1 protocols remain separate from the current version 2 boards. The complete official download includes configurations hidden by default source filters. Source identities are preserved, and these measurements do not enter overall or category rankings.

### How many models are evaluated on FACTS Search V1?

The Archived version 1 contains 31 AI models.

### Does FACTS Search V1 affect BenchLM's overall score?

Not directly. FACTS Search V1 is still displayed on BenchLM for reference, but it is excluded from the weighted scoring formula.
