# RAGTruth: provider-reported F1 (RAGTruth (provider reports))

> Corpus of retrieval-augmented responses annotated word by word for unsupported or contradicted content.

Canonical page: https://benchlm.ai/benchmarks/ragtruthprovider

- Category: [Knowledge](/knowledge)
- Last updated: October 29, 2026

## About RAGTruth (provider reports)

- Year: 2024
- Tasks: Retrieval-augmented question answering, summarization and data-to-text
- Format: F1
- Difficulty: Avoiding unsupported claims
- Paper: [RAGTruth](https://github.com/ParticleMedia/RAGTruth)

NVIDIA reports it for Nemotron 3.5 Bolt E4B (October 23, 2026), run in its NeMo Gym harness, as F1 in reasoning mode, and describes the task as avoiding unsupported claims. NVIDIA does not say whether the model wrote the responses or labeled them. The RAGTruth paper board keeps its generator and detector profiles separately.

RAGTruth (provider reports) is currently displayed on BenchLM for reference, but it is excluded from the weighted scoring formula.

## Leaderboard (2 models)

| Rank | Model | Creator | Score |
|------|-------|---------|-------|
| 1 | [Nemotron 3.5 Bolt E4B](/models/nemotron-3-5-bolt-e4b) | NVIDIA | 77.88% |
| 2 | [Nemotron 3.5 Bolt E4B BF16](/models/nemotron-3-5-bolt-e4b-bf16) | NVIDIA | 77.59% |

## FAQ

### What does RAGTruth (provider reports) measure?

Corpus of retrieval-augmented responses annotated word by word for unsupported or contradicted content.

### Which model scores highest on RAGTruth (provider reports)?

Nemotron 3.5 Bolt E4B by NVIDIA currently leads with a score of 77.88% on RAGTruth (provider reports).

### How many models are evaluated on RAGTruth (provider reports)?

2 AI models have published results on RAGTruth (provider reports) in the BenchLM catalog.

### Does RAGTruth (provider reports) affect BenchLM's overall score?

Not directly. RAGTruth (provider reports) is still displayed on BenchLM for reference, but it is excluded from the weighted scoring formula.

## Compare Top Models on RAGTruth (provider reports)

- [Nemotron 3.5 Bolt E4B vs Nemotron 3.5 Bolt E4B BF16](/compare/nemotron-3-5-bolt-e4b-vs-nemotron-3-5-bolt-e4b-bf16)