TruthfulQA
We show this table for reference; we do not rank on it.
A benchmark designed to measure whether language models produce truthful answers instead of repeating common misconceptions or misleading falsehoods.
About TruthfulQA
Year
2021
Tasks
Truthfulness and misconception resistance
Format
Question answering
Difficulty
Hallucination and factuality stress test
TruthfulQA matters because many models sound confident while repeating popular but false answers. It is a useful factuality and hallucination-adjacent benchmark even though it is older than newer factuality suites.
Freshness and provenance
Version
TruthfulQA 2021
Refresh cadence
Static
Staleness state
Stale
Question availability
Public benchmark set
BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.
Questions
What does TruthfulQA measure?
A benchmark designed to measure whether language models produce truthful answers instead of repeating common misconceptions or misleading falsehoods.
Which model scores highest on TruthfulQA?
No sourced model results are published for TruthfulQA on BenchLM yet.
How many models are evaluated on TruthfulQA?
0 AI models have published results on TruthfulQA in the BenchLM catalog.
Know when it’s worth switching models
The model to choose, the cheaper alternative, and the release we would wait on.
Read a sample issueJoin 5,600+ readers.
One email each week. Unsubscribe anytime.