Benchmark profile
HellaSwag
A commonsense natural-language inference benchmark reported in DeepSeek-V4 base-model evaluations.
Data verifiedBenchmark score on HellaSwag — July 23, 2026
BenchLM mirrors the published score view for HellaSwag. DeepSeek V4 Pro Base leads the public snapshot at 88.0% , followed by DeepSeek V4 Flash Base (85.7%). BenchLM does not use these results to rank models overall.
DeepSeek V4 Pro Base
DeepSeek
deepseek-v4-pro-base
DeepSeek V4 Flash Base
DeepSeek
deepseek-v4-flash-base
Benchmark score table (2 models)
ScoreAbout HellaSwag
Year
2026
Tasks
Commonsense completion questions
Format
Exact match
Difficulty
Commonsense reasoning
BenchLM stores HellaSwag as a display-only provider-table row when exact values are published in DeepSeek-V4 evaluations.
BenchLM freshness & provenance
Version
HellaSwag 2026
Refresh cadence
Quarterly
Staleness state
Current
Question availability
Public benchmark set
BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.
FAQ
What does HellaSwag measure?
A commonsense natural-language inference benchmark reported in DeepSeek-V4 base-model evaluations.
Which model scores highest on HellaSwag?
DeepSeek V4 Pro Base by DeepSeek currently leads with a score of 88.0% on HellaSwag.
How many models are evaluated on HellaSwag?
2 AI models have been evaluated on HellaSwag on BenchLM.
Compare Top Models on HellaSwag
Choose a model with this week’s evidence
Join 2,000+ readers for ranking moves, pricing changes, and the claims that still need proof.
One email each week. Unsubscribe anytime.