Benchmark profile
Testing the Limits of Chain-of-thought with Multistep Soft Reasoning (MuSR)
A dataset for evaluating language models on multistep soft reasoning tasks specified in natural language narratives. Tests the ability to perform complex, structured reasoning.
Data verifiedHow BenchLM shows MuSR right now
BenchLM is tracking MuSR in the local dataset, but exact-source verification records for these rows are still being attached. To avoid a blank benchmark page, BenchLM shows the current tracked rows below as a display-only reference table.
These tracked rows are useful for inspection and spot-checking, but until exact-source attachments are completed they should not be treated as fully verified public benchmark rows.
Tracked score on MuSR — July 20, 2026
BenchLM mirrors the published tracked score view for MuSR. GPT-5.2 Pro leads the public snapshot at 95% , followed by GPT-5.4 (94%) and GPT-5.3 Instant (94%). BenchLM does not use these results to rank models overall.
GPT-5.2 Pro
OpenAI
gpt-5-2-pro
GPT-5.4
OpenAI
gpt-5-4
GPT-5.3 Instant
OpenAI
gpt-5-3-instant
Tracked score table (113 models)
ScoreThe published MuSR snapshot places GPT-5.2 Pro first at 95%. The third row is 1.0 points behind. The broader top-10 range is 2.0 points, so many of the published results sit in a relatively narrow band.
113 models have been evaluated on MuSR. The benchmark falls in the Reasoning category. This category carries a 17% weight in BenchLM.ai's overall scoring system. MuSR is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.
About MuSR
Year
2023
Tasks
Multi-step reasoning
Format
Narrative-based reasoning
Difficulty
Complex reasoning tasks
MuSR challenges models to perform multistep reasoning over complex narratives. Unlike simple factual questions, it requires models to track multiple entities, relationships, and logical steps across extended contexts.
BenchLM freshness & provenance
Version
MuSR 2023
Refresh cadence
Static
Staleness state
Stale
Question availability
Public benchmark set
BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.
FAQ
What does MuSR measure?
A dataset for evaluating language models on multistep soft reasoning tasks specified in natural language narratives. Tests the ability to perform complex, structured reasoning.
Which model leads the published MuSR snapshot?
GPT-5.2 Pro currently leads the published MuSR snapshot with 95% tracked score. BenchLM shows this benchmark for display only and does not use it in overall rankings.
How many models are evaluated on MuSR?
113 AI models are included in BenchLM's mirrored MuSR snapshot, based on the public leaderboard captured on July 20, 2026.
Choose a model with this week’s evidence
Join 2,000+ readers for ranking moves, pricing changes, and the claims that still need proof.
One email each week. Unsubscribe anytime.