Toloka Arena
We show this table for reference; we do not rank on it.
An independent agentic-intelligence evaluation from Toloka using private simulated workflows and a pass^5 metric.
How Toloka Arena is shown here
BenchLM tracks Toloka Arena as a source-backed external benchmark using the public pass^5 metric and update label from the official page.
Toloka Arena is display only on BenchLM. The public site renders an arena leaderboard, but BenchLM did not find a stable public static CSV or API for mirroring every row, so this page is source metadata only for now.
Snapshot
About Toloka Arena
Year
2026
Tasks
Private simulated enterprise workflows
Format
pass^5 arena score
Difficulty
Agentic workflow reliability
Toloka Arena evaluates agents on private simulated workflows with tools, databases, policies, and multi-turn tasks. BenchLM tracks it as source metadata only until a stable public leaderboard data feed is available.
Freshness and provenance
Version
Toloka Arena 2026
Refresh cadence
Quarterly
Staleness state
Current
Question availability
Public benchmark set
BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.
Questions
What does Toloka Arena measure?
An independent agentic-intelligence evaluation from Toloka using private simulated workflows and a pass^5 metric.
Which model leads the published Toloka Arena snapshot?
No models have been evaluated on Toloka Arena yet.
How many models are evaluated on Toloka Arena?
The June 3, 2026 snapshot contains 0 AI models.
Know when it’s worth switching models
The model to choose, the cheaper alternative, and the release we would wait on.
Read a sample issueJoin 2,000+ readers.
One email each week. Unsubscribe anytime.