Benchmark profile
RuneBench / runescape-bench (RuneScape-Bench)
An agentic coding benchmark where models use a TypeScript SDK to play a RuneScape-like environment and optimize skill-training performance.
How BenchLM shows RuneScape-Bench
BenchLM mirrors RuneBench, the public results site for runescape-bench. The snapshot averages ln(1 + XP/min) across 16 skill-training tasks where coding agents use a TypeScript SDK to control a RuneScape-like game environment.
RuneScape-Bench is display only on BenchLM because it measures agent scaffolds and gameplay automation strategies as much as base model quality. BenchLM keeps it as external agentic-coding context.
Avg ln(1 + XP/min) on RuneScape-Bench — May 2026 snapshot
BenchLM mirrors the published avg ln(1 + xp/min) view for RuneScape-Bench. GPT-5.5 xhigh leads the public snapshot at 5.7% , followed by Gemini 3.5 Flash (5.4%) and GPT-5.5 (5.3%). BenchLM does not use these results to rank models overall.
GPT-5.5 xhigh
OpenAI
gpt55-apikey
Gemini 3.5 Flash
gemini35flash
GPT-5.5
OpenAI
gpt55
Avg ln(1 + XP/min) table (25 models)
ScoreThe published RuneScape-Bench snapshot places GPT-5.5 xhigh first at 5.7%. The third row is 0.4 points behind. The broader top-10 range is 1.1 points, so many of the published results sit in a relatively narrow band.
25 models have been evaluated on RuneScape-Bench. The benchmark falls in the External benchmark mirrors category. We keep external benchmark mirrors separate from the weighted global scoring system, so these results remain source-specific evidence. RuneScape-Bench is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.
About RuneScape-Bench
Year
2026
Tasks
16 RuneScape skill-training tasks
Format
Average log XP-rate score
Difficulty
Agentic gameplay automation
RuneBench evaluates gameplay automation and coding-agent strategy. BenchLM mirrors the public aggregate computed as average ln(1 + XP/min) across 16 skill-training tasks, while keeping the benchmark display-only because rows reflect agent harness and gameplay strategy.
BenchLM freshness & provenance
Version
RuneScape-Bench 2026
Refresh cadence
Quarterly
Staleness state
Current
Question availability
Public benchmark set
BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.
FAQ
What does RuneScape-Bench measure?
An agentic coding benchmark where models use a TypeScript SDK to play a RuneScape-like environment and optimize skill-training performance.
Which model leads the published RuneScape-Bench snapshot?
GPT-5.5 xhigh currently leads the published RuneScape-Bench snapshot with 5.7% avg ln(1 + xp/min). BenchLM shows this benchmark for display only and does not use it in overall rankings.
How many models are evaluated on RuneScape-Bench?
25 AI models are included in BenchLM's mirrored RuneScape-Bench snapshot, based on the public leaderboard captured on May 2026 snapshot.
Know when it’s worth switching models
The model to choose, the cheaper alternative, and the release we would wait on.
Read a sample issueJoin 2,000+ readers.
One email each week. Unsubscribe anytime.