JudgeBench authors

Data verified October 1, 2026

This page groups canonical JudgeBench authors model families and applies the same public scoring lane used by the main leaderboard.

Model count

Best model

N/A

Arena-Hard (claude-3-5-sonnet-20240620) (JudgeBench)

Avg. top 3

N/A

Latest release

N/A

Public-ranked

Supported

Provider models

		Price			Public score
Arena-Hard (claude-3-5-sonnet-20240620) (JudgeBench)	Tracked	N/A	N/A	N/A	—
Arena-Hard (claude-3-haiku-20240307) (JudgeBench)	Tracked	N/A	N/A	N/A	—
Arena-Hard (DeepSeek-R1-250120) (JudgeBench)	Tracked	N/A	N/A	N/A	—
Arena-Hard (gemini-1.5-flash-001) (JudgeBench)	Tracked	N/A	N/A	N/A	—
Arena-Hard (gemini-1.5-pro-001) (JudgeBench)	Tracked	N/A	N/A	N/A	—
Arena-Hard (gpt-4o-2024-05-13) (JudgeBench)	Tracked	N/A	N/A	N/A	—
Arena-Hard (gpt-4o-mini-2024-07-18) (JudgeBench)	Tracked	N/A	N/A	N/A	—
Arena-Hard (Llama-3.1-405B-Instruct) (JudgeBench)	Tracked	N/A	N/A	N/A	—
Arena-Hard (Llama-3.1-70B-Instruct) (JudgeBench)	Tracked	N/A	N/A	N/A	—
Arena-Hard (Llama-3.1-8B-Instruct) (JudgeBench)	Tracked	N/A	N/A	N/A	—
Arena-Hard (o1-mini-2024-09-12) (JudgeBench)	Tracked	N/A	N/A	N/A	—
Arena-Hard (o1-preview-2024-09-12) (JudgeBench)	Tracked	N/A	N/A	N/A	—
Arena-Hard (o3-mini-2025-01-31 (high)) (JudgeBench)	Tracked	N/A	N/A	N/A	—
Arena-Hard (o3-mini-2025-01-31 (low)) (JudgeBench)	Tracked	N/A	N/A	N/A	—
Arena-Hard (o3-mini-2025-01-31 (medium)) (JudgeBench)	Tracked	N/A	N/A	N/A	—
ChatEval (gpt-4o-2024-05-13) (JudgeBench)	Tracked	N/A	N/A	N/A	—
Claude-3.5-Sonnet Solver (JudgeBench)	Tracked	N/A	N/A	N/A	—
Gemini-1.5-pro Solver (JudgeBench)	Tracked	N/A	N/A	N/A	—
GPT-4o Solver (JudgeBench)	Tracked	N/A	N/A	N/A	—
Llama-3.1-405B-Instruct Solver (JudgeBench)	Tracked	N/A	N/A	N/A	—
Vanilla (gpt-4o-2024-05-13) (JudgeBench)	Tracked	N/A	N/A	N/A	—
VertexAI Evaluation (gemini-1.5-pro-001) (JudgeBench)	Tracked	N/A	N/A	N/A	—