# Prometheus2-7b (JudgeBench) Benchmark Scores & Performance > Prometheus2-7b (JudgeBench) has published results in 5 original benchmark tables. The evaluated configuration, source metrics, and precision remain visible below. These results do not produce a general model score or rank. Canonical page: https://benchlm.ai/models/native-judgebench-prometheus2-7b Last updated: 2026-10-01 General benchmark catalog last updated: October 1, 2026. This profile’s source review has its own date above. ## Model Details | Property | Value | |----------|-------| | Creator | Prometheus authors | | Source Type | Open Weight | | Reasoning Type | Unspecified | | Context Window | Not established by evaluation | | Official model card | [Checkpoint identified by JudgeBench](https://huggingface.co/prometheus-eval/prometheus-7b-v2.0) | | Overall Score | Not computed (source protocol results only) | | Overall Rank | Unranked | ## Family & Coverage - Family: Prometheus2-7b (JudgeBench) - Variant: benchmark-system - Benchmarks covered: 0 of 645 - Coverage note: Original benchmark result tables appear below; these metrics are separate from weighted benchmark slots. ## Original benchmark results [All model results (JSON)](/api/data/benchmarks?model=native-judgebench-prometheus2-7b) · [Numeric metrics (CSV)](/api/data/benchmarks?model=native-judgebench-prometheus2-7b&format=csv) ### Maintainer results on GPT-4o response pairs JudgeBench’s paper and maintained leaderboard report judges under different prompts, reasoning efforts, and response-model splits. Accuracy is a percentage. The paper’s 700-pair GPT-4o split is distinct from the 270-pair Claude split. The app appends the same Nemotron CSV to both tabs without specifying a response split; we show that supplement once with its split unresolved. Live one-decimal values and paper two-decimal values are preserved separately. GPT-4o-2024-05-13 response split. The public app rounds to one decimal; paper tables retain two decimals. JudgeBench: A Benchmark for Evaluating LLM-Based Judges — Sijun Tan and colleagues. Numeric results transcribed and reformatted; evaluation notes and model links added by BenchLM. Published numeric precision is retained. [Published source](https://huggingface.co/spaces/ScalerLab/JudgeBench) · [Full JudgeBench results](/benchmarks/judgebench) | Judge | Type | Knowledge (%) | Reasoning (%) | Math (%) | Coding (%) | Overall (%) | | --- | --- | --- | --- | --- | --- | --- | | Prometheus2-7b | Fine-Tuned Judge | 38.3 | 25.5 | 35.7 | 42.9 | 34.9 | ### Paper: judge methods JudgeBench’s paper and maintained leaderboard report judges under different prompts, reasoning efforts, and response-model splits. Accuracy is a percentage. The paper’s 700-pair GPT-4o split is distinct from the 270-pair Claude split. The app appends the same Nemotron CSV to both tabs without specifying a response split; we show that supplement once with its split unresolved. Live one-decimal values and paper two-decimal values are preserved separately. Paper v2; source group labels and published precision are retained. JudgeBench: A Benchmark for Evaluating LLM-Based Judges — Sijun Tan and colleagues. Numeric results transcribed and reformatted; evaluation notes and model links added by BenchLM. Published numeric precision is retained. [Published source](https://arxiv.org/abs/2410.12784v2) · [Full JudgeBench results](/benchmarks/judgebench) | Judge | Knowledge (%) | Reasoning (%) | Math (%) | Coding (%) | Overall (%) | | --- | --- | --- | --- | --- | --- | | Prometheus2-7b | 38.31 | 25.51 | 35.71 | 42.86 | 34.86 | ### Paper: judgment outcomes JudgeBench’s paper and maintained leaderboard report judges under different prompts, reasoning efforts, and response-model splits. Accuracy is a percentage. The paper’s 700-pair GPT-4o split is distinct from the 270-pair Claude split. The app appends the same Nemotron CSV to both tabs without specifying a response split; we show that supplement once with its split unresolved. Live one-decimal values and paper two-decimal values are preserved separately. Paper v2; source group labels and published precision are retained. JudgeBench: A Benchmark for Evaluating LLM-Based Judges — Sijun Tan and colleagues. Numeric results transcribed and reformatted; evaluation notes and model links added by BenchLM. Published numeric precision is retained. [Published source](https://arxiv.org/abs/2410.12784v2) · [Full JudgeBench results](/benchmarks/judgebench) | Judge | A>B count | A