# Skywork-Critic-Llama-3.1-8B (JudgeBench) Benchmark Scores & Performance

> Skywork-Critic-Llama-3.1-8B (JudgeBench) has published results in 4 original benchmark tables. The evaluated configuration, source metrics, and precision remain visible below. These results do not produce a general model score or rank.

Canonical page: https://benchlm.ai/models/native-judgebench-skywork-critic-llama-3-1-8b

Last updated: 2026-10-01

General benchmark catalog last updated: October 1, 2026. This profile’s source review has its own date above.

## Model Details

| Property | Value |
|----------|-------|
| Creator | Skywork |
| Source Type | Open Weight |
| Reasoning Type | Unspecified |
| Context Window | Not established by evaluation |
| Official model card | [Checkpoint identified by JudgeBench](https://huggingface.co/Skywork/Skywork-Critic-Llama-3.1-8B) |
| Overall Score | Not computed (source protocol results only) |
| Overall Rank | Unranked |

## Family & Coverage

- Family: Skywork-Critic-Llama-3.1-8B (JudgeBench)
- Variant: benchmark-system
- Benchmarks covered: 0 of 645
- Coverage note: Original benchmark result tables appear below; these metrics are separate from weighted benchmark slots.

## Original benchmark results

[All model results (JSON)](/api/data/benchmarks?model=native-judgebench-skywork-critic-llama-3-1-8b) · [Numeric metrics (CSV)](/api/data/benchmarks?model=native-judgebench-skywork-critic-llama-3-1-8b&format=csv)

### Maintainer results on GPT-4o response pairs

JudgeBench’s paper and maintained leaderboard report judges under different prompts, reasoning efforts, and response-model splits. Accuracy is a percentage. The paper’s 700-pair GPT-4o split is distinct from the 270-pair Claude split. The app appends the same Nemotron CSV to both tabs without specifying a response split; we show that supplement once with its split unresolved. Live one-decimal values and paper two-decimal values are preserved separately.

GPT-4o-2024-05-13 response split. The public app rounds to one decimal; paper tables retain two decimals.

JudgeBench: A Benchmark for Evaluating LLM-Based Judges — Sijun Tan and colleagues. Numeric results transcribed and reformatted; evaluation notes and model links added by BenchLM. Published numeric precision is retained.

[Published source](https://huggingface.co/spaces/ScalerLab/JudgeBench) · [Full JudgeBench results](/benchmarks/judgebench)

| Judge | Type | Knowledge (%) | Reasoning (%) | Math (%) | Coding (%) | Overall (%) |
| --- | --- | --- | --- | --- | --- | --- |
| Skywork-Critic-Llama-3.1-8B | Fine-Tuned Judge | 51.3 | 54.1 | 73.2 | 33.3 | 53.4 |

### Paper: judge methods

JudgeBench’s paper and maintained leaderboard report judges under different prompts, reasoning efforts, and response-model splits. Accuracy is a percentage. The paper’s 700-pair GPT-4o split is distinct from the 270-pair Claude split. The app appends the same Nemotron CSV to both tabs without specifying a response split; we show that supplement once with its split unresolved. Live one-decimal values and paper two-decimal values are preserved separately.

Paper v2; source group labels and published precision are retained.

JudgeBench: A Benchmark for Evaluating LLM-Based Judges — Sijun Tan and colleagues. Numeric results transcribed and reformatted; evaluation notes and model links added by BenchLM. Published numeric precision is retained.

[Published source](https://arxiv.org/abs/2410.12784v2) · [Full JudgeBench results](/benchmarks/judgebench)

| Judge | Knowledge (%) | Reasoning (%) | Math (%) | Coding (%) | Overall (%) |
| --- | --- | --- | --- | --- | --- |
| Skywork-LLaMA-3.1B-8B | 51.30 | 54.08 | 73.21 | 33.33 | 53.43 |

### Paper: judgment outcomes

JudgeBench’s paper and maintained leaderboard report judges under different prompts, reasoning efforts, and response-model splits. Accuracy is a percentage. The paper’s 700-pair GPT-4o split is distinct from the 270-pair Claude split. The app appends the same Nemotron CSV to both tabs without specifying a response split; we show that supplement once with its split unresolved. Live one-decimal values and paper two-decimal values are preserved separately.

Paper v2; source group labels and published precision are retained.

JudgeBench: A Benchmark for Evaluating LLM-Based Judges — Sijun Tan and colleagues. Numeric results transcribed and reformatted; evaluation notes and model links added by BenchLM. Published numeric precision is retained.

[Published source](https://arxiv.org/abs/2410.12784v2) · [Full JudgeBench results](/benchmarks/judgebench)

| Judge | A>B count | A<B count | Tie count | Invalid count |
| --- | --- | --- | --- | --- |
| Skywork-LLaMA-3.1B-8B | 346 | 354 | 0 | 0 |

### Paper: order inconsistency

JudgeBench’s paper and maintained leaderboard report judges under different prompts, reasoning efforts, and response-model splits. Accuracy is a percentage. The paper’s 700-pair GPT-4o split is distinct from the 270-pair Claude split. The app appends the same Nemotron CSV to both tabs without specifying a response split; we show that supplement once with its split unresolved. Live one-decimal values and paper two-decimal values are preserved separately.

Paper v2; source group labels and published precision are retained.

JudgeBench: A Benchmark for Evaluating LLM-Based Judges — Sijun Tan and colleagues. Numeric results transcribed and reformatted; evaluation notes and model links added by BenchLM. Published numeric precision is retained.

[Published source](https://arxiv.org/abs/2410.12784v2) · [Full JudgeBench results](/benchmarks/judgebench)

| Judge | Inconsistent (%) |
| --- | --- |
| Skywork-Llama-3.1B-8B | 18.86% |

## Other Skywork Models

- [Skywork-Critic-Llama-3.1-70B (JudgeBench)](/models/native-judgebench-skywork-critic-llama-3-1-70b) - Score: not computed
- [Skywork-Reward-Gemma-2-27B (JudgeBench)](/models/native-judgebench-skywork-reward-gemma-2-27b) - Score: not computed
- [Skywork-Reward-Llama-3.1-8B (JudgeBench)](/models/native-judgebench-skywork-reward-llama-3-1-8b) - Score: not computed
