Skip to main content
BenchLM
Data

WritingBench

We show this table for reference; we do not rank on it.

WritingBench evaluates generative writing across six domains. This dated benchmark-owner table contains 54 source model rows, with overall and domain scores on the native 0-100 scale.

Evaluation results published by WritingBench / X-PLUG project. Published overall and six domain aggregates on a 0-100 point scale. The 1,000-query count applies to each overall row; domain counts are not reported.

WritingBench: A Comprehensive Benchmark for Generative Writing, WritingBench / X-PLUG project; official aggregate workbook. Apache 2.0 license. Source and transformation notice. Published aggregate workbook only. No task texts, evaluation prompts, model responses, or model weights are included.

Writing score on WritingBench — November 27, 2025 source update

We mirror the published writing score view for WritingBench. gpt-5-2025-08-07 leads the public snapshot at 83.87, followed by qwen3-235b-a22b-thinking-2507 (82.34) and kimi-k2-instruct (81.26). We do not use these results to rank models overall.

54 source model rowsInstruction FollowingDated writing cohortDisplay onlyUpdated November 27, 2025 source update

WritingBench, November 2025 cohort (54 source model rows)
Source modelOverallAcademic & EngineeringFinance & BusinessPolitics & LawLiterature & ArtsEducationAdvertising & MarketingParameters (B)Open / closed
gpt-5-2025-08-07OpenAI83.8784.4683.7882.2185.2685.6482.34Not reportedUnknown
qwen3-235b-a22b-thinking-2507Alibaba82.3483.4383.4479.6782.6884.5280.94Not reportedOpen
kimi-k2-instructMoonshot81.2682.2381.9080.3281.7380.9780.02Not reportedUnknown
claude-sonnet-4-5-20250929Anthropic80.7180.7780.5479.5981.2682.3280.45Not reportedUnknown
o3-2025-04-16OpenAI80.4680.8381.1578.3180.4781.5981.23Not reportedUnknown
qwen3-235b-a22b-instruct-2507Alibaba80.2680.8081.1479.1480.4780.9778.97Not reportedOpen
qwen3-maxAlibaba80.2680.4680.1078.7081.5081.7579.70Not reportedUnknown
claude-opus-4-5-20251101Anthropic79.7879.3180.0078.0581.4181.3079.11Not reportedUnknown
doubao-seed-1-6-thinking-250715ByteDance79.2980.7979.7478.0578.3781.4877.95Not reportedUnknown
gemini-2.5-proGoogle79.2679.5978.2478.6980.9281.3077.27Not reportedUnknown
nanbeige4-3b-thinking-2511Boss79.0380.7782.3777.4176.0580.8176.55Not reportedUnknown
deepseek-r1-0528Deepseek78.9278.7978.3877.2780.9180.4178.44Not reportedUnknown
doubao-seed-1-6-thinking-250615ByteDance78.7680.0779.9976.9877.0681.7377.72Not reportedUnknown
gemini-3-pro-previewGoogle78.5077.1377.2677.5581.1180.5878.27Not reportedUnknown
doubao-seed-1-6-250615ByteDance78.3380.1878.8072.9079.9181.0679.02Not reportedUnknown
claude-haiku-4-5-20251001Anthropic77.0977.5478.6175.3376.3579.6275.59Not reportedUnknown
claude-opus-4-1-20250805Anthropic76.3676.8975.5674.1978.0577.3377.16Not reportedUnknown
claude-opus-4-20250514-thinkingAnthropic75.1275.6074.5773.0977.2075.7874.98Not reportedUnknown
qwen3-235b-a22b-thinkingAlibaba74.7375.4574.8473.3074.6776.4174.50Not reportedUnknown
grok-4-0709xAI74.6575.4473.9973.0874.6677.4874.73Not reportedUnknown
claude-opus-4-20250514Anthropic74.4573.9073.9673.0576.3175.2374.81Not reportedUnknown
claude-sonnet-4-20250514Anthropic74.1075.3574.1371.5574.6674.9974.84Not reportedUnknown
claude-sonnet-4-20250514-thinkingAnthropic74.0775.0874.5270.7175.2676.0473.88Not reportedUnknown
claude-3-7-sonnet-20250219-thinkingAnthropic73.4073.1173.1272.4373.9374.4374.11Not reportedUnknown
chatgpt-4o-latestOpenAI73.2272.7973.0872.1673.5873.7174.77Not reportedUnknown
o4-mini-2025-04-16OpenAI72.9076.0473.1971.2669.8775.9172.66Not reportedUnknown
claude-3-7-sonnet-20250219Anthropic72.4572.4672.7870.8071.6974.7473.56Not reportedUnknown
qwen3-235b-a22b-nothinkingAlibaba72.4472.4072.7871.3672.6774.2571.70Not reportedUnknown
qwq-32bAlibaba72.4072.9272.0471.7170.4575.3373.66Not reportedUnknown
deepseek-r1DeepSeek72.1371.9570.3571.5271.9374.5474.45Not reportedUnknown
grok-3xAI71.7271.4071.7372.1971.1474.6869.63Not reportedUnknown
gpt-4.1-2025-04-14OpenAI70.9071.5270.2670.2170.4572.2071.77Not reportedClosed
deepseek-v3-250324DeepSeek69.3668.9768.1368.2769.7871.2171.41Not reportedUnknown
o3-miniOpenAI68.0269.5268.6166.9266.5471.4865.95Not reportedUnknown
gpt-4.5-previewOpenAI67.6168.2266.1766.8366.4070.5669.59Not reportedUnknown
gemini-2.0-flashGoogle66.8067.5165.7865.8466.2469.5367.50Not reportedUnknown
qwen-maxAlibaba66.7866.3765.5265.2267.3669.7768.44Not reportedUnknown
o1-preview-2024-09-12OpenAI63.4463.5662.3062.3763.1865.5365.39Not reportedUnknown
deepseek-v3DeepSeek59.2359.6457.8658.3257.8562.3461.67Not reportedUnknown
gemini-1.5-proGoogle58.8058.8355.6957.2260.3361.7861.61Not reportedUnknown
qwen-2.5-72b-instructAlibaba57.7859.3756.9357.2755.3362.2557.53Not reportedUnknown
gpt-4o-miniOpenAI56.4057.1454.6954.3456.4959.0559.03Not reportedUnknown
mistral-large-instruct-2411Mistral AI54.4455.5454.3553.7351.6757.3055.77Not reportedUnknown
claude-3-5-sonnet-20241022Anthropic53.7652.7752.4451.6953.1055.7859.69Not reportedUnknown
llama-4-maverick-17b-128eMeta52.5551.8351.5851.3551.2555.4256.36Not reportedUnknown
llama-4-scout-17b-16e-instructMeta52.0252.5752.0551.4749.1954.7653.78Not reportedUnknown
qwen-2.5-7b-instructAlibaba49.4651.8650.4349.2143.7953.5949.64Not reportedUnknown
claude-3-5-haiku-20241022Anthropic49.0649.7048.7247.3346.2550.2054.52Not reportedUnknown
llama-3.3-70b-instructMeta48.0447.5848.5245.7346.0450.8651.84Not reportedUnknown
qwen3-0.6b-thinkingAlibaba45.0850.1347.2845.6537.9847.4642.06Not reportedUnknown
qwen3-0.6b-nothinkingAlibaba41.4746.3743.5241.8534.6142.8139.72Not reportedUnknown
llama-3.1-8b-instructMeta40.1841.5841.4937.0236.5242.9244.02Not reportedUnknown
llama-3.2-3b-instructMeta38.1440.2639.8934.7834.2741.0140.84Not reportedUnknown
llama-3.2-1b-instructMeta28.7432.5630.0325.4425.1830.1130.73Not reportedUnknown

All seven columns use native 0-100 score points, displayed to two decimals. The 1,000-query total is not each domain's denominator. The source does not report generation settings or individual run dates. This table does not move overall or category rankings.

How we show WritingBench

We extracted all 54 model rows from the official aggregate workbook at the pinned November 27, 2025 source update. This historical table names Claude Sonnet 4.5 as the judge. Its update date is separate from individual evaluation dates, which are not reported.

Overall and domain values retain their native 0-100 scale. They are judge scores, not accuracy percentages. The source already multiplied its original 10-point assessments by ten; we do not repeat that scaling or recompute the published overall score from domain averages.

Three profile references match reviewed model versions and modes. The other 51 source rows keep their own identities. Generation settings, thinking budgets, endpoints, and weight revisions remain unknown, including for the three linked models. These results are excluded from overall and category rankings.

Snapshot

1,000 queriesSix domains0-100 pointsNovember 2025 cohortDisplay only

The published WritingBench snapshot places gpt-5-2025-08-07 first at 83.87. The third row is 2.61 score units behind. The broader top-10 range is 4.61 score units, so many of the published results sit in a relatively narrow band.

54 source model rows are shown for WritingBench. The benchmark falls in the Instruction Following category. We keep external benchmark mirrors separate from the weighted global scoring system, so these results remain source-specific evidence. WritingBench is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.

About WritingBench

Year

2025

Tasks

1,000 queries

Format

Judge score, 0-100 points

The source update is dated November 27, 2025 and names Claude Sonnet 4.5 as the judge. Individual run dates, generation parameters, thinking budgets, and domain counts are not reported in the workbook. This historical cohort stays display only and does not enter overall or category rankings.

Freshness and provenance

Version

November 27, 2025 aggregate workbook

Refresh cadence

Pinned source artifact

Staleness state

Dated writing cohort

Question availability

Public upstream; no task contents mirrored

Dated writing cohortDisplay only

BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.

Questions

What does WritingBench measure?

WritingBench evaluates generative writing across six domains. This dated benchmark-owner table contains 54 source model rows, with overall and domain scores on the native 0-100 scale.

Which model leads the published WritingBench snapshot?

gpt-5-2025-08-07 currently leads the published WritingBench snapshot with 83.87 writing score. BenchLM shows this benchmark for display only and does not use it in overall rankings.

How many models are evaluated on WritingBench?

The November 27, 2025 source update snapshot contains 54 source model rows.

Are WritingBench scores accuracy percentages?

The workbook reports judge scores on a 0-100 scale. We keep its native values and show overall and domain scores separately. The source already scaled its original 10-point assessments before publishing this table. Applying that scaling again would inflate the values tenfold.

Do the profile links identify exact evaluation settings?

Three profile references match the reviewed model version and mode. The remaining source rows stay separate. Even those three links do not establish an endpoint, weight revision, quantization, temperature, output cap, or thinking budget. The source update date also does not establish an individual run date.

Last updated: November 27, 2025 source update · mirrored from the public benchmark leaderboard

Know when it’s worth switching models

The model to choose, the cheaper alternative, and the release we would wait on.

Read a sample issue

Join 5,600+ readers.

One email each week. Unsubscribe anytime.