# Physical-Engineering's Last Exam (PLE)

> Long, end-to-end engineering projects: an agent works through a full project folder, finds the governing codes and physical limits, and produces deliverables a licensed engineer would sign off on.

Canonical page: https://benchlm.ai/benchmarks/ple-bench

- Category: [Agentic](/agentic)
- Last updated: November 12, 2026 capture

Evaluation results published by [Google](https://ple-bench.com/leaderboard). undefined

We captured Google's Physical-Engineering's Last Exam leaderboard on November 12, 2026. It lists 18 models, most run in seven agent harnesses and some in their own, for 122 model and harness pairs. Each row keeps its harness, the spread across three runs, the cost and time per task, and the score in each of the four engineering disciplines. We did not rerun them.

Scores cover the 56 hidden test tasks (6 structural, 9 civil, 18 electrical, 23 mechanical). Google publishes them from 0 to 1; we show them as percentages. Automated checks grade quantitative outputs, and an LLM judge (Claude Opus 5.5) grades open-ended work against an expert rubric. A design must pass every safety and feasibility check before it earns points for cost.

PLE is display only. Each row is a model inside a specific agent harness, so the table compares complete agent setups, not base models, and it does not enter weighted rankings. A model's native harness is marked. Mercor's copy of this board lists only the native-harness rows.

- [PLE leaderboard (Google)](https://ple-bench.com/leaderboard)
- [PLE paper on arXiv](https://arxiv.org/abs/2610.30537)
- [PLE public tasks and grading code](https://github.com/google-research/ple)

## About PLE

- Year: 2026
- Tasks: 56 hidden test tasks (85 in all)
- Format: Rubric and check score, 0 to 100
- Difficulty: Long-horizon professional engineering
- Paper: [PLE: Physical-Engineering's Last Exam](https://arxiv.org/abs/2610.30537)

PLE has 85 tasks across structural, civil, electrical and mechanical engineering, built by practicing engineers. Google's leaderboard scores 56 hidden test tasks, three runs per model and harness pair, in an isolated container with no internet and a 6-hour limit. Automated scripts check quantitative outputs and an LLM judge grades open-ended work against an expert rubric. BenchLM mirrors every model and harness pair and keeps it display only, because each row is a complete agent setup.

PLE is currently displayed on BenchLM for reference, but it is excluded from the weighted scoring formula.

## Leaderboard (122 model and harness pairs)

| Rank | Model | Configuration | Creator | Score |
|------|-------|---------------|---------|-------|
| 1 | [Claude Opus 5.5](/models/claude-opus-5-5) | openhands · openhands harness · ±2.3 across runs · $14.87 per task · 66 min per task · Structural 57.6, Civil 64, Electrical 47.9, Mechanical 40.8 | Anthropic | 48.6% |
| 2 | [Claude Opus 5.5](/models/claude-opus-5-5) | claude-code · claude-code harness (native) · ±1.4 across runs · $17.12 per task · 63 min per task · Structural 56.3, Civil 70.3, Electrical 43.3, Mechanical 41.6 | Anthropic | 48.3% |
| 3 | [Claude Opus 5.5](/models/claude-opus-5-5) | agy · agy harness · ±0.8 across runs · about $42.32 per task · 45 min per task · Structural 49.6, Civil 62.1, Electrical 46.8, Mechanical 42.4 | Anthropic | 47.7% |
| 4 | [Claude Opus 5.5](/models/claude-opus-5-5) | pi · pi harness · ±1.4 across runs · $13.35 per task · 68 min per task · Structural 54.6, Civil 62.4, Electrical 45.3, Mechanical 40.9 | Anthropic | 47.2% |
| 5 | [Claude Opus 5.5](/models/claude-opus-5-5) | hermes · hermes harness · ±0.5 across runs · $16.03 per task · 66 min per task · Structural 47.2, Civil 62, Electrical 49, Mechanical 38.5 | Anthropic | 46.6% |
| 6 | [Claude Opus 5.5](/models/claude-opus-5-5) | opencode · opencode harness · ±2 across runs · $12.87 per task · 49 min per task · Structural 53.9, Civil 62.3, Electrical 43.8, Mechanical 40.5 | Anthropic | 46.5% |
| 7 | [Claude Opus 5.5](/models/claude-opus-5-5) | codex · codex harness · ±1.9 across runs · $37.62 per task · 130 min per task · Structural 51.6, Civil 63.5, Electrical 48.5, Mechanical 36.7 | Anthropic | 46.4% |
| 8 | [GPT-6 Astra](/models/gpt-6-astra) | codex · codex harness (native) · ±0.6 across runs · $9.53 per task · 26 min per task · Structural 48.4, Civil 57.6, Electrical 40.4, Mechanical 44.8 | OpenAI | 45.8% |
| 9 | [Claude Sonnet 5.5](/models/claude-sonnet-5-5) | hermes · hermes harness · ±3.8 across runs · $14.71 per task · 87 min per task · Structural 51.8, Civil 55.7, Electrical 40.8, Mechanical 42.5 | Anthropic | 45.1% |
| 10 | [Claude Sonnet 5.5](/models/claude-sonnet-5-5) | agy · agy harness · ±0.4 across runs · about $33.89 per task · 53 min per task · Structural 50.1, Civil 56.2, Electrical 39.5, Mechanical 43.2 | Anthropic | 44.9% |
| 11 | [Claude Sonnet 5.5](/models/claude-sonnet-5-5) | pi · pi harness · ±2.2 across runs · $11.77 per task · 96 min per task · Structural 48.9, Civil 57.9, Electrical 39.9, Mechanical 40.9 | Anthropic | 44.2% |
| 12 | [Claude Sonnet 5.5](/models/claude-sonnet-5-5) | claude-code · claude-code harness (native) · ±1.4 across runs · $18.68 per task · 99 min per task · Structural 47.4, Civil 52, Electrical 40.6, Mechanical 41.5 | Anthropic | 43.5% |
| 13 | [Claude Sonnet 5.5](/models/claude-sonnet-5-5) | codex · codex harness · ±2.9 across runs · $42.56 per task · 243 min per task · Structural 46.7, Civil 51.4, Electrical 42.1, Mechanical 39.7 | Anthropic | 43.1% |
| 14 | [Claude Opus 5](/models/claude-opus-5) | openhands · openhands harness · ±0.9 across runs · $17.13 per task · 66 min per task · Structural 52, Civil 52.5, Electrical 37.8, Mechanical 40 | Anthropic | 42.6% |
| 15 | [Claude Sonnet 5.5](/models/claude-sonnet-5-5) | opencode · opencode harness · ±0.7 across runs · $10.53 per task · 63 min per task · Structural 52.2, Civil 52.1, Electrical 39, Mechanical 38.9 | Anthropic | 42.5% |
| 16 | [Claude Opus 5](/models/claude-opus-5) | pi · pi harness · ±1 across runs · $15.26 per task · 58 min per task · Structural 51.3, Civil 43.1, Electrical 40.6, Mechanical 39.8 | Anthropic | 41.8% |
| 17 | [Claude Opus 5](/models/claude-opus-5) | agy · agy harness · ±2.1 across runs · about $29.59 per task · 42 min per task · Structural 52.1, Civil 45.5, Electrical 37.4, Mechanical 40.5 | Anthropic | 41.5% |
| 18 | [Gemini 4 Argon](/models/gemini-4-argon) | claude-code · claude-code harness · ±1.4 across runs · $8.51 per task · 67 min per task · Structural 44.9, Civil 51.5, Electrical 41, Mechanical 36.1 | Google | 41.1% |
| 19 | [Claude Sonnet 5.5](/models/claude-sonnet-5-5) | openhands · openhands harness · ±1.4 across runs · $15.72 per task · 112 min per task · Structural 51.7, Civil 47, Electrical 36, Mechanical 39.1 | Anthropic | 40.7% |
| 20 | [Gemini 4 Argon](/models/gemini-4-argon) | agy · agy harness (native) · ±1.3 across runs · $7.7 per task · 73 min per task · Structural 45.8, Civil 53.8, Electrical 39.7, Mechanical 34.8 | Google | 40.6% |
| 21 | [Claude Opus 5](/models/claude-opus-5) | hermes · hermes harness · ±1.7 across runs · $13.89 per task · 52 min per task · Structural 49.7, Civil 44.3, Electrical 37.9, Mechanical 38.4 | Anthropic | 40.4% |
| 22 | [Claude Opus 5](/models/claude-opus-5) | opencode · opencode harness · ±1.7 across runs · $12.51 per task · 38 min per task · Structural 48.7, Civil 45.6, Electrical 35.8, Mechanical 39.6 | Anthropic | 40.4% |
| 23 | [Claude Opus 5](/models/claude-opus-5) | claude-code · claude-code harness (native) · ±1.6 across runs · $16.52 per task · 48 min per task · Structural 47.3, Civil 46.1, Electrical 36.7, Mechanical 38.3 | Anthropic | 40.0% |
| 24 | [Claude Opus 5](/models/claude-opus-5) | codex · codex harness · ±0.6 across runs · $20.77 per task · 69 min per task · Structural 52.3, Civil 39.4, Electrical 36.5, Mechanical 37 | Anthropic | 38.9% |
| 25 | [Gemini 4 Argon](/models/gemini-4-argon) | codex · codex harness · ±1.7 across runs · $7.13 per task · 83 min per task · Structural 39.9, Civil 54.5, Electrical 34.6, Mechanical 35.9 | Google | 38.9% |
| 26 | [Gemini 4 Argon](/models/gemini-4-argon) | hermes · hermes harness · ±1.2 across runs · $7.92 per task · 61 min per task · Structural 38.2, Civil 48.1, Electrical 40.7, Mechanical 33.9 | Google | 38.9% |
| 27 | [Gemini 4 Argon](/models/gemini-4-argon) | opencode · opencode harness · ±0.6 across runs · $7.04 per task · 55 min per task · Structural 43.8, Civil 47, Electrical 34.1, Mechanical 34.3 | Google | 37.3% |
| 28 | [Gemini 4 Argon](/models/gemini-4-argon) | pi · pi harness · ±1.5 across runs · $7 per task · 78 min per task · Structural 42, Civil 50.3, Electrical 32.3, Mechanical 33.1 | Google | 36.6% |
| 29 | [Claude Fable 5](/models/claude-fable) | claude-code · claude-code harness (native) · ±2 across runs · $26.46 per task · 45 min per task · Structural 40.6, Civil 39.1, Electrical 31.7, Mechanical 33.2 | Anthropic | 34.5% |
| 30 | [Claude Fable 5](/models/claude-fable) | codex · codex harness · ±1.5 across runs · $28.77 per task · 60 min per task · Structural 48, Civil 35.1, Electrical 31.2, Mechanical 33.3 | Anthropic | 34.5% |
| 31 | [Claude Fable 5](/models/claude-fable) | pi · pi harness · ±1.6 across runs · $21.17 per task · 47 min per task · Structural 46.9, Civil 31.5, Electrical 35, Mechanical 31.4 | Anthropic | 34.2% |
| 32 | [Claude Fable 5](/models/claude-fable) | opencode · opencode harness · ±1.5 across runs · $22.95 per task · 38 min per task · Structural 39.6, Civil 32.6, Electrical 33.2, Mechanical 33.9 | Anthropic | 34.1% |
| 33 | [Claude Fable 5](/models/claude-fable) | hermes · hermes harness · ±0.9 across runs · $24.3 per task · 55 min per task · Structural 44.6, Civil 31.2, Electrical 32, Mechanical 32.3 | Anthropic | 33.3% |
| 34 | [Claude Fable 5](/models/claude-fable) | openhands · openhands harness · ±0.4 across runs · $25.83 per task · 44 min per task · Structural 48.7, Civil 32.6, Electrical 31.4, Mechanical 30.9 | Anthropic | 33.2% |
| 35 | [Claude Fable 5](/models/claude-fable) | agy · agy harness · ±1 across runs · about $54.19 per task · 37 min per task · Structural 37.6, Civil 31.9, Electrical 32.3, Mechanical 31.5 | Anthropic | 32.5% |
| 36 | [Grok 4.7](/models/grok-4-7) | pi · pi harness · ±0.5 across runs · $8.01 per task · 40 min per task · Structural 32.5, Civil 34.6, Electrical 30.9, Mechanical 27.3 | xAI | 30.2% |
| 37 | [Grok 4.7](/models/grok-4-7) | grok-build · grok-build harness (native) · ±0.7 across runs · $10.18 per task · 52 min per task · Structural 28.3, Civil 37.1, Electrical 31.2, Mechanical 27 | xAI | 30.1% |
| 38 | [Gemini 4 Argon](/models/gemini-4-argon) | openhands · openhands harness · ±3.3 across runs · $7.54 per task · 83 min per task · Structural 32.2, Civil 29.1, Electrical 31.8, Mechanical 26.1 | Google | 29.0% |
| 39 | [Grok 4.7](/models/grok-4-7) | opencode · opencode harness · ±1.7 across runs · $10.25 per task · 34 min per task · Structural 28.9, Civil 35.9, Electrical 26.9, Mechanical 26.5 | xAI | 28.4% |
| 40 | [Gemini 3.8 Flash](/models/gemini-3-8-flash) | openhands · openhands harness · ±1 across runs · $3.21 per task · 33 min per task · Structural 33.9, Civil 30.9, Electrical 26.2, Mechanical 27.1 | Google | 28.2% |
| 41 | [Gemini 3.8 Flash](/models/gemini-3-8-flash) | codex · codex harness · ±0.1 across runs · $3.61 per task · 45 min per task · Structural 28.4, Civil 30.1, Electrical 25.9, Mechanical 28.2 | Google | 27.8% |
| 42 | [Grok 4.7](/models/grok-4-7) | agy · agy harness · ±0.7 across runs · about $16.81 per task (source footnote) · 33 min per task · Structural 26.4, Civil 32.1, Electrical 29.6, Mechanical 25.1 | xAI | 27.8% |
| 43 | [Gemini 3.8 Flash](/models/gemini-3-8-flash) | agy · agy harness (native) · ±0.7 across runs · $2.6 per task · 40 min per task · Structural 27.1, Civil 31.8, Electrical 26.2, Mechanical 26.9 | Google | 27.5% |
| 44 | [Grok 4.7](/models/grok-4-7) | openhands · openhands harness · ±1.9 across runs · $8.89 per task · 34 min per task · Structural 27.3, Civil 28.6, Electrical 32.8, Mechanical 23 | xAI | 27.5% |
| 45 | [Gemini 3.8 Flash](/models/gemini-3-8-flash) | claude-code · claude-code harness · ±0.3 across runs · $2.61 per task · 34 min per task · Structural 32.2, Civil 28.6, Electrical 23.2, Mechanical 28.5 | Google | 27.2% |
| 46 | [Gemini 3.8 Flash](/models/gemini-3-8-flash) | pi · pi harness · ±2.2 across runs · $2.68 per task · 42 min per task · Structural 25.6, Civil 28.9, Electrical 27.1, Mechanical 26.1 | Google | 26.8% |
| 47 | [Grok 4.7](/models/grok-4-7) | claude-code · claude-code harness · ±1.2 across runs · $12.75 per task · 48 min per task · Structural 26.5, Civil 26, Electrical 27.1, Mechanical 26.3 | xAI | 26.6% |
| 48 | [Gemini 3.8 Flash](/models/gemini-3-8-flash) | opencode · opencode harness · ±0.5 across runs · $2.45 per task · 25 min per task · Structural 25.3, Civil 25.5, Electrical 25, Mechanical 26.9 | Google | 25.9% |
| 49 | [Grok 4.7](/models/grok-4-7) | codex · codex harness · ±2 across runs · $7.02 per task · 39 min per task · Structural 26.4, Civil 31.4, Electrical 28.1, Mechanical 21.9 | xAI | 25.9% |
| 50 | [Grok 4.7](/models/grok-4-7) | hermes · hermes harness · ±2.1 across runs · $10.09 per task · 47 min per task · Structural 24.5, Civil 29.7, Electrical 25.6, Mechanical 24.3 | xAI | 25.6% |
| 51 | [GLM-5.2](/models/glm-5-2) | codex · codex harness · ±1.5 across runs · $12.57 per task · 121 min per task · Structural 26.8, Civil 23.8, Electrical 24.3, Mechanical 25.6 | Z.AI | 25.0% |
| 52 | [GLM-5.2](/models/glm-5-2) | pi · pi harness · ±0.4 across runs · $13.66 per task · 109 min per task · Structural 26.3, Civil 26.3, Electrical 22.3, Mechanical 26.3 | Z.AI | 25.0% |
| 53 | [GLM-5.2](/models/glm-5-2) | hermes · hermes harness · ±1.2 across runs · $10.83 per task · 70 min per task · Structural 24.9, Civil 23.4, Electrical 22.6, Mechanical 25.1 | Z.AI | 24.0% |
| 54 | [GLM-5.2](/models/glm-5-2) | opencode · opencode harness · ±1.1 across runs · Cost not reported · 94 min per task · Structural 27.6, Civil 20.9, Electrical 22.9, Mechanical 25.2 | Z.AI | 24.0% |
| 55 | [GLM-5.2](/models/glm-5-2) | agy · agy harness · ±0.8 across runs · about $12.71 per task · 86 min per task · Structural 22.3, Civil 23.4, Electrical 23.3, Mechanical 24.7 | Z.AI | 23.8% |
| 56 | [GLM-5.2](/models/glm-5-2) | openhands · openhands harness · ±0.5 across runs · $15.5 per task · 104 min per task · Structural 21.1, Civil 23.3, Electrical 22.7, Mechanical 24.4 | Z.AI | 23.4% |
| 57 | [DeepSeek-V4.1-Flash](https://ple-bench.com/leaderboard) | opencode · opencode harness · ±2.3 across runs · $3.46 per task · 172 min per task · Structural 32.1, Civil 21.7, Electrical 20.1, Mechanical 22.5 | DeepSeek | 22.5% |
| 58 | [DeepSeek-V4.1-Flash](https://ple-bench.com/leaderboard) | pi · pi harness · ±3.4 across runs · $4.54 per task · 169 min per task · Structural 21.4, Civil 26.8, Electrical 21.1, Mechanical 22.3 | DeepSeek | 22.5% |
| 59 | [GLM-5.2](/models/glm-5-2) | claude-code · claude-code harness · ±0.5 across runs · $14.78 per task · 94 min per task · Structural 23.1, Civil 20.6, Electrical 22.2, Mechanical 21.7 | Z.AI | 21.8% |
| 60 | [Gemini 3.8 Flash](/models/gemini-3-8-flash) | hermes · hermes harness · ±2 across runs · $2.39 per task · 24 min per task · Structural 11.7, Civil 18.4, Electrical 18.6, Mechanical 17.7 | Google | 17.4% |
| 61 | [Gemini 3.1 Pro](/models/gemini-3-1-pro) | hermes · hermes harness · ±1.6 across runs · $2.09 per task · 12 min per task · Structural 11.7, Civil 14.8, Electrical 16.2, Mechanical 14.6 | Google | 14.8% |
| 62 | [Gemini 3.1 Pro](/models/gemini-3-1-pro) | openhands · openhands harness · ±1.6 across runs · $4.67 per task · 16 min per task · Structural 9.8, Civil 14.4, Electrical 16, Mechanical 15.2 | Google | 14.7% |
| 63 | [Gemini 3.1 Pro](/models/gemini-3-1-pro) | codex · codex harness · ±0.2 across runs · $2.8 per task · 16 min per task · Structural 11.4, Civil 15.2, Electrical 16, Mechanical 13.9 | Google | 14.5% |
| 64 | [DeepSeek-V4.1-Flash](https://ple-bench.com/leaderboard) | dsh · dsh harness (native) · ±2.3 across runs · $6.3 per task · 240 min per task · Structural 1.7, Civil 9, Electrical 14.1, Mechanical 20.1 | DeepSeek | 14.4% |
| 65 | [Gemini 3.1 Pro](/models/gemini-3-1-pro) | claude-code · claude-code harness · ±0.6 across runs · $3.65 per task · 17 min per task · Structural 12.9, Civil 13.3, Electrical 15.9, Mechanical 14 | Google | 14.4% |
| 66 | [Gemini 3.1 Pro](/models/gemini-3-1-pro) | opencode · opencode harness · ±0.5 across runs · $2.67 per task · 15 min per task · Structural 11.4, Civil 13.5, Electrical 15.3, Mechanical 14.1 | Google | 14.1% |
| 67 | [Gemini 3.1 Pro](/models/gemini-3-1-pro) | pi · pi harness · ±0.8 across runs · $2.76 per task · 24 min per task · Structural 11.9, Civil 12.1, Electrical 15.1, Mechanical 14.6 | Google | 14.1% |
| 68 | [Gemini 3.1 Pro](/models/gemini-3-1-pro) | agy · agy harness (native) · ±1.4 across runs · $2.47 per task · 15 min per task · Structural 7.8, Civil 13.2, Electrical 15.8, Mechanical 14.1 | Google | 13.8% |
| 69 | [DeepSeek-V4.1-Flash](https://ple-bench.com/leaderboard) | claude-code · claude-code harness · ±1.2 across runs · $3.74 per task · 241 min per task · Structural 3.3, Civil 11.6, Electrical 14.5, Mechanical 11.5 | DeepSeek | 11.7% |
| 70 | [DeepSeek-V4.1-Flash](https://ple-bench.com/leaderboard) | agy · agy harness · ±1.3 across runs · about $3.5 per task · 229 min per task · Structural 1.7, Civil 6.2, Electrical 10, Mechanical 11.7 | DeepSeek | 9.2% |
| 71 | [DeepSeek-V4.1-Flash](https://ple-bench.com/leaderboard) | openhands · openhands harness · ±1.5 across runs · $1.65 per task · 194 min per task · Structural 0, Civil 5.8, Electrical 4.2, Mechanical 9.7 | DeepSeek | 6.3% |
| 72 | [Kimi K2 Thinking](https://ple-bench.com/leaderboard) | opencode · opencode harness · ±0.2 across runs · $0.28 per task · 8 min per task · Structural 4.5, Civil 3.2, Electrical 9.1, Mechanical 5.4 | Moonshot AI | 6.2% |
| 73 | [Qwen3 Coder 480B](https://ple-bench.com/leaderboard) | claude-code · claude-code harness · ±0.1 across runs · $0.13 per task · 10 min per task · Structural 2.2, Civil 3.6, Electrical 9, Mechanical 6.2 | Alibaba | 6.2% |
| 74 | [Qwen3 Coder 480B](https://ple-bench.com/leaderboard) | hermes · hermes harness · ±0.4 across runs · $0.12 per task · 8 min per task · Structural 2.7, Civil 2.2, Electrical 8.5, Mechanical 6.9 | Alibaba | 6.2% |
| 75 | [Qwen3 Coder 480B](https://ple-bench.com/leaderboard) | openhands · openhands harness · ±0.7 across runs · $0.21 per task · 28 min per task · Structural 3.1, Civil 2.1, Electrical 8.5, Mechanical 6.4 | Alibaba | 6.0% |
| 76 | [MiniMax M2](https://ple-bench.com/leaderboard) | claude-code · claude-code harness · ±0.6 across runs · $0.1 per task · 12 min per task · Structural 2.7, Civil 2.9, Electrical 8.8, Mechanical 5.1 | MiniMax | 5.7% |
| 77 | [MiniMax M2](https://ple-bench.com/leaderboard) | hermes · hermes harness · ±0.5 across runs · $0.097 per task · 10 min per task · Structural 2.3, Civil 4, Electrical 6.8, Mechanical 6.3 | MiniMax | 5.7% |
| 78 | [DeepSeek-V4.1-Flash](https://ple-bench.com/leaderboard) | hermes · hermes harness · ±2.6 across runs · $2.98 per task · 255 min per task · Structural 0, Civil 3.2, Electrical 5.1, Mechanical 7.7 | DeepSeek | 5.3% |
| 79 | [MiniMax M2](https://ple-bench.com/leaderboard) | openhands · openhands harness · ±0.3 across runs · $0.13 per task · 14 min per task · Structural 0.2, Civil 2.3, Electrical 9.6, Mechanical 4.4 | MiniMax | 5.3% |
| 80 | [Kimi K2 Thinking](https://ple-bench.com/leaderboard) | hermes · hermes harness · ±0.6 across runs · $0.28 per task · 8 min per task · Structural 1, Civil 3.4, Electrical 7.5, Mechanical 4.6 | Moonshot AI | 5.0% |
| 81 | [Qwen3 Coder 480B](https://ple-bench.com/leaderboard) | codex · codex harness · ±0.6 across runs · $0.11 per task · 6 min per task · Structural 2, Civil 3.1, Electrical 6.7, Mechanical 4.4 | Alibaba | 4.7% |
| 82 | [GPT-OSS 120B](/models/gpt-oss-120b) | openhands · openhands harness · ±0.9 across runs · $0.14 per task · 52 min per task · Structural 1.7, Civil 2, Electrical 5.4, Mechanical 5.7 | OpenAI | 4.6% |
| 83 | [Kimi K2 Thinking](https://ple-bench.com/leaderboard) | claude-code · claude-code harness · ±1.4 across runs · $0.25 per task · 7 min per task · Structural 0.2, Civil 2.8, Electrical 7.6, Mechanical 4 | Moonshot AI | 4.6% |
| 84 | [MiniMax M2](https://ple-bench.com/leaderboard) | codex · codex harness · ±0.2 across runs · $0.093 per task · 14 min per task · Structural 2.8, Civil 2.2, Electrical 6.9, Mechanical 4.3 | MiniMax | 4.6% |
| 85 | [MiniMax M2](https://ple-bench.com/leaderboard) | pi · pi harness · ±0.2 across runs · $0.094 per task · 12 min per task · Structural 1.2, Civil 3, Electrical 7.8, Mechanical 3.5 | MiniMax | 4.6% |
| 86 | [Gemma 4 26B A4B](/models/gemma-4-26b-a4b) | openhands · openhands harness · ±0.5 across runs · $0.61 per task · 109 min per task · Structural 0, Civil 2.6, Electrical 4.6, Mechanical 6.3 | Google | 4.5% |
| 87 | [Qwen3 Coder 480B](https://ple-bench.com/leaderboard) | opencode · opencode harness · ±0.2 across runs · $0.25 per task · 8 min per task · Structural 0.1, Civil 1.9, Electrical 7.2, Mechanical 4.6 | Alibaba | 4.5% |
| 88 | [Kimi K2 Thinking](https://ple-bench.com/leaderboard) | openhands · openhands harness · ±0.7 across runs · $0.25 per task · 12 min per task · Structural 0.1, Civil 2.7, Electrical 5.8, Mechanical 5.1 | Moonshot AI | 4.4% |
| 89 | [Qwen3 Coder 480B](https://ple-bench.com/leaderboard) | agy · agy harness · ±0.6 across runs · about $0.49 per task · 6 min per task · Structural 0.7, Civil 3.6, Electrical 5.8, Mechanical 4.6 | Alibaba | 4.4% |
| 90 | [Qwen3-Next 80B](https://ple-bench.com/leaderboard) | openhands · openhands harness · ±0.1 across runs · $0.77 per task (source footnote) · 92 min per task · Structural 1.1, Civil 2, Electrical 6.5, Mechanical 4.4 | Alibaba | 4.3% |
| 91 | [Gemma 4 26B A4B](/models/gemma-4-26b-a4b) | agy · agy harness (native) · ±0.4 across runs · about $0.21 per task · 95 min per task · Structural 0.7, Civil 2.4, Electrical 4.2, Mechanical 5.8 | Google | 4.2% |
| 92 | [GPT-OSS 120B](/models/gpt-oss-120b) | agy · agy harness · ±0.3 across runs · Cost not reported · 36 min per task · Structural 1.1, Civil 1.1, Electrical 6.1, Mechanical 4.7 | OpenAI | 4.2% |
| 93 | [GPT-OSS 120B](/models/gpt-oss-120b) | claude-code · claude-code harness · ±0.2 across runs · $0.11 per task · 46 min per task · Structural 0.5, Civil 2.1, Electrical 5.4, Mechanical 4.9 | OpenAI | 4.2% |
| 94 | [MiniMax M2](https://ple-bench.com/leaderboard) | opencode · opencode harness · ±0.4 across runs · $0.079 per task · 14 min per task · Structural 0, Civil 3.1, Electrical 7.6, Mechanical 3 | MiniMax | 4.2% |
| 95 | [Qwen3 Coder 480B](https://ple-bench.com/leaderboard) | pi · pi harness · ±0.5 across runs · $0.15 per task · 10 min per task · Structural 0.9, Civil 2.3, Electrical 7, Mechanical 3.7 | Alibaba | 4.2% |
| 96 | [DeepSeek-V4.1-Flash](https://ple-bench.com/leaderboard) | codex · codex harness · ±1.6 across runs · $2.08 per task · 295 min per task · Structural 2, Civil 3.7, Electrical 3, Mechanical 5.5 | DeepSeek | 4.1% |
| 97 | [GPT-OSS 120B](/models/gpt-oss-120b) | pi · pi harness · ±0.6 across runs · $0.12 per task · 26 min per task · Structural 1.5, Civil 3.3, Electrical 5.6, Mechanical 3.5 | OpenAI | 4.0% |
| 98 | [Kimi K2 Thinking](https://ple-bench.com/leaderboard) | pi · pi harness · ±0.2 across runs · $0.2 per task · 8 min per task · Structural 0, Civil 3, Electrical 5.2, Mechanical 4.5 | Moonshot AI | 4.0% |
| 99 | [Gemma 4 26B A4B](/models/gemma-4-26b-a4b) | claude-code · claude-code harness · ±0.2 across runs · $0.53 per task · 88 min per task · Structural 0.1, Civil 2.5, Electrical 4.4, Mechanical 5 | Google | 3.8% |
| 100 | [Gemma 4 26B A4B](/models/gemma-4-26b-a4b) | pi · pi harness · ±0.2 across runs · $0.29 per task · 84 min per task · Structural 0.2, Civil 3.3, Electrical 4.6, Mechanical 4.4 | Google | 3.8% |
| 101 | [GPT-OSS 120B](/models/gpt-oss-120b) | codex · codex harness (native) · ±0.5 across runs · $0.18 per task · 45 min per task · Structural 1.5, Civil 1.3, Electrical 3.5, Mechanical 5.7 | OpenAI | 3.8% |
| 102 | [GPT-OSS 120B](/models/gpt-oss-120b) | hermes · hermes harness · ±0.1 across runs · $0.16 per task · 48 min per task · Structural 1.8, Civil 2.4, Electrical 4.9, Mechanical 3.7 | OpenAI | 3.7% |
| 103 | [GPT-OSS 120B](/models/gpt-oss-120b) | opencode · opencode harness · ±0.7 across runs · $0.16 per task · 47 min per task · Structural 1, Civil 2, Electrical 5.4, Mechanical 3.6 | OpenAI | 3.7% |
| 104 | [MiniMax M2](https://ple-bench.com/leaderboard) | agy · agy harness · ±0.2 across runs · about $0.33 per task · 13 min per task · Structural 0.3, Civil 1.8, Electrical 5.7, Mechanical 3.4 | MiniMax | 3.5% |
| 105 | [Kimi K2 Thinking](https://ple-bench.com/leaderboard) | agy · agy harness · ±0.7 across runs · about $0.29 per task · 18 min per task · Structural 0.1, Civil 1.5, Electrical 3.8, Mechanical 4.2 | Moonshot AI | 3.2% |
| 106 | [Kimi K2 Thinking](https://ple-bench.com/leaderboard) | codex · codex harness · ±0.8 across runs · $0.26 per task · 9 min per task · Structural 1, Civil 1.3, Electrical 4.4, Mechanical 3.7 | Moonshot AI | 3.2% |
| 107 | [Gemma 4 26B A4B](/models/gemma-4-26b-a4b) | opencode · opencode harness · ±0.3 across runs · $0.45 per task · 46 min per task · Structural 0.1, Civil 1.3, Electrical 3.2, Mechanical 3.6 | Google | 2.7% |
| 108 | [Qwen3-Next 80B](https://ple-bench.com/leaderboard) | pi · pi harness · ±0.2 across runs · $1.05 per task (source footnote) · 59 min per task · Structural 0, Civil 0.8, Electrical 5.8, Mechanical 1.7 | Alibaba | 2.7% |
| 109 | [Qwen3-Next 80B](https://ple-bench.com/leaderboard) | claude-code · claude-code harness · ±0.6 across runs · $0.54 per task (source footnote) · 44 min per task · Structural 1.1, Civil 2.1, Electrical 4.1, Mechanical 2 | Alibaba | 2.6% |
| 110 | [Qwen3-Next 80B](https://ple-bench.com/leaderboard) | opencode · opencode harness · ±0.4 across runs · $0.54 per task (source footnote) · 70 min per task · Structural 0, Civil 1.6, Electrical 4.8, Mechanical 1.9 | Alibaba | 2.6% |
| 111 | [Qwen3-Next 80B](https://ple-bench.com/leaderboard) | hermes · hermes harness · ±0.6 across runs · $0.41 per task (source footnote) · 47 min per task · Structural 0.1, Civil 1.4, Electrical 2.6, Mechanical 2.1 | Alibaba | 1.9% |
| 112 | [Gemma 4 26B A4B](/models/gemma-4-26b-a4b) | hermes · hermes harness · ±0.2 across runs · $0.29 per task · 24 min per task · Structural 0, Civil 2.6, Electrical 2.7, Mechanical 1.3 | Google | 1.8% |
| 113 | [Qwen3-Next 80B](https://ple-bench.com/leaderboard) | agy · agy harness · ±0.6 across runs · about $0.4 per task (source footnote) · 41 min per task · Structural 0, Civil 1.5, Electrical 3, Mechanical 0.6 | Alibaba | 1.4% |
| 114 | [Qwen3-Next 80B](https://ple-bench.com/leaderboard) | codex · codex harness · ±0.5 across runs · $0.56 per task (source footnote) · 36 min per task · Structural 0.7, Civil 0.5, Electrical 1.7, Mechanical 0.6 | Alibaba | 1.0% |
| 115 | [Gemma 4 26B A4B](/models/gemma-4-26b-a4b) | codex · codex harness · ±0.2 across runs · $0.2 per task · 24 min per task · Structural 0, Civil 1, Electrical 0.5, Mechanical 1 | Google | 0.7% |
| 116 | [Llama 4 Maverick](/models/llama-4-maverick) | openhands · openhands harness · ±0.2 across runs · $0.18 per task (source footnote) · 2 min per task · Structural 0, Civil 0.2, Electrical 1, Mechanical 0.9 | Meta | 0.7% |
| 117 | [Llama 4 Maverick](/models/llama-4-maverick) | pi · pi harness · ±0.3 across runs · $0.34 per task (source footnote) · 1 min per task · Structural 0, Civil 0.1, Electrical 0.6, Mechanical 1.2 | Meta | 0.7% |
| 118 | [Llama 4 Maverick](/models/llama-4-maverick) | claude-code · claude-code harness · ±0.1 across runs · $0.063 per task (source footnote) · 1 min per task · Structural 0, Civil 0.1, Electrical 0.4, Mechanical 0.6 | Meta | 0.4% |
| 119 | [Llama 4 Maverick](/models/llama-4-maverick) | agy · agy harness · ±0.1 across runs · about $0.06 per task (source footnote) · 3 min per task · Structural 0, Civil 0, Electrical 0, Mechanical 0.2 | Meta | 0.1% |
| 120 | [Llama 4 Maverick](/models/llama-4-maverick) | codex · codex harness · ±0.1 across runs · $0.097 per task (source footnote) · 2 min per task · Structural 0, Civil 0, Electrical 0, Mechanical 0.1 | Meta | 0.0% |
| 121 | [Llama 4 Maverick](/models/llama-4-maverick) | hermes · hermes harness · ±0 across runs · $0.046 per task (source footnote) · 1 min per task · Structural 0, Civil 0, Electrical 0, Mechanical 0.1 | Meta | 0.0% |
| 122 | [Llama 4 Maverick](/models/llama-4-maverick) | opencode · opencode harness · ±0 across runs · $0.004 per task (source footnote) · <1 min per task · Structural 0, Civil 0, Electrical 0, Mechanical 0 | Meta | 0.0% |

## FAQ

### What does PLE measure?

Long, end-to-end engineering projects: an agent works through a full project folder, finds the governing codes and physical limits, and produces deliverables a licensed engineer would sign off on.

### Which model leads the published PLE snapshot?

Claude Opus 5.5 currently leads the published PLE snapshot with a score of 48.6%.

### How many models are evaluated on PLE?

The November 12, 2026 capture contains 18 models on 9 harnesses.

### Does PLE affect BenchLM's overall score?

Not directly. PLE is still displayed on BenchLM for reference, but it is excluded from the weighted scoring formula.