Vals Code Migration v1.1 (Code Migration v1.1)
We show this table for reference; we do not rank on it.
Reimplementing working programs in another language using the Pi agent harness and revised hidden tests.
Evaluation results published by Vals AI. Published leaderboard aggregates and evaluation settings only. Dataset contents are not included.
Code Migration v1.1 score on Code Migration v1.1 — November 9, 2026
We mirror the published code migration v1.1 score view for Code Migration v1.1. Claude Sonnet 5.5 leads the public snapshot at 86.88%, followed by Claude Fable 5.2 (83.27%) and Claude Opus 5.5 (81.01%). We do not use these results to rank models overall.
Claude Sonnet 5.5
Anthropic
Claude Fable 5.2
Anthropic
Claude Opus 5.5
Anthropic
30 modelsCodingCurrentDisplay onlyUpdated November 9, 2026
Code Migration v1.1 score table (30 models)
| Rank | Model / configuration | Score | Parameters (B) | Open / closed |
|---|---|---|---|---|
| 1 | Claude Sonnet 5.5Anthropic | 86.88% | Not reported | Closed |
| 2 | Claude Fable 5.2Anthropic | 83.27% | Not reported | Closed |
| 3 | Claude Opus 5.5Anthropic | 81.01% | Not reported | Closed |
| 4 | GPT-6 AstraOpenAImax reasoning | 80.58% | Not reported | Closed |
| 5 | GPT-6.1 SolOpenAImax reasoning | 77.32% | Not reported | Closed |
| 6 | Muse WonderMetamax reasoning | 72.36% | Not reported | Closed |
| 7 | Gemini 4 ArgonGooglehigh reasoning | 70.80% | Not reported | Closed |
| 8 | DeepSeek V4.1 Flash 1017DeepSeekmax reasoning | 67.52% | Not reported | Open |
| 9 | Muse Wonder FullMetamax reasoning | 62.79% | Not reported | Closed |
| 10 | DeepSeek V4.1 Flash 1017DeepSeekmax reasoning | 58.94% | Not reported | Open |
| 11 | Qwen3.8 Max InternalAlibaba | 57.19% | Not reported | Unknown |
| 12 | GLM-5.3Z.AImax reasoning | 55.07% | Not reported | Open |
| 13 | Grok 4.7xAIxhigh reasoning | 53.22% | Not reported | Closed |
| 14 | Claude Haiku 5.5Anthropic | 52.36% | Not reported | Closed |
| 15 | DeepSeek V4 Pro 0813DeepSeekmax reasoning | 51.99% | Not reported | Open |
| 16 | GLM-5.3-FlashZ.AImax reasoning | 51.65% | Not reported | Open |
| 17 | MiMo-V2.6-ProXiaomi | 48.79% | Not reported | Open |
| 18 | Step 5 PreviewStepFun | 47.00% | Not reported | Open |
| 19 | GPT-6 LunaOpenAImax reasoning | 46.67% | Not reported | Closed |
| 20 | Hy4 previewTencent | 45.36% | Not reported | Open |
| 21 | MiMo-V2.6-FlashXiaomi | 39.55% | Not reported | Open |
| 22 | Mercury 3Inceptionhigh reasoning | 39.26% | Not reported | Closed |
| 23 | Gemini 3.8 FlashGooglehigh reasoning | 38.65% | Not reported | Closed |
| 24 | Kimi K3Moonshot AImax reasoning | 28.59% | Not reported | Open |
| 25 | Muse Spark OpenMetaxhigh reasoning | 26.89% | Not reported | Open |
| 26 | Beam 1.0Reflection | 22.85% | Not reported | Unknown |
| 27 | MiniMax M3MiniMax | 20.90% | Not reported | Open |
| 28 | Nemotron 3.5 Super VL 120B A12BNVIDIAhigh reasoning | 16.44% | Not reported | Open |
| 29 | Inkling-SmallThinking Machines Lab0.99 reasoning | 10.43% | Not reported | Open |
| 30 | InklingThinking Machines Lab0.99 reasoning | 8.82% | Not reported | Open |
Code Migration
BenchLM mirrors this Vals AI leaderboard for reference only. It is excluded from BenchLM overall and category rankings.
| Source rank | Source model or configuration | Code Migration v1 (archived) score | Source setup | Parameters (B) | Open / closed |
|---|---|---|---|---|---|
| 1 | Claude Sonnet 5.5Anthropic | 69.83% | Vals AIOriginal result | Not reported | Closed |
| 2 | Gemini 4 ArgonGoogle | 68.17% | high reasoningOriginal result | Not reported | Closed |
| 3 | GPT-6 AstraOpenAI | 67.74% | max reasoningOriginal result | Not reported | Closed |
| 4 | Claude Opus 5.5Anthropic | 66.65% | Vals AIOriginal result | Not reported | Closed |
| 5 | GPT-6.1 SolOpenAI | 65.12% | max reasoningOriginal result | Not reported | Closed |
| 6 | Muse WonderMeta | 62.55% | max reasoningOriginal result | Not reported | Closed |
| 7 | Muse Wonder FullMeta | 61.03% | max reasoningOriginal result | Not reported | Closed |
| 8 | Claude Opus 5Anthropic | 57.47% | Vals AIOriginal result | Not reported | Closed |
| 9 | GPT-6 SolOpenAI | 57.20% | max reasoningOriginal result | Not reported | Closed |
| 10 | Claude Fable 5Anthropic | 55.06% | Vals AIOriginal result | Not reported | Closed |
| 11 | Claude Fable 5.1Anthropic | 54.61% | Vals AIOriginal result | Not reported | Closed |
| 12 | GPT-5.6 SolOpenAI | 52.92% | max reasoningOriginal result | Not reported | Closed |
| 13 | GPT-5.6 TerraOpenAI | 47.80% | max reasoningOriginal result | Not reported | Closed |
| 14 | Hy4 previewTencent | 47.43% | Vals AIOriginal result | Not reported | Open |
| 15 | Muse Spark 1.3 MaxMeta | 47.41% | max reasoningOriginal result | Not reported | Unknown |
| 16 | Claude Opus 4.8Anthropic | 47.25% | Vals AIOriginal result | Not reported | Closed |
| 17 | DeepSeek V4.1 Flash 1017DeepSeek | 45.62% | high reasoningOriginal result | Not reported | Open |
| 18 | GPT-5.5OpenAI | 45.16% | xhigh reasoningOriginal result | Not reported | Closed |
| 19 | Grok 4.7xAI | 44.82% | xhigh reasoningOriginal result | Not reported | Closed |
| 20 | Grok 4.6xAI | 44.57% | high reasoningOriginal result | Not reported | Closed |
| 21 | Claude Haiku 5.5Anthropic | 44.57% | Vals AIOriginal result | Not reported | Closed |
| 22 | GPT-5.6 LunaOpenAI | 44.55% | max reasoningOriginal result | Not reported | Closed |
| 23 | Claude Sonnet 5Anthropic | 44.39% | Vals AIOriginal result | Not reported | Closed |
| 24 | GLM-5.3Z.AI | 44.22% | max reasoningOriginal result | Not reported | Open |
| 25 | DeepSeek V4.1 Flash 1017DeepSeek | 44.21% | max reasoningOriginal result | Not reported | Open |
| 26 | Claude Opus 4.7Anthropic | 43.88% | Vals AIOriginal result | Not reported | Closed |
| 27 | MiMo-V2.6-ProXiaomi | 43.01% | Vals AIOriginal result | Not reported | Open |
| 28 | GPT-6 LunaOpenAI | 42.55% | max reasoningOriginal result | Not reported | Closed |
| 29 | DeepSeek V4 Pro 0813DeepSeek | 41.54% | max reasoningOriginal result | Not reported | Open |
| 30 | MiMo-V2.6-FlashXiaomi | 40.93% | Vals AIOriginal result | Not reported | Open |
| 31 | Claude Sonnet 4.6Anthropic | 39.89% | Vals AIOriginal result | Not reported | Closed |
| 32 | Step 5 PreviewStepFun | 38.98% | Vals AIOriginal result | Not reported | Open |
| 33 | DeepSeek V4 Flash 0731DeepSeek | 38.63% | high reasoningOriginal result | Not reported | Open |
| 34 | GLM-5.2Z.AI | 37.87% | max reasoningOriginal result | Not reported | Open |
| 35 | Grok 4.5xAI | 36.60% | high reasoningOriginal result | Not reported | Closed |
| 36 | Gemini 3.8 FlashGoogle | 36.55% | high reasoningOriginal result | Not reported | Closed |
| 37 | GPT-5.4OpenAI | 34.98% | xhigh reasoningOriginal result | Not reported | Closed |
| 38 | Gemini 3.7 FlashGoogle | 34.80% | high reasoningOriginal result | Not reported | Closed |
| 39 | Ember-1Fireworks | 32.51% | Vals AIOriginal result | Not reported | Closed |
| 40 | Muse Spark 1.1Meta | 31.11% | xhigh reasoningOriginal result | Not reported | Closed |
| 41 | Gemini 3.6 FlashGoogle | 30.93% | high reasoningOriginal result | Not reported | Closed |
| 42 | Mistral Large 4Mistral | 30.56% | high reasoningOriginal result | Not reported | Open |
| 43 | Muse Spark 1.2Meta | 29.95% | xhigh reasoningOriginal result | Not reported | Closed |
| 44 | Kimi K2.6Moonshot AI | 27.77% | Vals AIOriginal result | Not reported | Open |
| 45 | Muse Spark 1.3Meta | 27.58% | xhigh reasoningOriginal result | Not reported | Closed |
| 46 | Gemini 3.5 FlashGoogle | 26.75% | high reasoningOriginal result | Not reported | Closed |
| 47 | DeepSeek V4 Pro 0813DeepSeek | 26.20% | max reasoningOriginal result | Not reported | Open |
| 48 | GLM-5.1Z.AI | 25.77% | Vals AIOriginal result | Not reported | Open |
| 49 | Kimi K2.7 CodeMoonshot AI | 25.39% | Vals AIOriginal result | Not reported | Open |
| 50 | Qwen3.8 MaxAlibaba | 23.96% | Vals AIOriginal result | Not reported | Open |
| 51 | MiMo-V2.5-ProXiaomi | 21.56% | Vals AIOriginal result | Not reported | Closed |
| 52 | Muse Spark OpenMeta | 21.17% | xhigh reasoningOriginal result | Not reported | Open |
| 53 | GLM-5.3-FlashZ.AI | 20.52% | max reasoningOriginal result | Not reported | Open |
| 54 | MiniMax M3MiniMax | 19.93% | Vals AIOriginal result | Not reported | Open |
| 55 | Gemini 3.1 Pro PreviewGoogle | 17.31% | high reasoningOriginal result | Not reported | Unknown |
| 56 | Kimi K3Moonshot AI | 16.10% | max reasoningOriginal result | Not reported | Open |
| 57 | GPT-5.4 nanoOpenAI | 14.47% | high reasoningOriginal result | Not reported | Closed |
| 58 | MiMo-V2.5Xiaomi | 14.23% | Vals AIOriginal result | Not reported | Closed |
| 59 | Qwen3.8-27BAlibaba | 14.16% | xhigh reasoningOriginal result | Not reported | Open |
| 60 | Inkling-SmallThinking Machines Lab | 13.68% | 0.99 reasoningOriginal result | Not reported | Open |
| 61 | Qwen3.7 MaxAlibaba | 13.07% | Vals AIOriginal result | Not reported | Closed |
| 62 | GPT-5.4 miniOpenAI | 12.94% | xhigh reasoningOriginal result | Not reported | Closed |
| 63 | Qwen3.7 PlusAlibaba | 12.86% | Vals AIOriginal result | Not reported | Closed |
| 64 | InklingThinking Machines Lab | 11.79% | 0.99 reasoningOriginal result | Not reported | Open |
| 65 | Qwen3.6 PlusAlibaba | 11.10% | Vals AIOriginal result | Not reported | Closed |
| 66 | MiniMax M2.7MiniMax | 8.69% | Vals AIOriginal result | Not reported | Open |
| 67 | Claude Haiku 4.5 ThinkingAnthropic | 7.55% | Vals AIOriginal result | Not reported | Closed |
| 68 | Kimi K2.5 ThinkingMoonshot AI | 6.96% | Vals AIOriginal result | Not reported | Unknown |
| 69 | Grok 4.3xAI | 6.79% | high reasoningOriginal result | Not reported | Closed |
| 70 | Gemini 3 Flash PreviewGoogle | 6.39% | high reasoningOriginal result | Not reported | Unknown |
| 71 | Gemini 3.5 Flash-LiteGoogle | 6.15% | high reasoningOriginal result | Not reported | Closed |
| 72 | Mistral Medium 3.5Mistral AI | 5.13% | high reasoningOriginal result | Not reported | Unknown |
| 73 | Nemotron 3 Ultra 550b A55bNvidia | 4.91% | Vals AIOriginal result | Not reported | Unknown |
| 74 | Gemini 3.1 Flash Lite PreviewGoogle | 4.61% | high reasoningOriginal result | Not reported | Unknown |
| 75 | Mercury 2.5Inception | 4.52% | high reasoningOriginal result | Not reported | Closed |
| 76 | Nemotron Lightning 3p5 30b A3bFireworks AI | 2.95% | Vals AIOriginal result | Not reported | Unknown |
| 77 | Ling 3.0 Flash Af Rc3Ant | 1.82% | Vals AIOriginal result | Not reported | Unknown |
| 78 | Grok 4.20 0309 ReasoningxAI | 0.31% | Vals AIOriginal result | Not reported | Unknown |
| 79 | Ling 3.0 Flash 2607Ant | 0.00% | Vals AIOriginal result | Not reported | Unknown |
How Code Migration v1.1 is shown here
BenchLM mirrors the public Vals AI Code Migration v1.1 leaderboard captured from https://www.vals.ai/benchmarks/code-migration-v1-1 and updated by Vals on November 9, 2026. The snapshot preserves overall scores, uncertainty, latency, cost-per-test metadata, and task-level scores where Vals publishes them.
Code Migration v1.1 is display only on BenchLM. Vals proprietary or Vals-hosted aggregate views are useful context, but BenchLM does not use them as weighted ranking inputs or as a replacement for benchmark-native source records.
Snapshot
The published Code Migration v1.1 snapshot places Claude Sonnet 5.5 first at 86.88%. The third row is 5.86 points behind. The broader top-10 range is 27.94 points, so the table still separates the published systems.
30 models have been evaluated on Code Migration v1.1. The benchmark falls in the Coding category. We keep external benchmark mirrors separate from the weighted global scoring system, so these results remain source-specific evidence. Code Migration v1.1 is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.
About Code Migration v1.1
Year
2026
Tasks
120 CLI migration tasks and 10 COBOL tasks
Format
75% CLI and 25% COBOL accuracy
Difficulty
Production code migration
Version 1.1 replaces mini-SWE-agent with Pi and revises hidden tests. Tasks are unchanged, but scores are not directly comparable with v1. The standalone score combines 120 CLI migration tasks and 10 COBOL tasks at 75% and 25%. Vals Index uses a fixed CLI subset, so its component score differs. Display only.
Freshness and provenance
Version
Code Migration v1.1 2026
Refresh cadence
Quarterly
Staleness state
Current
Question availability
Public benchmark set
BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.
Questions
What does Code Migration v1.1 measure?
Reimplementing working programs in another language using the Pi agent harness and revised hidden tests.
Which model leads the published Code Migration v1.1 snapshot?
Claude Sonnet 5.5 currently leads the published Code Migration v1.1 snapshot with 86.88% code migration v1.1 score. BenchLM shows this benchmark for display only and does not use it in overall rankings.
How many models are evaluated on Code Migration v1.1?
The November 9, 2026 snapshot contains 30 AI models.
Know when it’s worth switching models
The model to choose, the cheaper alternative, and the release we would wait on.
Read a sample issueJoin 7,000+ subscribers.
One email each week. Unsubscribe anytime.