# SciCode Subproblem Standard (Kaggle task v3) (SciCode Subproblem Standard (Kaggle))

> A separate Kaggle SciCode track for decomposed scientific coding problems without background notes.

Canonical page: https://benchlm.ai/benchmarks/scicode-subproblem-standard-kaggle

- Category: [Coding](/coding)
- Last updated: 2026-10-20 source capture

Evaluation results published by [Kaggle Benchmarks](https://www.kaggle.com/benchmarks/open-benchmarks/scicode). undefined

This Kaggle SciCode track tests decomposed scientific coding problems without background notes. The four tracks retain separate scores because supplying background information and evaluating subproblems change the task.

We preserve Kaggle task version 3, source configuration names, evaluation dates, and published intervals. The source does not state an interval confidence level here. These rows remain separate from the core SciCode, Artificial Analysis, and Mercor evaluation protocols.

These are published source configurations. Compare the task version and disclosed settings before treating a score difference as a model difference.

- [Kaggle leaderboard and methodology](https://www.kaggle.com/benchmarks/open-benchmarks/scicode)
- [Published leaderboard data](https://www.kaggle.com/api/v1/benchmarks/open-benchmarks/scicode/leaderboard)
- [SciCode project and original methodology](https://scicode-bench.github.io/)
- [SciCode paper](https://arxiv.org/abs/2407.13168)
- [Apache 2.0 license shown by Kaggle](https://www.apache.org/licenses/LICENSE-2.0)

## About SciCode Subproblem Standard (Kaggle)

- Year: 2024
- Tasks: Decomposed scientific coding problems
- Format: Published Kaggle leaderboard aggregates
- Paper: [SciCode: A Research Coding Benchmark Curated by Scientists](https://arxiv.org/abs/2407.13168)

This track reports problem success for decomposed scientific coding problems without background notes. We show the published percentage and keep it separate from the other three Kaggle tracks and other SciCode evaluation providers.

SciCode Subproblem Standard (Kaggle) is currently displayed on BenchLM for reference, but it is excluded from the weighted scoring formula.

## Leaderboard (62 configurations)

| Rank | Model | Configuration | Creator | Score |
|------|-------|---------------|---------|-------|
| 1 | [Claude Opus 5.5](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2026-09-24 | — | 52.2% |
| 2 | [Gemini 4 Argon](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2026-10-12 | — | 45.0% |
| 3 | [Gemini 3.1 Pro Preview](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3 | — | 44.9% |
| 4 | [Claude Sonnet 5.5](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2026-09-30 | — | 43.3% |
| 5 | [GPT-6 Astra](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2026-09-14 | — | 43.3% |
| 6 | [Gemini 3.7 Flash](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2026-08-28 | — | 43.0% |
| 7 | [Claude Opus 5](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2026-07-27 | — | 42.6% |
| 8 | [GPT-5.6 Sol](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2026-07-22 | — | 42.6% |
| 9 | [Grok 4.5](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2026-07-21 | — | 41.9% |
| 10 | [Gemini 3.8 Flash](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2026-09-06 | — | 40.2% |
| 11 | [Claude Sonnet 5](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2026-07-23 | — | 40.1% |
| 12 | [Gemini 3.5 Flash](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3 | — | 39.5% |
| 13 | [GPT-5.6 Terra](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2026-07-22 | — | 39.2% |
| 14 | [Claude Opus 4.8](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3 | — | 38.1% |
| 15 | [Gemini 3.6 Flash](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2026-07-21 | — | 37.8% |
| 16 | [GPT-6.1 Sol](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2026-10-05 | — | 37.8% |
| 17 | [o3](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-22 | — | 36.4% |
| 18 | [o4 mini](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-22 | — | 36.1% |
| 19 | [o3 mini](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-22 | — | 34.7% |
| 20 | [Claude Haiku 5.5](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2026-10-09 | — | 34.4% |
| 21 | [GPT-5.6 Luna](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2026-07-21 | — | 34.4% |
| 22 | [GPT-5](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3 | — | 33.3% |
| 23 | [Gemma 4 31B](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3 | — | 33.2% |
| 24 | [Claude Sonnet 4](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-23 | — | 31.3% |
| 25 | [Gemini 3 Flash Preview](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3 | — | 30.9% |
| 26 | [Gemini 2.5 Pro Preview](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-06-06 | — | 30.9% |
| 27 | [GPT-4.1](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-22 | — | 30.9% |
| 28 | [Gemini 2.5 Flash Preview](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-23 | — | 30.9% |
| 29 | [Claude Opus 4](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-23 | — | 30.6% |
| 30 | [Claude 3.7 Sonnet](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-22 | — | 30.6% |
| 31 | [Gemini 3.5 Flash-Lite](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2026-07-21 | — | 29.6% |
| 32 | [DeepSeek-R1](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-06-04 | — | 29.6% |
| 33 | [o1](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-22 | — | 29.2% |
| 34 | [Grok 3](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-26 | — | 29.2% |
| 35 | [Gemini 1.5 Pro](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-22 | — | 28.5% |
| 36 | [DeepSeek-V3](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-22 | — | 27.8% |
| 37 | [gpt-oss-120b](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-08-15 | — | 27.5% |
| 38 | [Gemini 3.1 Flash-Lite Preview](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3 | — | 27.5% |
| 39 | [Claude Opus 4.1](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-08-26 | — | 27.1% |
| 40 | [Grok 3 Mini](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-26 | — | 26.8% |
| 41 | [deepseek-v3.1](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-08-27 | — | 26.5% |
| 42 | [Qwen 3 235B A22B Instruct 2506](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-09-03 | — | 25.1% |
| 43 | [o1 mini](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-22 | — | 25.1% |
| 44 | [Claude 3.5 Sonnet](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-22 | — | 24.1% |
| 45 | [GPT-4o](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-22 | — | 24.1% |
| 46 | [Gemini 2.0 Flash](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-22 | — | 22.7% |
| 47 | [Mistral Large 2](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-22 | — | 22.7% |
| 48 | [gpt-oss-20b](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-08-15 | — | 22.7% |
| 49 | [Claude 3.5 Haiku](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-22 | — | 22.0% |
| 50 | [Grok 2](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-22 | — | 21.0% |
| 51 | [Gemini 1.5 Flash](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-22 | — | 20.3% |
| 52 | [Codestral](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-22 | — | 17.2% |
| 53 | [GPT-4o mini](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-22 | — | 16.5% |
| 54 | [Granite 4.0 Small](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-09-30 | — | 16.5% |
| 55 | [Mixtral 8x22B](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-22 | — | 15.5% |
| 56 | [Gemma 3 27B](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-22 | — | 14.8% |
| 57 | [Gemini 1.5 Flash 8B](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-22 | — | 14.4% |
| 58 | [GPT-3.5 Turbo](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-22 | — | 13.1% |
| 59 | [Gemma 3 12B](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-22 | — | 12.0% |
| 60 | [Ministral 8B](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-22 | — | 8.2% |
| 61 | [Ministral 3B](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-22 | — | 6.9% |
| 62 | [Gemma 3 4B](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-22 | — | 4.8% |

## FAQ

### What does SciCode Subproblem Standard (Kaggle) measure?

A separate Kaggle SciCode track for decomposed scientific coding problems without background notes.

### Which source row has the highest reported SciCode Subproblem Standard (Kaggle) value?

Claude Opus 5.5 has the highest reported SciCode Subproblem Standard (Kaggle) value at 52.2%. These are published source configurations. Compare the task version and disclosed settings before treating a score difference as a model difference.

### How many models are evaluated on SciCode Subproblem Standard (Kaggle)?

The 2026-10-20 source capture contains 62 AI models.

### Does SciCode Subproblem Standard (Kaggle) affect BenchLM's overall score?

Not directly. SciCode Subproblem Standard (Kaggle) is still displayed on BenchLM for reference, but it is excluded from the weighted scoring formula.