# SciCode Subproblem With Background (Kaggle task v3) (SciCode Subproblem With Background (Kaggle))

> A separate Kaggle SciCode track for decomposed scientific coding problems with supplied background.

Canonical page: https://benchlm.ai/benchmarks/scicode-subproblem-with-background-kaggle

- Category: [Coding](/coding)
- Last updated: 2026-10-20 source capture

Evaluation results published by [Kaggle Benchmarks](https://www.kaggle.com/benchmarks/open-benchmarks/scicode). undefined

This Kaggle SciCode track tests decomposed scientific coding problems with supplied background. The four tracks retain separate scores because supplying background information and evaluating subproblems change the task.

We preserve Kaggle task version 3, source configuration names, evaluation dates, and published intervals. The source does not state an interval confidence level here. These rows remain separate from the core SciCode, Artificial Analysis, and Mercor evaluation protocols.

These are published source configurations. Compare the task version and disclosed settings before treating a score difference as a model difference.

- [Kaggle leaderboard and methodology](https://www.kaggle.com/benchmarks/open-benchmarks/scicode)
- [Published leaderboard data](https://www.kaggle.com/api/v1/benchmarks/open-benchmarks/scicode/leaderboard)
- [SciCode project and original methodology](https://scicode-bench.github.io/)
- [SciCode paper](https://arxiv.org/abs/2407.13168)
- [Apache 2.0 license shown by Kaggle](https://www.apache.org/licenses/LICENSE-2.0)

## About SciCode Subproblem With Background (Kaggle)

- Year: 2024
- Tasks: Decomposed scientific coding problems
- Format: Published Kaggle leaderboard aggregates
- Paper: [SciCode: A Research Coding Benchmark Curated by Scientists](https://arxiv.org/abs/2407.13168)

This track reports problem success for decomposed scientific coding problems with supplied background. We show the published percentage and keep it separate from the other three Kaggle tracks and other SciCode evaluation providers.

SciCode Subproblem With Background (Kaggle) is currently displayed on BenchLM for reference, but it is excluded from the weighted scoring formula.

## Leaderboard (62 configurations)

| Rank | Model | Configuration | Creator | Score |
|------|-------|---------------|---------|-------|
| 1 | [Claude Opus 5.5](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2026-09-24 | — | 58.1% |
| 2 | [GPT-6 Astra](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2026-09-14 | — | 56.4% |
| 3 | [Gemini 4 Argon](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2026-10-12 | — | 55.3% |
| 4 | [Gemini 3.8 Flash](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2026-09-06 | — | 54.6% |
| 5 | [GPT-5.6 Sol](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2026-07-22 | — | 54.6% |
| 6 | [Gemini 3.7 Flash](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2026-08-28 | — | 54.3% |
| 7 | [GPT-6.1 Sol](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2026-10-05 | — | 53.3% |
| 8 | [Claude Sonnet 5.5](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2026-09-30 | — | 50.2% |
| 9 | [Grok 4.5](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2026-07-22 | — | 50.2% |
| 10 | [Gemini 3.1 Pro Preview](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3 | — | 50.0% |
| 11 | [Claude Opus 5](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2026-07-28 | — | 49.5% |
| 12 | [Gemini 3.6 Flash](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2026-07-22 | — | 49.5% |
| 13 | [Claude Sonnet 5](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2026-07-23 | — | 49.3% |
| 14 | [Gemini 3.5 Flash](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3 | — | 49.1% |
| 15 | [GPT-5.6 Terra](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2026-07-22 | — | 48.5% |
| 16 | [Gemini 3 Flash Preview](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2026-07-06 | — | 47.1% |
| 17 | [Claude Opus 4.8](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3 | — | 45.0% |
| 18 | [o3](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-22 | — | 44.7% |
| 19 | [o3 mini](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-22 | — | 43.3% |
| 20 | [Grok 3 Mini](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-26 | — | 43.3% |
| 21 | [Gemma 4 31B](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3 | — | 42.9% |
| 22 | [GPT-5.6 Luna](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2026-07-22 | — | 41.9% |
| 23 | [Claude Opus 4](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-23 | — | 41.9% |
| 24 | [Gemini 2.5 Flash Preview](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-23 | — | 41.9% |
| 25 | [Claude Haiku 5.5](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2026-10-09 | — | 41.6% |
| 26 | [Gemini 2.5 Pro Preview](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-06-06 | — | 41.2% |
| 27 | [o4 mini](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-22 | — | 39.9% |
| 28 | [Claude Sonnet 4](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-23 | — | 38.8% |
| 29 | [Claude 3.7 Sonnet](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-22 | — | 38.8% |
| 30 | [DeepSeek-V3](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-22 | — | 38.8% |
| 31 | [o1](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-22 | — | 38.5% |
| 32 | [Gemini 3.5 Flash-Lite](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2026-07-22 | — | 38.1% |
| 33 | [GPT-4.1](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-22 | — | 38.1% |
| 34 | [Claude Opus 4.1](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-08-26 | — | 38.1% |
| 35 | [Claude 3.5 Sonnet](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-22 | — | 38.1% |
| 36 | [Grok 3](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-26 | — | 38.1% |
| 37 | [DeepSeek-R1](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-06-04 | — | 37.8% |
| 38 | [o1 mini](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-22 | — | 36.1% |
| 39 | [Gemini 1.5 Pro](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-22 | — | 34.7% |
| 40 | [deepseek-v3.1](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-08-27 | — | 34.7% |
| 41 | [Gemini 2.0 Flash](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-22 | — | 34.7% |
| 42 | [gpt-oss-120b](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-08-15 | — | 34.0% |
| 43 | [Gemini 3.1 Flash-Lite Preview](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3 | — | 34.0% |
| 44 | [GPT-4o](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-22 | — | 33.7% |
| 45 | [Qwen 3 235B A22B Instruct 2506](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-09-03 | — | 33.3% |
| 46 | [Mistral Large 2](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-22 | — | 31.6% |
| 47 | [Claude 3.5 Haiku](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-22 | — | 30.6% |
| 48 | [GPT-5](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3 | — | 29.6% |
| 49 | [Grok 2](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-22 | — | 29.6% |
| 50 | [Codestral](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-22 | — | 29.6% |
| 51 | [gpt-oss-20b](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-08-15 | — | 28.9% |
| 52 | [Gemini 1.5 Flash](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-22 | — | 28.2% |
| 53 | [Gemini 1.5 Flash 8B](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-22 | — | 26.1% |
| 54 | [GPT-4o mini](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-22 | — | 24.1% |
| 55 | [Gemma 3 27B](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-22 | — | 23.4% |
| 56 | [Mixtral 8x22B](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-22 | — | 22.3% |
| 57 | [Granite 4.0 Small](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-09-30 | — | 21.0% |
| 58 | [GPT-3.5 Turbo](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-22 | — | 18.6% |
| 59 | [Gemma 3 12B](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-22 | — | 18.6% |
| 60 | [Ministral 8B](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-22 | — | 12.4% |
| 61 | [Ministral 3B](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-22 | — | 10.3% |
| 62 | [Gemma 3 4B](https://www.kaggle.com/benchmarks/open-benchmarks/scicode) | Task version 3; Evaluated 2025-05-22 | — | 9.3% |

## FAQ

### What does SciCode Subproblem With Background (Kaggle) measure?

A separate Kaggle SciCode track for decomposed scientific coding problems with supplied background.

### Which source row has the highest reported SciCode Subproblem With Background (Kaggle) value?

Claude Opus 5.5 has the highest reported SciCode Subproblem With Background (Kaggle) value at 58.1%. These are published source configurations. Compare the task version and disclosed settings before treating a score difference as a model difference.

### How many models are evaluated on SciCode Subproblem With Background (Kaggle)?

The 2026-10-20 source capture contains 62 AI models.

### Does SciCode Subproblem With Background (Kaggle) affect BenchLM's overall score?

Not directly. SciCode Subproblem With Background (Kaggle) is still displayed on BenchLM for reference, but it is excluded from the weighted scoring formula.