Benchmark profile
Market-Bench
A quantitative-trading implementation benchmark that asks models to build backtesters under market-book liquidity and execution-delay constraints, then compares their outputs with a verifier.
How we show Market-Bench
We mirror AfterQuery's Market-Bench table captured on July 18, 2026 snapshot. The benchmark asks models to implement backtesters for 3 quantitative-trading strategies, then measures mean absolute error against verifiable reference outputs.
Mean MAE is lower-is-better. The strategies include market-book liquidity and execution-delay constraints, so this is a code-and-simulation result rather than a prediction of investment returns. We keep it display-only and do not mix its unbounded error scale with percentage benchmarks.
Mean MAE on Market-Bench — July 18, 2026 snapshot
BenchLM mirrors the published mean mae view for Market-Bench. Grok 4 leads the public snapshot at 443.24 , followed by GPT-5.2 (969.39) and Gemini 3 Pro Preview (1744.27). BenchLM does not use these results to rank models overall.
Grok 4
xAI
afterquery/market-bench/grok-4
GPT-5.2
OpenAI
afterquery/market-bench/gpt-5-2
Gemini 3 Pro Preview
afterquery/market-bench/gemini-3-pro-preview
Mean MAE table (13 models)
ScoreThe published Market-Bench snapshot places Grok 4 first at 443.24. The third row is 1301.03 score units higher. The broader top-10 range is 9230.97 score units, so the table still separates the published systems.
13 models have been evaluated on Market-Bench. The benchmark falls in the Agentic category. This category carries a 22% weight in BenchLM.ai's overall scoring system. Market-Bench is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.
About Market-Bench
Year
2025
Tasks
3 quantitative-trading strategies
Format
Backtester implementation scored by mean absolute error
Difficulty
Market simulation and quantitative coding
Market-Bench covers scheduled single-stock execution, pairs mean reversion, and dynamic delta hedging. The public table reports mean absolute error across the strategies; lower values are better. The unbounded error scale stays display-only and is not mixed with percentage benchmarks.
BenchLM freshness & provenance
Version
Market-Bench 2025
Refresh cadence
Quarterly
Staleness state
Current
Question availability
Public benchmark set
BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.
FAQ
What does Market-Bench measure?
A quantitative-trading implementation benchmark that asks models to build backtesters under market-book liquidity and execution-delay constraints, then compares their outputs with a verifier.
Which model leads the published Market-Bench snapshot?
Grok 4 currently leads the published Market-Bench snapshot with 443.24 mean mae. BenchLM shows this benchmark for display only and does not use it in overall rankings.
How many models are evaluated on Market-Bench?
13 AI models are included in BenchLM's mirrored Market-Bench snapshot, based on the public leaderboard captured on July 18, 2026 snapshot.
The AI models change fast. We track them for you.
A weekly brief for engineers and researchers covering new models, ranking shifts, and pricing changes.
Free. No spam. Unsubscribe anytime.