A text-to-SQL benchmark over realistic warehouse-scale schemas, reported by Interfaze for model comparison.
BenchLM mirrors the published score view for Spider 2.0-Lite. Interfaze Beta leads the public snapshot at 52.9%. BenchLM does not use these results to rank models overall.
Year
2024
Tasks
Text-to-SQL queries
Format
Execution accuracy
Difficulty
Enterprise text-to-SQL
Spider 2.0-Lite tests whether a model can generate executable SQL from natural-language questions against realistic database schemas. BenchLM tracks Interfaze's SQLite subset score as a display-only coding and data benchmark.
Version
Spider 2.0-Lite 2024
Refresh cadence
Annual
Staleness state
Refreshing
Question availability
Public benchmark set
BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.
A text-to-SQL benchmark over realistic warehouse-scale schemas, reported by Interfaze for model comparison.
Interfaze Beta by Interfaze currently leads with a score of 52.9% on Spider 2.0-Lite.
1 AI models have been evaluated on Spider 2.0-Lite on BenchLM.
For engineers, researchers, and the plain curious — a weekly brief on new models, ranking shifts, and pricing changes.
Free. No spam. Unsubscribe anytime.