Benchmarks

DS-1000

Codingunit % · normalized over [0, 36]

Realistic data-science coding problems across 7 Python libraries.

#ModelSourceScoreNormalized

Score distribution

4 tracked results across the normalization window

036

Score vs. parameters

Open-weights models, log-x params