Benchmarks

GSM8K

Mathunit % · normalized over [5, 100]

Grade-school math word problems, 8-shot pass@1. Saturated at the frontier.

#ModelSourceScoreNormalized

Score distribution

203 tracked results across the normalization window

5100

Score vs. parameters

Open-weights models, log-x params