Benchmarks

PutnamBench

Mathunit % · normalized over [0, 8]

Formal (Lean 4) proofs of William Lowell Putnam Competition problems.

#ModelSourceScoreNormalized

Score distribution

11 tracked results across the normalization window

Score vs. parameters

Open-weights models, log-x params