Benchmarks
Benchmarks

MBPP+

Codingunit % · normalized over [10, 90]

EvalPlus-augmented MBPP with extra test cases (stricter than base MBPP).

#ModelSourceScoreNormalized
Score distribution
38 tracked results across the normalization window
1090
Score vs. parameters
Open-weights models, log-x params
1B10B100B1000B