Benchmarks

HumanEval+

Codingunit % · normalized over [10, 100]

EvalPlus-augmented HumanEval with extra test cases (stricter than base HumanEval).

#ModelSourceScoreNormalized

Score distribution

38 tracked results across the normalization window

10100

Score vs. parameters

Open-weights models, log-x params