Benchmarks

HumanEval FIM

Codingunit % · normalized over [0, 91]

Fill-in-the-middle code completion variant of HumanEval.

#ModelSourceScoreNormalized

Score distribution

7 tracked results across the normalization window

091

Score vs. parameters

Open-weights models, log-x params