Benchmarks

RepoBench

Codingunit % · normalized over [0, 40]

Repository-level code auto-completion benchmark.

#ModelSourceScoreNormalized

Score distribution

8 tracked results across the normalization window

040

Score vs. parameters

Open-weights models, log-x params