Benchmarks

SWE-bench Verified

Codingunit % · normalized over [0, 97]

Resolving real GitHub issues in real repositories, verified subset.

#ModelSourceScoreNormalized

Score distribution

118 tracked results across the normalization window

097

Score vs. parameters

Open-weights models, log-x params