Benchmarks
Benchmarks

NL2Repo

Codingunit % · normalized over [0, 72]

Generating a complete, working code repository from a natural-language specification.

#ModelSourceScoreNormalized
Score distribution
0 tracked results across the normalization window
072
Score vs. parameters
Open-weights models, log-x params
No open-weights models with disclosed parameter counts have a score here yet.