Benchmarks

BigCodeBench

Codingunit % · normalized over [0, 88]

Practical, tool-using code generation with complex instructions.

#ModelSourceScoreNormalized

Score distribution

8 tracked results across the normalization window

088

Score vs. parameters

Open-weights models, log-x params