Benchmarks
Benchmarks

Arena-Hard v2

Human preferenceunit % · normalized over [0, 84]

Second-generation Arena-Hard, harder prompt set.

#ModelSourceScoreNormalized
Score distribution
8 tracked results across the normalization window
084
Score vs. parameters
Open-weights models, log-x params
1B10B100B1000B