Benchmarks

Vicuna Bench

Human preferenceunit Elo · normalized over [880, 1200]

Early human/LLM-judged Elo ranking on 80 diverse questions.

#ModelSourceScoreNormalized

Score distribution

5 tracked results across the normalization window

8801200

Score vs. parameters

Open-weights models, log-x params