Benchmarks

SimpleQA

Knowledgeunit % · normalized over [0, 66]

Short factual questions with a single verifiable answer; notoriously low scores.

#ModelSourceScoreNormalized

Score distribution

48 tracked results across the normalization window

066

Score vs. parameters

Open-weights models, log-x params