Benchmarks
Benchmarks

BIG-Bench Hard

Reasoningunit % · normalized over [30, 97]

23 of the hardest BIG-bench tasks, chain-of-thought.

#ModelSourceScoreNormalized
Score distribution
142 tracked results across the normalization window
3097
Score vs. parameters
Open-weights models, log-x params
1B10B100B1000B