Benchmarks
Benchmarks
SWE-bench Multimodal
Codingunit % · normalized over [0, 70]SWE-bench Multimodal — issues augmented with visual context (screenshots, design mockups), testing whether coding agents generalize to visual software domains.
#ModelSourceScoreNormalized
Score distribution
3 tracked results across the normalization window
070
Score vs. parameters
Open-weights models, log-x params
No open-weights models with disclosed parameter counts have a score here yet.