Model
Model explorer
SmolLM2 1.7B
OPENHugging Face · SmolLM family · released Nov 1, 2024
Fully-open small-model family (135M/360M/1.7B) for on-device use, trained on 11T curated tokens (FineWeb-Edu, DCLM, Stack, custom math/code).
ReasoningCodingVisionFunction callingTool useAgentic
-93.8
Elo · rank #411
Parameters
1.71B
Active params
1.71B (dense)
Context
8K tokens
Architecture
Llama-style decoder-only Transformer (SwiGLU, RoPE, tied embeddings), 24 layers, 2048 hidden dim
License
Apache-2.0
Languages
1+
API price (in/out)
No hosted API
Modalities
text
Benchmark results
Bar shows position within the tracked field; marker = field best
best: Llama 3.1 405B · 96.9%
best: Llama 3.1 405B · 96.8%
best: Claude 3 Opus · 95.4%
best: Claude Fable 5 · 91.5%
best: Claude 1 · 90.8%
best: GPT-4o mini · 93.1%
best: Sarvam-1 (2B) · 90.6%
best: PaLM 2 · 90.9%
Run it locally
VRAM @ Q4
1.5 GB
VRAM @ FP16
4 GB
Fits on (Q4)
RTX 3060 12GBRTX 4070 Ti 16GBRTX 3090 24GBRTX 4090 24GBRTX 5090 32GBM4 Pro 48GBM3 Max 128GBM3 Ultra 512GBA100 80GBH100 80GBH200 141GBB200 192GB
Throughput data unavailable.
Quantizations
GGUF Q4 · GGUF Q8 · MLX
SmolLM family
Elo progression across releases
API price weights · each benchmark row carries its own source badge (see methodology)