Model
Model explorer

BLOOM (176B)

OPEN
BigScience · BLOOM family · released Jul 11, 2022

First openly-released 100B+ LLM, built by 1000+ BigScience researchers across 46 natural + 13 programming languages under RAIL license.

ReasoningCodingVisionFunction callingTool useAgentic
-148.0
Elo · rank #416
Parameters
176.25B
Active params
176.25B (dense)
Context
2K tokens
Architecture
Dense decoder-only transformer (ALiBi positional encoding, GPT-2-style, GeLU)
License
BigScience RAIL License v1.0
Languages
59+
API price (in/out)
No hosted API
Modalities
text
Benchmark results
Bar shows position within the tracked field; marker = field best
ARC-ChallengeReasoning50.4%#122
best: Llama 3.1 405B · 96.9%
HellaSwagReasoning76.4%#102
best: Claude 3 Opus · 95.4%
HumanEvalCoding15.5%#176
best: Claude Opus 4.5 · 99.4%
MMLUKnowledge30.9%#268
best: OpenAI o3 · 92.9%
TruthfulQAKnowledge39.8%#81
best: Phi-3.5-MoE (16x3.8B, 6.6B active) · 77.5%
Run it locally
VRAM @ Q4
106 GB
VRAM @ FP16
352 GB
Fits on (Q4)
M3 Ultra 512GBH200 141GBB200 192GB
Throughput data unavailable.
Quantizations
INT8 (bitsandbytes)
BLOOM family
Elo progression across releases
BLOOM (176B)Jul 2022-148.0BLOOM-7B1Jul 2022-387.2
Resources
HFbigscience/bloomAPIAvailable via BigScience API
API price weights · each benchmark row carries its own source badge (see methodology)