Model
Model explorer

Granite 8B Code Instruct

OPEN
IBM · Granite Code family · released May 6, 2024

IBM's workhorse code model (family spans 3B-34B) trained on 116 languages; now deprecated in favor of newer Granite releases.

ReasoningCodingVisionFunction callingTool useAgentic
296.4
Elo · unrated
Parameters
8B
Active params
8B (dense)
Context
4K tokens
Architecture
Dense decoder-only transformer
License
Apache 2.0
Languages
—
API price (in/out)
No hosted API
Modalities
text
Benchmark results
Bar shows position within the tracked field; marker = field best
BFCLAgents60.8%#26
best: SmolLM3 3B (No Thinking) · 92.3%
HumanEvalCoding49.6%#125
best: Claude Opus 4.5 · 99.4%
Run it locally
VRAM @ Q4
4.6 GB
VRAM @ FP16
16 GB
Fits on (Q4)
RTX 3060 12GBRTX 4070 Ti 16GBRTX 3090 24GBRTX 4090 24GBRTX 5090 32GBM4 Pro 48GBM3 Max 128GBM3 Ultra 512GBA100 80GBH100 80GBH200 141GBB200 192GB
Throughput data unavailable.
Quantizations
GGUF
Fine-tune it
Permissive
QLoRA7.0 GB1× RTX 3060 12GB
LoRA18.6 GB1× RTX 3090 24GB
Full fine-tune130.0 GB1× H200 141GB
QLoRA SFT on ~10k samples ≈ $4.68 (1× RTX 3060 12GB)
Plan a fine-tune →
Granite Code family
Elo progression across releases
Granite 34B Code InstructMay 2024424.5Granite 8B Code InstructMay 2024296.4
Resources
HFibm-granite/granite-8b-code-instruct-4kGHibm-granite/granite-code-modelsDOCSibm.com/granite/docs/models/code
API price weights · each benchmark row carries its own source badge (see methodology)