Model

Granite 3.3 8B Instruct

OPEN

IBM · Granite 3.3 family · released Apr 16, 2025

Adds fill-in-the-middle code generation and stronger math/symbolic reasoning; shipped alongside IBM's Granite Speech 3.3 8B speech-to-text model.

ReasoningCodingVisionFunction callingTool useAgentic

746.5

Elo · rank #260

Parameters

8.1B

Active params

8.1B (dense)

Context

128K tokens

Architecture

Dense decoder-only transformer with fill-in-the-middle code training and think/response tags

License

Apache 2.0

Languages

12+

API price (in/out)

No hosted API

Modalities

text

Benchmark results

Bar shows position within the tracked field; marker = field best

AIMEMath8.1%#149

best: GPT-5.2 · 100.0%

AlpacaEvalHuman preference62.7%#11

best: Tülu 2+DPO 70B · 95.1%

Arena-HardHuman preference57.6%#39

best: Qwen3-235B-A22B (Non-Thinking) · 96.1%

BIG-Bench HardReasoning69.1%#61

best: ERNIE 4.5 300B-A47B · 94.3%

DROPReasoning59.36#51

best: Hunyuan-T1 · 93.1

GSM8KMath80.9%#79

best: Llama 3.1 405B · 96.8%

HumanEval+Coding86.1%#9

best: Mistral Small 3.2 (24B) · 92.9%

HumanEvalCoding89.7%#19

best: Claude Opus 4.5 · 99.4%

IFEvalReasoning74.8%#105

best: Gemma 4 26B A4B · 98.5%

MATH-500Math69.0%#98

best: GPT-5 · 99.4%

MMLUKnowledge65.5%#174

best: OpenAI o3 · 92.9%

TruthfulQAKnowledge66.9%#10

best: Phi-3.5-MoE (16x3.8B, 6.6B active) · 77.5%

Run it locally

VRAM @ Q4

6 GB

VRAM @ FP16

16.2 GB

Fits on (Q4)

RTX 3060 12GBRTX 4070 Ti 16GBRTX 3090 24GBRTX 4090 24GBRTX 5090 32GBM4 Pro 48GBM3 Max 128GBM3 Ultra 512GBA100 80GBH100 80GBH200 141GBB200 192GB

Throughput data unavailable.

Quantizations

GGUF Q4_K_M · AWQ · GPTQ

Granite 3.3 family

Elo progression across releases

Granite 3.3 8B InstructApr 2025746.5

Resources

HFibm-granite/granite-3.3-8b-instruct GHibm-granite/granite-3.3-language-models DOCSibm.com/granite/docs/models/granite APIAvailable via IBM API

API price weights · each benchmark row carries its own source badge (see methodology)