Quick start

ollama run granite4:latest

Runnable variants

Memory is a rough file-size estimate; context length, runtime and GPU offload change it.

12 of 17 matching variants shown.17 of 17 variants shown.

Tag	Type	Inputs	Digest	Download	Parameters	Quantization	Context	Est. memory	Run
1b	Typelocal	Inputstext	Digest26e4cb132798	Download3.3 GB	Parameters1b	QuantizationUnknown	Context128K	Est. memory≈ 5 GB	`ollama run granite4:1b`
1b-bf16	Typelocal	Inputstext	Digest26e4cb132798	Download3.3 GB	Parameters1b	QuantizationBF16	Context128K	Est. memory≈ 5 GB	`ollama run granite4:1b-bf16`
1b-h	Typelocal	Inputstext	Digest7761ae79cab9	Download1.6 GB	Parameters1b	QuantizationUnknown	Context1M	Est. memory≈ 3 GB	`ollama run granite4:1b-h`
1b-h-q8_0	Typelocal	Inputstext	Digest7761ae79cab9	Download1.6 GB	Parameters1b	QuantizationQ8_0	Context1M	Est. memory≈ 3 GB	`ollama run granite4:1b-h-q8_0`
32b-a9b-h	Typelocal	Inputstext	Digest2f8a7367d441	Download19 GB	Parameters32b-a9b	QuantizationUnknown	Context1M	Est. memory≈ 22.5 GB	`ollama run granite4:32b-a9b-h`
350m	Typelocal	Inputstext	Digest5eee845b49c4	Download708 MB	Parameters350m	QuantizationUnknown	Context32K	Est. memory≈ 2 GB	`ollama run granite4:350m`
350m-bf16	Typelocal	Inputstext	Digest5eee845b49c4	Download708 MB	Parameters350m	QuantizationBF16	Context32K	Est. memory≈ 2 GB	`ollama run granite4:350m-bf16`
350m-h	Typelocal	Inputstext	Digest7145075ed3d6	Download366 MB	Parameters350m	QuantizationUnknown	Context1M	Est. memory≈ 1.5 GB	`ollama run granite4:350m-h`
350m-h-q8_0	Typelocal	Inputstext	Digest7145075ed3d6	Download366 MB	Parameters350m	QuantizationQ8_0	Context1M	Est. memory≈ 1.5 GB	`ollama run granite4:350m-h-q8_0`
3b	Typelocal	Inputstext	Digest89962fcc7523	Download2.1 GB	Parameters3b	QuantizationUnknown	Context128K	Est. memory≈ 3.5 GB	`ollama run granite4:3b`
3b-h	Typelocal	Inputstext	Digest076afb3855dc	Download1.9 GB	Parameters3b	QuantizationUnknown	Context1M	Est. memory≈ 3.5 GB	`ollama run granite4:3b-h`
7b-a1b-h	Typelocal	Inputstext	Digest566b725534ea	Download4.2 GB	Parameters7b-a1b	QuantizationUnknown	Context1M	Est. memory≈ 6 GB	`ollama run granite4:7b-a1b-h`
latestdefault	Typelocal	Inputstext	Digest4235724a127c	Download2.1 GB	ParametersUnknown	QuantizationUnknown	Context128K	Est. memory≈ 3.5 GB	`ollama run granite4:latest`
micro	Typelocal	Inputstext	Digest89962fcc7523	Download2.1 GB	ParametersUnknown	QuantizationUnknown	Context128K	Est. memory≈ 3.5 GB	`ollama run granite4:micro`
micro-h	Typelocal	Inputstext	Digest076afb3855dc	Download1.9 GB	ParametersUnknown	QuantizationUnknown	Context1M	Est. memory≈ 3.5 GB	`ollama run granite4:micro-h`
small-h	Typelocal	Inputstext	Digest2f8a7367d441	Download19 GB	ParametersUnknown	QuantizationUnknown	Context1M	Est. memory≈ 22.5 GB	`ollama run granite4:small-h`
tiny-h	Typelocal	Inputstext	Digest566b725534ea	Download4.2 GB	ParametersUnknown	QuantizationUnknown	Context1M	Est. memory≈ 6 GB	`ollama run granite4:tiny-h`

Source-listed applications

Claude CodeHermes AgentOpenClawOpenCode

Related models

qwen2.5local

Qwen2.5 models are pretrained on Alibaba's latest large-scale dataset, encompassing up to 18 trillion tokens. The model supports up to 128K tokens and has multilingual support.

qwen2.5-coderlocal

The latest series of Code-Specific Qwen models, with significant improvements in code generation, code reasoning, and code fixing.

qwen2local

Qwen2 is a new series of large language models from Alibaba group

granite3-moelocal

The IBM Granite 1B and 3B models are the first mixture of experts (MoE) Granite models from IBM designed for low latency usage.