Quick start

ollama run granite4.1-guardian:8b

Runnable variants

Memory is a rough file-size estimate; context length, runtime and GPU offload change it.

12 of 16 matching variants shown.16 of 16 variants shown.

Tag	Type	Inputs	Digest	Download	Parameters	Quantization	Context	Est. memory	Run
8bdefault	Typelocal	Inputstext	Digestf82c0882cec1	Download6.9 GB	Parameters8b	QuantizationUnknown	Context128K	Est. memory≈ 9 GB	`ollama run granite4.1-guardian:8b`
8b-bf16	Typelocal	Inputstext	Digest554b81f96395	Download17 GB	Parameters8b	QuantizationBF16	Context128K	Est. memory≈ 20 GB	`ollama run granite4.1-guardian:8b-bf16`
8b-q2_K	Typelocal	Inputstext	Digest2c6ebdbc4c96	Download3.3 GB	Parameters8b	QuantizationQ2_K	Context128K	Est. memory≈ 5 GB	`ollama run granite4.1-guardian:8b-q2_K`
8b-q3_K_L	Typelocal	Inputstext	Digest364832eedf35	Download4.5 GB	Parameters8b	QuantizationQ3_K_L	Context128K	Est. memory≈ 6.5 GB	`ollama run granite4.1-guardian:8b-q3_K_L`
8b-q3_K_M	Typelocal	Inputstext	Digest4b56e240be8d	Download4.2 GB	Parameters8b	QuantizationQ3_K_M	Context128K	Est. memory≈ 6 GB	`ollama run granite4.1-guardian:8b-q3_K_M`
8b-q3_K_S	Typelocal	Inputstext	Digest474fe767d1ed	Download3.8 GB	Parameters8b	QuantizationQ3_K_S	Context128K	Est. memory≈ 5.5 GB	`ollama run granite4.1-guardian:8b-q3_K_S`
8b-q4_0	Typelocal	Inputstext	Digesta10286f69b99	Download4.8 GB	Parameters8b	QuantizationQ4_0	Context128K	Est. memory≈ 6.5 GB	`ollama run granite4.1-guardian:8b-q4_0`
8b-q4_1	Typelocal	Inputstext	Digest1be4061519d1	Download5.3 GB	Parameters8b	QuantizationQ4_1	Context128K	Est. memory≈ 7 GB	`ollama run granite4.1-guardian:8b-q4_1`
8b-q4_K_M	Typelocal	Inputstext	Digestc84f3ddf98bb	Download5.1 GB	Parameters8b	QuantizationQ4_K_M	Context128K	Est. memory≈ 7 GB	`ollama run granite4.1-guardian:8b-q4_K_M`
8b-q4_K_S	Typelocal	Inputstext	Digesta8736da3fe78	Download4.9 GB	Parameters8b	QuantizationQ4_K_S	Context128K	Est. memory≈ 6.5 GB	`ollama run granite4.1-guardian:8b-q4_K_S`
8b-q5_0	Typelocal	Inputstext	Digest0c7c74ffa2b8	Download5.8 GB	Parameters8b	QuantizationQ5_0	Context128K	Est. memory≈ 7.5 GB	`ollama run granite4.1-guardian:8b-q5_0`
8b-q5_1	Typelocal	Inputstext	Digest083543c1944b	Download6.3 GB	Parameters8b	QuantizationQ5_1	Context128K	Est. memory≈ 8.5 GB	`ollama run granite4.1-guardian:8b-q5_1`
8b-q5_K_M	Typelocal	Inputstext	Digestb06b03b262f4	Download6.0 GB	Parameters8b	QuantizationQ5_K_M	Context128K	Est. memory≈ 8 GB	`ollama run granite4.1-guardian:8b-q5_K_M`
8b-q5_K_S	Typelocal	Inputstext	Digesteabbd076be52	Download5.8 GB	Parameters8b	QuantizationQ5_K_S	Context128K	Est. memory≈ 7.5 GB	`ollama run granite4.1-guardian:8b-q5_K_S`
8b-q6_K	Typelocal	Inputstext	Digestf82c0882cec1	Download6.9 GB	Parameters8b	QuantizationQ6_K	Context128K	Est. memory≈ 9 GB	`ollama run granite4.1-guardian:8b-q6_K`
8b-q8_0	Typelocal	Inputstext	Digest3697077f3aa1	Download8.9 GB	Parameters8b	QuantizationQ8_0	Context128K	Est. memory≈ 11 GB	`ollama run granite4.1-guardian:8b-q8_0`

Source-listed applications

Claude CodeHermes AgentOpenClawOpenCode

Related models

olmo-3local

Olmo is a series of Open language models designed to enable the science of language models. These models are pre-trained on the Dolma 3 dataset and post-trained on the Dolci datasets.

lfm2.5local

LFM2.5-8B-A1B, an edge model built for fast, reliable tool calling on consumer hardware.

ornithlocal

A self-improving family of open-source models for agentic coding

qwen3-vllocal

The most powerful vision-language model in the Qwen model family to date.