Quick start

ollama run granite4.1:3b

Runnable variants

Memory is a rough file-size estimate; context length, runtime and GPU offload change it.

12 of 48 matching variants shown.48 of 48 variants shown.

Tag	Type	Inputs	Digest	Download	Parameters	Quantization	Context	Est. memory	Run
30b	Typelocal	Inputstext	Digest3f3e5df8a021	Download17 GB	Parameters30b	QuantizationUnknown	Context128K	Est. memory≈ 20 GB	`ollama run granite4.1:30b`
30b-bf16	Typelocal	Inputstext	Digeste2e7d6de1890	Download58 GB	Parameters30b	QuantizationBF16	Context128K	Est. memory≈ 66 GB	`ollama run granite4.1:30b-bf16`
30b-q2_K	Typelocal	Inputstext	Digestae1d684487df	Download11 GB	Parameters30b	QuantizationQ2_K	Context128K	Est. memory≈ 13.5 GB	`ollama run granite4.1:30b-q2_K`
30b-q3_K_L	Typelocal	Inputstext	Digest7c55609a16c7	Download15 GB	Parameters30b	QuantizationQ3_K_L	Context128K	Est. memory≈ 18 GB	`ollama run granite4.1:30b-q3_K_L`
30b-q3_K_M	Typelocal	Inputstext	Digest234006e86874	Download14 GB	Parameters30b	QuantizationQ3_K_M	Context128K	Est. memory≈ 17 GB	`ollama run granite4.1:30b-q3_K_M`
30b-q3_K_S	Typelocal	Inputstext	Digesta5eeaa67e5fd	Download13 GB	Parameters30b	QuantizationQ3_K_S	Context128K	Est. memory≈ 16 GB	`ollama run granite4.1:30b-q3_K_S`
30b-q4_0	Typelocal	Inputstext	Digest402200215ef1	Download16 GB	Parameters30b	QuantizationQ4_0	Context128K	Est. memory≈ 19 GB	`ollama run granite4.1:30b-q4_0`
30b-q4_1	Typelocal	Inputstext	Digest8f3b74ec031d	Download18 GB	Parameters30b	QuantizationQ4_1	Context128K	Est. memory≈ 21.5 GB	`ollama run granite4.1:30b-q4_1`
30b-q4_K_M	Typelocal	Inputstext	Digest3f3e5df8a021	Download17 GB	Parameters30b	QuantizationQ4_K_M	Context128K	Est. memory≈ 20 GB	`ollama run granite4.1:30b-q4_K_M`
30b-q4_K_S	Typelocal	Inputstext	Digest1cab6c5d975d	Download16 GB	Parameters30b	QuantizationQ4_K_S	Context128K	Est. memory≈ 19 GB	`ollama run granite4.1:30b-q4_K_S`
30b-q5_0	Typelocal	Inputstext	Digest9b8dca9cb9cb	Download20 GB	Parameters30b	QuantizationQ5_0	Context128K	Est. memory≈ 23.5 GB	`ollama run granite4.1:30b-q5_0`
30b-q5_1	Typelocal	Inputstext	Digest23203614f0e9	Download22 GB	Parameters30b	QuantizationQ5_1	Context128K	Est. memory≈ 26 GB	`ollama run granite4.1:30b-q5_1`
30b-q5_K_M	Typelocal	Inputstext	Digest454ddb5316f7	Download20 GB	Parameters30b	QuantizationQ5_K_M	Context128K	Est. memory≈ 23.5 GB	`ollama run granite4.1:30b-q5_K_M`
30b-q5_K_S	Typelocal	Inputstext	Digestf1fba10b6ca9	Download20 GB	Parameters30b	QuantizationQ5_K_S	Context128K	Est. memory≈ 23.5 GB	`ollama run granite4.1:30b-q5_K_S`
30b-q6_K	Typelocal	Inputstext	Digestd7711d853ce4	Download24 GB	Parameters30b	QuantizationQ6_K	Context128K	Est. memory≈ 28 GB	`ollama run granite4.1:30b-q6_K`
30b-q8_0	Typelocal	Inputstext	Digest0f7a2b54edab	Download31 GB	Parameters30b	QuantizationQ8_0	Context128K	Est. memory≈ 36 GB	`ollama run granite4.1:30b-q8_0`
3bdefault	Typelocal	Inputstext	Digest6fd349357287	Download2.1 GB	Parameters3b	QuantizationUnknown	Context128K	Est. memory≈ 3.5 GB	`ollama run granite4.1:3b`
3b-bf16	Typelocal	Inputstext	Digest517250fafa06	Download6.8 GB	Parameters3b	QuantizationBF16	Context128K	Est. memory≈ 9 GB	`ollama run granite4.1:3b-bf16`
3b-q2_K	Typelocal	Inputstext	Digest41d7e7e6dc59	Download1.4 GB	Parameters3b	QuantizationQ2_K	Context128K	Est. memory≈ 3 GB	`ollama run granite4.1:3b-q2_K`
3b-q3_K_L	Typelocal	Inputstext	Digesteb446378f84c	Download1.9 GB	Parameters3b	QuantizationQ3_K_L	Context128K	Est. memory≈ 3.5 GB	`ollama run granite4.1:3b-q3_K_L`
3b-q3_K_M	Typelocal	Inputstext	Digestbd72b20cd67b	Download1.7 GB	Parameters3b	QuantizationQ3_K_M	Context128K	Est. memory≈ 3 GB	`ollama run granite4.1:3b-q3_K_M`
3b-q3_K_S	Typelocal	Inputstext	Digest1daefd678dc8	Download1.6 GB	Parameters3b	QuantizationQ3_K_S	Context128K	Est. memory≈ 3 GB	`ollama run granite4.1:3b-q3_K_S`
3b-q4_0	Typelocal	Inputstext	Digest010f4b63e5f7	Download2.0 GB	Parameters3b	QuantizationQ4_0	Context128K	Est. memory≈ 3.5 GB	`ollama run granite4.1:3b-q4_0`
3b-q4_1	Typelocal	Inputstext	Digest53377988686e	Download2.2 GB	Parameters3b	QuantizationQ4_1	Context128K	Est. memory≈ 3.5 GB	`ollama run granite4.1:3b-q4_1`
3b-q4_K_M	Typelocal	Inputstext	Digest6fd349357287	Download2.1 GB	Parameters3b	QuantizationQ4_K_M	Context128K	Est. memory≈ 3.5 GB	`ollama run granite4.1:3b-q4_K_M`
3b-q4_K_S	Typelocal	Inputstext	Digestaaf53db81651	Download2.0 GB	Parameters3b	QuantizationQ4_K_S	Context128K	Est. memory≈ 3.5 GB	`ollama run granite4.1:3b-q4_K_S`
3b-q5_0	Typelocal	Inputstext	Digest655215522aaa	Download2.4 GB	Parameters3b	QuantizationQ5_0	Context128K	Est. memory≈ 4 GB	`ollama run granite4.1:3b-q5_0`
3b-q5_1	Typelocal	Inputstext	Digest7d0a195533f7	Download2.6 GB	Parameters3b	QuantizationQ5_1	Context128K	Est. memory≈ 4 GB	`ollama run granite4.1:3b-q5_1`
3b-q5_K_M	Typelocal	Inputstext	Digest5f9ff57bab32	Download2.4 GB	Parameters3b	QuantizationQ5_K_M	Context128K	Est. memory≈ 4 GB	`ollama run granite4.1:3b-q5_K_M`
3b-q5_K_S	Typelocal	Inputstext	Digestd671c6877cde	Download2.4 GB	Parameters3b	QuantizationQ5_K_S	Context128K	Est. memory≈ 4 GB	`ollama run granite4.1:3b-q5_K_S`
3b-q6_K	Typelocal	Inputstext	Digest3c142316f4cf	Download2.8 GB	Parameters3b	QuantizationQ6_K	Context128K	Est. memory≈ 4.5 GB	`ollama run granite4.1:3b-q6_K`
3b-q8_0	Typelocal	Inputstext	Digestf087f8b0712f	Download3.6 GB	Parameters3b	QuantizationQ8_0	Context128K	Est. memory≈ 5.5 GB	`ollama run granite4.1:3b-q8_0`
8b	Typelocal	Inputstext	Digest444af1c4b2fe	Download5.3 GB	Parameters8b	QuantizationUnknown	Context128K	Est. memory≈ 7 GB	`ollama run granite4.1:8b`
8b-bf16	Typelocal	Inputstext	Digestff2ca5247c31	Download18 GB	Parameters8b	QuantizationBF16	Context128K	Est. memory≈ 21.5 GB	`ollama run granite4.1:8b-bf16`
8b-q2_K	Typelocal	Inputstext	Digestccf96f3f0780	Download3.4 GB	Parameters8b	QuantizationQ2_K	Context128K	Est. memory≈ 5 GB	`ollama run granite4.1:8b-q2_K`
8b-q3_K_L	Typelocal	Inputstext	Digestd780c2e519e8	Download4.7 GB	Parameters8b	QuantizationQ3_K_L	Context128K	Est. memory≈ 6.5 GB	`ollama run granite4.1:8b-q3_K_L`
8b-q3_K_M	Typelocal	Inputstext	Digest11ec0ebc2697	Download4.3 GB	Parameters8b	QuantizationQ3_K_M	Context128K	Est. memory≈ 6 GB	`ollama run granite4.1:8b-q3_K_M`
8b-q3_K_S	Typelocal	Inputstext	Digesta6cf031b28f0	Download3.9 GB	Parameters8b	QuantizationQ3_K_S	Context128K	Est. memory≈ 5.5 GB	`ollama run granite4.1:8b-q3_K_S`
8b-q4_0	Typelocal	Inputstext	Digestd1ca2294e93a	Download5.1 GB	Parameters8b	QuantizationQ4_0	Context128K	Est. memory≈ 7 GB	`ollama run granite4.1:8b-q4_0`
8b-q4_1	Typelocal	Inputstext	Digestd2eb1c61fdae	Download5.6 GB	Parameters8b	QuantizationQ4_1	Context128K	Est. memory≈ 7.5 GB	`ollama run granite4.1:8b-q4_1`
8b-q4_K_M	Typelocal	Inputstext	Digest444af1c4b2fe	Download5.3 GB	Parameters8b	QuantizationQ4_K_M	Context128K	Est. memory≈ 7 GB	`ollama run granite4.1:8b-q4_K_M`
8b-q4_K_S	Typelocal	Inputstext	Digestf7082ba9a6e7	Download5.1 GB	Parameters8b	QuantizationQ4_K_S	Context128K	Est. memory≈ 7 GB	`ollama run granite4.1:8b-q4_K_S`
8b-q5_0	Typelocal	Inputstext	Digest4ac8c864384e	Download6.1 GB	Parameters8b	QuantizationQ5_0	Context128K	Est. memory≈ 8 GB	`ollama run granite4.1:8b-q5_0`
8b-q5_1	Typelocal	Inputstext	Digest88e9f3963ec8	Download6.6 GB	Parameters8b	QuantizationQ5_1	Context128K	Est. memory≈ 8.5 GB	`ollama run granite4.1:8b-q5_1`
8b-q5_K_M	Typelocal	Inputstext	Digesta15a247eea85	Download6.3 GB	Parameters8b	QuantizationQ5_K_M	Context128K	Est. memory≈ 8.5 GB	`ollama run granite4.1:8b-q5_K_M`
8b-q5_K_S	Typelocal	Inputstext	Digest3f290aa8867b	Download6.1 GB	Parameters8b	QuantizationQ5_K_S	Context128K	Est. memory≈ 8 GB	`ollama run granite4.1:8b-q5_K_S`
8b-q6_K	Typelocal	Inputstext	Digestcc47b04956a8	Download7.2 GB	Parameters8b	QuantizationQ6_K	Context128K	Est. memory≈ 9.5 GB	`ollama run granite4.1:8b-q6_K`
8b-q8_0	Typelocal	Inputstext	Digestee48dfe31954	Download9.3 GB	Parameters8b	QuantizationQ8_0	Context128K	Est. memory≈ 11.5 GB	`ollama run granite4.1:8b-q8_0`

Source-listed applications

Claude CodeHermes AgentOpenClawOpenCode

Related models

hermes3local

Hermes 3 is the latest version of the flagship Hermes series of LLMs by Nous Research

granite3.3local

IBM Granite 2B and 8B models are 128K context length language models that have been fine-tuned for improved reasoning and instruction-following capabilities.

granite3.2local

Granite-3.2 is a family of long-context AI models from IBM Granite fine-tuned for thinking capabilities.

deepseek-r1local

DeepSeek-R1 is a family of open reasoning models with performance approaching that of leading models, such as O3 and Gemini 2.5 Pro.