Quick start

ollama run granite4.2:latest

Runnable variants

Memory is a rough file-size estimate; context length, runtime and GPU offload change it.

12 of 49 matching variants shown.49 of 49 variants shown.

Tag	Type	Inputs	Digest	Download	Parameters	Quantization	Context	Est. memory	Run
30b	Typelocal	Inputstext	Digestbe22829aa92a	Download18 GB	Parameters30b	QuantizationUnknown	Context128K	Est. memory≈ 21.5 GB	`ollama run granite4.2:30b`
30b-bf16	Typelocal	Inputstext	Digestcdffb12cc8f4	Download45 GB	Parameters30b	QuantizationBF16	Context128K	Est. memory≈ 51.5 GB	`ollama run granite4.2:30b-bf16`
30b-q2_K	Typelocal	Inputstext	Digest2780f0bcdfc4	Download11 GB	Parameters30b	QuantizationQ2_K	Context128K	Est. memory≈ 13.5 GB	`ollama run granite4.2:30b-q2_K`
30b-q3_K_L	Typelocal	Inputstext	Digest77c0476600fd	Download15 GB	Parameters30b	QuantizationQ3_K_L	Context128K	Est. memory≈ 18 GB	`ollama run granite4.2:30b-q3_K_L`
30b-q3_K_M	Typelocal	Inputstext	Digestac6fd22e76bc	Download14 GB	Parameters30b	QuantizationQ3_K_M	Context128K	Est. memory≈ 17 GB	`ollama run granite4.2:30b-q3_K_M`
30b-q3_K_S	Typelocal	Inputstext	Digest6f2931d568a9	Download13 GB	Parameters30b	QuantizationQ3_K_S	Context128K	Est. memory≈ 16 GB	`ollama run granite4.2:30b-q3_K_S`
30b-q4_0	Typelocal	Inputstext	Digestedbb1b038ac2	Download17 GB	Parameters30b	QuantizationQ4_0	Context128K	Est. memory≈ 20 GB	`ollama run granite4.2:30b-q4_0`
30b-q4_1	Typelocal	Inputstext	Digest9a78f0c510d7	Download18 GB	Parameters30b	QuantizationQ4_1	Context128K	Est. memory≈ 21.5 GB	`ollama run granite4.2:30b-q4_1`
30b-q4_K_M	Typelocal	Inputstext	Digestbe22829aa92a	Download18 GB	Parameters30b	QuantizationQ4_K_M	Context128K	Est. memory≈ 21.5 GB	`ollama run granite4.2:30b-q4_K_M`
30b-q4_K_S	Typelocal	Inputstext	Digestabcb112a7a95	Download17 GB	Parameters30b	QuantizationQ4_K_S	Context128K	Est. memory≈ 20 GB	`ollama run granite4.2:30b-q4_K_S`
30b-q5_0	Typelocal	Inputstext	Digestb8023e8136fb	Download20 GB	Parameters30b	QuantizationQ5_0	Context128K	Est. memory≈ 23.5 GB	`ollama run granite4.2:30b-q5_0`
30b-q5_1	Typelocal	Inputstext	Digest2576fe18aa53	Download22 GB	Parameters30b	QuantizationQ5_1	Context128K	Est. memory≈ 26 GB	`ollama run granite4.2:30b-q5_1`
30b-q5_K_M	Typelocal	Inputstext	Digestc9ca8a38ab2a	Download21 GB	Parameters30b	QuantizationQ5_K_M	Context128K	Est. memory≈ 24.5 GB	`ollama run granite4.2:30b-q5_K_M`
30b-q5_K_S	Typelocal	Inputstext	Digeste7b6b56ce25c	Download20 GB	Parameters30b	QuantizationQ5_K_S	Context128K	Est. memory≈ 23.5 GB	`ollama run granite4.2:30b-q5_K_S`
30b-q6_K	Typelocal	Inputstext	Digest201f8e27f3c2	Download24 GB	Parameters30b	QuantizationQ6_K	Context128K	Est. memory≈ 28 GB	`ollama run granite4.2:30b-q6_K`
30b-q8_0	Typelocal	Inputstext	Digest3fafd190107e	Download31 GB	Parameters30b	QuantizationQ8_0	Context128K	Est. memory≈ 36 GB	`ollama run granite4.2:30b-q8_0`
3b	Typelocal	Inputstext	Digest40577dc168a3	Download2.2 GB	Parameters3b	QuantizationUnknown	Context128K	Est. memory≈ 3.5 GB	`ollama run granite4.2:3b`
3b-bf16	Typelocal	Inputstext	Digesta3001cc8a64f	Download7.3 GB	Parameters3b	QuantizationBF16	Context128K	Est. memory≈ 9.5 GB	`ollama run granite4.2:3b-bf16`
3b-q2_K	Typelocal	Inputstext	Digest21007f3e04e1	Download1.5 GB	Parameters3b	QuantizationQ2_K	Context128K	Est. memory≈ 3 GB	`ollama run granite4.2:3b-q2_K`
3b-q3_K_L	Typelocal	Inputstext	Digest92299e79879e	Download2.0 GB	Parameters3b	QuantizationQ3_K_L	Context128K	Est. memory≈ 3.5 GB	`ollama run granite4.2:3b-q3_K_L`
3b-q3_K_M	Typelocal	Inputstext	Digest37c1855f627f	Download1.8 GB	Parameters3b	QuantizationQ3_K_M	Context128K	Est. memory≈ 3.5 GB	`ollama run granite4.2:3b-q3_K_M`
3b-q3_K_S	Typelocal	Inputstext	Digestd1ad36607eac	Download1.7 GB	Parameters3b	QuantizationQ3_K_S	Context128K	Est. memory≈ 3 GB	`ollama run granite4.2:3b-q3_K_S`
3b-q4_0	Typelocal	Inputstext	Digestffe53a4441a1	Download2.1 GB	Parameters3b	QuantizationQ4_0	Context128K	Est. memory≈ 3.5 GB	`ollama run granite4.2:3b-q4_0`
3b-q4_1	Typelocal	Inputstext	Digest954511ce239c	Download2.3 GB	Parameters3b	QuantizationQ4_1	Context128K	Est. memory≈ 4 GB	`ollama run granite4.2:3b-q4_1`
3b-q4_K_M	Typelocal	Inputstext	Digest40577dc168a3	Download2.2 GB	Parameters3b	QuantizationQ4_K_M	Context128K	Est. memory≈ 3.5 GB	`ollama run granite4.2:3b-q4_K_M`
3b-q4_K_S	Typelocal	Inputstext	Digest4182b0b98b0e	Download2.1 GB	Parameters3b	QuantizationQ4_K_S	Context128K	Est. memory≈ 3.5 GB	`ollama run granite4.2:3b-q4_K_S`
3b-q5_0	Typelocal	Inputstext	Digestddbab3d2014a	Download2.6 GB	Parameters3b	QuantizationQ5_0	Context128K	Est. memory≈ 4 GB	`ollama run granite4.2:3b-q5_0`
3b-q5_1	Typelocal	Inputstext	Digest9e9e61dce423	Download2.8 GB	Parameters3b	QuantizationQ5_1	Context128K	Est. memory≈ 4.5 GB	`ollama run granite4.2:3b-q5_1`
3b-q5_K_M	Typelocal	Inputstext	Digest8a5cff2be752	Download2.6 GB	Parameters3b	QuantizationQ5_K_M	Context128K	Est. memory≈ 4 GB	`ollama run granite4.2:3b-q5_K_M`
3b-q5_K_S	Typelocal	Inputstext	Digest9ccbb8f64ae6	Download2.6 GB	Parameters3b	QuantizationQ5_K_S	Context128K	Est. memory≈ 4 GB	`ollama run granite4.2:3b-q5_K_S`
3b-q6_K	Typelocal	Inputstext	Digest6413701267c6	Download3.0 GB	Parameters3b	QuantizationQ6_K	Context128K	Est. memory≈ 4.5 GB	`ollama run granite4.2:3b-q6_K`
3b-q8_0	Typelocal	Inputstext	Digestf8163a0ed616	Download3.9 GB	Parameters3b	QuantizationQ8_0	Context128K	Est. memory≈ 5.5 GB	`ollama run granite4.2:3b-q8_0`
8b	Typelocal	Inputstext	Digestf586c02fdecd	Download5.3 GB	Parameters8b	QuantizationUnknown	Context128K	Est. memory≈ 7 GB	`ollama run granite4.2:8b`
8b-bf16	Typelocal	Inputstext	Digest6ec214bd57a2	Download18 GB	Parameters8b	QuantizationBF16	Context128K	Est. memory≈ 21.5 GB	`ollama run granite4.2:8b-bf16`
8b-q2_K	Typelocal	Inputstext	Digest67f03ef49c65	Download3.4 GB	Parameters8b	QuantizationQ2_K	Context128K	Est. memory≈ 5 GB	`ollama run granite4.2:8b-q2_K`
8b-q3_K_L	Typelocal	Inputstext	Digest418c3ffbe5f7	Download4.7 GB	Parameters8b	QuantizationQ3_K_L	Context128K	Est. memory≈ 6.5 GB	`ollama run granite4.2:8b-q3_K_L`
8b-q3_K_M	Typelocal	Inputstext	Digestde31561a84c0	Download4.3 GB	Parameters8b	QuantizationQ3_K_M	Context128K	Est. memory≈ 6 GB	`ollama run granite4.2:8b-q3_K_M`
8b-q3_K_S	Typelocal	Inputstext	Digest820e77415ef8	Download3.9 GB	Parameters8b	QuantizationQ3_K_S	Context128K	Est. memory≈ 5.5 GB	`ollama run granite4.2:8b-q3_K_S`
8b-q4_0	Typelocal	Inputstext	Digestd4259880557c	Download5.1 GB	Parameters8b	QuantizationQ4_0	Context128K	Est. memory≈ 7 GB	`ollama run granite4.2:8b-q4_0`
8b-q4_1	Typelocal	Inputstext	Digest187fee927aa0	Download5.6 GB	Parameters8b	QuantizationQ4_1	Context128K	Est. memory≈ 7.5 GB	`ollama run granite4.2:8b-q4_1`
8b-q4_K_M	Typelocal	Inputstext	Digestf586c02fdecd	Download5.3 GB	Parameters8b	QuantizationQ4_K_M	Context128K	Est. memory≈ 7 GB	`ollama run granite4.2:8b-q4_K_M`
8b-q4_K_S	Typelocal	Inputstext	Digestb6db325bf3af	Download5.1 GB	Parameters8b	QuantizationQ4_K_S	Context128K	Est. memory≈ 7 GB	`ollama run granite4.2:8b-q4_K_S`
8b-q5_0	Typelocal	Inputstext	Digestdf9cf32e33b0	Download6.1 GB	Parameters8b	QuantizationQ5_0	Context128K	Est. memory≈ 8 GB	`ollama run granite4.2:8b-q5_0`
8b-q5_1	Typelocal	Inputstext	Digestaee3affdbd31	Download6.6 GB	Parameters8b	QuantizationQ5_1	Context128K	Est. memory≈ 8.5 GB	`ollama run granite4.2:8b-q5_1`
8b-q5_K_M	Typelocal	Inputstext	Digest95568d24ff0d	Download6.3 GB	Parameters8b	QuantizationQ5_K_M	Context128K	Est. memory≈ 8.5 GB	`ollama run granite4.2:8b-q5_K_M`
8b-q5_K_S	Typelocal	Inputstext	Digest5556fb04e233	Download6.1 GB	Parameters8b	QuantizationQ5_K_S	Context128K	Est. memory≈ 8 GB	`ollama run granite4.2:8b-q5_K_S`
8b-q6_K	Typelocal	Inputstext	Digestcec7d398953f	Download7.2 GB	Parameters8b	QuantizationQ6_K	Context128K	Est. memory≈ 9.5 GB	`ollama run granite4.2:8b-q6_K`
8b-q8_0	Typelocal	Inputstext	Digest62837636dd31	Download9.3 GB	Parameters8b	QuantizationQ8_0	Context128K	Est. memory≈ 11.5 GB	`ollama run granite4.2:8b-q8_0`
latestdefault	Typelocal	Inputstext	Digestf586c02fdecd	Download5.3 GB	ParametersUnknown	QuantizationUnknown	Context128K	Est. memory≈ 7 GB	`ollama run granite4.2:latest`

Related models

moondreamlocal

moondream2 is a small vision language model designed to run efficiently on edge devices.

granite3.3local

IBM Granite 2B and 8B models are 128K context length language models that have been fine-tuned for improved reasoning and instruction-following capabilities.

granite3.2local

Granite-3.2 is a family of long-context AI models from IBM Granite fine-tuned for thinking capabilities.

exaone-deeplocal

EXAONE Deep exhibits superior capabilities in various reasoning tasks including math and coding benchmarks, ranging from 2.4B to 32B parameters developed and released by LG AI Research.