Quick start

ollama run granite3.1-moe:latest

Runnable variants

Memory is a rough file-size estimate; context length, runtime and GPU offload change it.

12 of 33 matching variants shown.33 of 33 variants shown.

Tag	Type	Inputs	Digest	Download	Parameters	Quantization	Context	Est. memory	Run
1b	Typelocal	Inputstext	Digest3269ce3e31ea	Download1.4 GB	Parameters1b	QuantizationUnknown	Context128K	Est. memory≈ 3 GB	`ollama run granite3.1-moe:1b`
1b-instruct-fp16	Typelocal	Inputstext	Digest99904f51aa5c	Download2.7 GB	Parameters1b	QuantizationFP16	Context128K	Est. memory≈ 4.5 GB	`ollama run granite3.1-moe:1b-instruct-fp16`
1b-instruct-q2_K	Typelocal	Inputstext	Digest6521a8fa2f7d	Download524 MB	Parameters1b	QuantizationQ2_K	Context128K	Est. memory≈ 2 GB	`ollama run granite3.1-moe:1b-instruct-q2_K`
1b-instruct-q3_K_L	Typelocal	Inputstext	Digest38e819bae7cb	Download724 MB	Parameters1b	QuantizationQ3_K_L	Context128K	Est. memory≈ 2 GB	`ollama run granite3.1-moe:1b-instruct-q3_K_L`
1b-instruct-q3_K_M	Typelocal	Inputstext	Digesta9921af691fb	Download671 MB	Parameters1b	QuantizationQ3_K_M	Context128K	Est. memory≈ 2 GB	`ollama run granite3.1-moe:1b-instruct-q3_K_M`
1b-instruct-q3_K_S	Typelocal	Inputstext	Digestc81277fe1196	Download610 MB	Parameters1b	QuantizationQ3_K_S	Context128K	Est. memory≈ 2 GB	`ollama run granite3.1-moe:1b-instruct-q3_K_S`
1b-instruct-q4_0	Typelocal	Inputstext	Digestf1e180ae50b0	Download781 MB	Parameters1b	QuantizationQ4_0	Context128K	Est. memory≈ 2 GB	`ollama run granite3.1-moe:1b-instruct-q4_0`
1b-instruct-q4_1	Typelocal	Inputstext	Digestd62c69d05bc9	Download861 MB	Parameters1b	QuantizationQ4_1	Context128K	Est. memory≈ 2 GB	`ollama run granite3.1-moe:1b-instruct-q4_1`
1b-instruct-q4_K_M	Typelocal	Inputstext	Digestf825ee9e296f	Download834 MB	Parameters1b	QuantizationQ4_K_M	Context128K	Est. memory≈ 2 GB	`ollama run granite3.1-moe:1b-instruct-q4_K_M`
1b-instruct-q4_K_S	Typelocal	Inputstext	Digest531849afb99e	Download787 MB	Parameters1b	QuantizationQ4_K_S	Context128K	Est. memory≈ 2 GB	`ollama run granite3.1-moe:1b-instruct-q4_K_S`
1b-instruct-q5_0	Typelocal	Inputstext	Digest3d8012283ac9	Download941 MB	Parameters1b	QuantizationQ5_0	Context128K	Est. memory≈ 2.5 GB	`ollama run granite3.1-moe:1b-instruct-q5_0`
1b-instruct-q5_1	Typelocal	Inputstext	Digest39b91d40cf9e	Download1.0 GB	Parameters1b	QuantizationQ5_1	Context128K	Est. memory≈ 2.5 GB	`ollama run granite3.1-moe:1b-instruct-q5_1`
1b-instruct-q5_K_M	Typelocal	Inputstext	Digest6c0ad5f8dbc5	Download969 MB	Parameters1b	QuantizationQ5_K_M	Context128K	Est. memory≈ 2.5 GB	`ollama run granite3.1-moe:1b-instruct-q5_K_M`
1b-instruct-q5_K_S	Typelocal	Inputstext	Digestfcc3d042cf51	Download941 MB	Parameters1b	QuantizationQ5_K_S	Context128K	Est. memory≈ 2.5 GB	`ollama run granite3.1-moe:1b-instruct-q5_K_S`
1b-instruct-q6_K	Typelocal	Inputstext	Digest72cde855354e	Download1.1 GB	Parameters1b	QuantizationQ6_K	Context128K	Est. memory≈ 2.5 GB	`ollama run granite3.1-moe:1b-instruct-q6_K`
1b-instruct-q8_0	Typelocal	Inputstext	Digest3269ce3e31ea	Download1.4 GB	Parameters1b	QuantizationQ8_0	Context128K	Est. memory≈ 3 GB	`ollama run granite3.1-moe:1b-instruct-q8_0`
3b	Typelocal	Inputstext	Digestb43d80d7fca7	Download2.0 GB	Parameters3b	QuantizationUnknown	Context128K	Est. memory≈ 3.5 GB	`ollama run granite3.1-moe:3b`
3b-instruct-fp16	Typelocal	Inputstext	Digestcdedb7e7b102	Download6.6 GB	Parameters3b	QuantizationFP16	Context128K	Est. memory≈ 8.5 GB	`ollama run granite3.1-moe:3b-instruct-fp16`
3b-instruct-q2_K	Typelocal	Inputstext	Digest7ea974a9d11f	Download1.3 GB	Parameters3b	QuantizationQ2_K	Context128K	Est. memory≈ 2.5 GB	`ollama run granite3.1-moe:3b-instruct-q2_K`
3b-instruct-q3_K_L	Typelocal	Inputstext	Digest712573071d24	Download1.8 GB	Parameters3b	QuantizationQ3_K_L	Context128K	Est. memory≈ 3.5 GB	`ollama run granite3.1-moe:3b-instruct-q3_K_L`
3b-instruct-q3_K_M	Typelocal	Inputstext	Digest216dcd8f0222	Download1.6 GB	Parameters3b	QuantizationQ3_K_M	Context128K	Est. memory≈ 3 GB	`ollama run granite3.1-moe:3b-instruct-q3_K_M`
3b-instruct-q3_K_S	Typelocal	Inputstext	Digest86de476c2ed2	Download1.5 GB	Parameters3b	QuantizationQ3_K_S	Context128K	Est. memory≈ 3 GB	`ollama run granite3.1-moe:3b-instruct-q3_K_S`
3b-instruct-q4_0	Typelocal	Inputstext	Digest575c94ea9f74	Download1.9 GB	Parameters3b	QuantizationQ4_0	Context128K	Est. memory≈ 3.5 GB	`ollama run granite3.1-moe:3b-instruct-q4_0`
3b-instruct-q4_1	Typelocal	Inputstext	Digesta4c8618969bb	Download2.1 GB	Parameters3b	QuantizationQ4_1	Context128K	Est. memory≈ 3.5 GB	`ollama run granite3.1-moe:3b-instruct-q4_1`
3b-instruct-q4_K_M	Typelocal	Inputstext	Digestb43d80d7fca7	Download2.0 GB	Parameters3b	QuantizationQ4_K_M	Context128K	Est. memory≈ 3.5 GB	`ollama run granite3.1-moe:3b-instruct-q4_K_M`
3b-instruct-q4_K_S	Typelocal	Inputstext	Digest71da5b32c299	Download1.9 GB	Parameters3b	QuantizationQ4_K_S	Context128K	Est. memory≈ 3.5 GB	`ollama run granite3.1-moe:3b-instruct-q4_K_S`
3b-instruct-q5_0	Typelocal	Inputstext	Digestac1c3501f148	Download2.3 GB	Parameters3b	QuantizationQ5_0	Context128K	Est. memory≈ 4 GB	`ollama run granite3.1-moe:3b-instruct-q5_0`
3b-instruct-q5_1	Typelocal	Inputstext	Digest14ba2faee6e3	Download2.5 GB	Parameters3b	QuantizationQ5_1	Context128K	Est. memory≈ 4 GB	`ollama run granite3.1-moe:3b-instruct-q5_1`
3b-instruct-q5_K_M	Typelocal	Inputstext	Digestfac03e34e804	Download2.4 GB	Parameters3b	QuantizationQ5_K_M	Context128K	Est. memory≈ 4 GB	`ollama run granite3.1-moe:3b-instruct-q5_K_M`
3b-instruct-q5_K_S	Typelocal	Inputstext	Digestec25600ae9c5	Download2.3 GB	Parameters3b	QuantizationQ5_K_S	Context128K	Est. memory≈ 4 GB	`ollama run granite3.1-moe:3b-instruct-q5_K_S`
3b-instruct-q6_K	Typelocal	Inputstext	Digestb49c14c5cac4	Download2.7 GB	Parameters3b	QuantizationQ6_K	Context128K	Est. memory≈ 4.5 GB	`ollama run granite3.1-moe:3b-instruct-q6_K`
3b-instruct-q8_0	Typelocal	Inputstext	Digest038f46903bbd	Download3.5 GB	Parameters3b	QuantizationQ8_0	Context128K	Est. memory≈ 5 GB	`ollama run granite3.1-moe:3b-instruct-q8_0`
latestdefault	Typelocal	Inputstext	Digestb43d80d7fca7	Download2.0 GB	ParametersUnknown	QuantizationUnknown	Context128K	Est. memory≈ 3.5 GB	`ollama run granite3.1-moe:latest`

Source-listed applications

Claude CodeHermes AgentOpenClawOpenCode

Related models

qwen3local

Qwen3 is the latest generation of large language models in Qwen series, offering a comprehensive suite of dense and mixture-of-experts (MoE) models.

granite3-moelocal

The IBM Granite 1B and 3B models are the first mixture of experts (MoE) Granite models from IBM designed for low latency usage.

llama3.2local

Meta's Llama 3.2 goes small with 1B and 3B models.

lfm2.5-thinkinglocal

LFM2.5 is a new family of hybrid models designed for on-device deployment.