Quick start
ollama run granite3.1-dense:latestRunnable variants
Memory is a rough file-size estimate; context length, runtime and GPU offload change it.
12 of 33 matching variants shown.33 of 33 variants shown.
| Tag | Type | Inputs | Digest | Download | Parameters | Quantization | Context | Est. memory | Run |
|---|---|---|---|---|---|---|---|---|---|
| 2b | Typelocal | Inputstext | Digestfba1ad01113e | Download1.6 GB | Parameters2b | QuantizationUnknown | Context128K | Est. memory≈ 3 GB | ollama run granite3.1-dense:2b |
| 2b-instruct-fp16 | Typelocal | Inputstext | Digest1f64b4541957 | Download5.1 GB | Parameters2b | QuantizationFP16 | Context128K | Est. memory≈ 7 GB | ollama run granite3.1-dense:2b-instruct-fp16 |
| 2b-instruct-q2_K | Typelocal | Inputstext | Digestf412eb659c66 | Download1.0 GB | Parameters2b | QuantizationQ2_K | Context128K | Est. memory≈ 2.5 GB | ollama run granite3.1-dense:2b-instruct-q2_K |
| 2b-instruct-q3_K_L | Typelocal | Inputstext | Digest85ad99cb9a18 | Download1.4 GB | Parameters2b | QuantizationQ3_K_L | Context128K | Est. memory≈ 3 GB | ollama run granite3.1-dense:2b-instruct-q3_K_L |
| 2b-instruct-q3_K_M | Typelocal | Inputstext | Digestd65eb61a1e65 | Download1.3 GB | Parameters2b | QuantizationQ3_K_M | Context128K | Est. memory≈ 2.5 GB | ollama run granite3.1-dense:2b-instruct-q3_K_M |
| 2b-instruct-q3_K_S | Typelocal | Inputstext | Digest74791f52899c | Download1.2 GB | Parameters2b | QuantizationQ3_K_S | Context128K | Est. memory≈ 2.5 GB | ollama run granite3.1-dense:2b-instruct-q3_K_S |
| 2b-instruct-q4_0 | Typelocal | Inputstext | Digest7ed050a70760 | Download1.5 GB | Parameters2b | QuantizationQ4_0 | Context128K | Est. memory≈ 3 GB | ollama run granite3.1-dense:2b-instruct-q4_0 |
| 2b-instruct-q4_1 | Typelocal | Inputstext | Digestc265a649f4f8 | Download1.6 GB | Parameters2b | QuantizationQ4_1 | Context128K | Est. memory≈ 3 GB | ollama run granite3.1-dense:2b-instruct-q4_1 |
| 2b-instruct-q4_K_M | Typelocal | Inputstext | Digestfba1ad01113e | Download1.6 GB | Parameters2b | QuantizationQ4_K_M | Context128K | Est. memory≈ 3 GB | ollama run granite3.1-dense:2b-instruct-q4_K_M |
| 2b-instruct-q4_K_S | Typelocal | Inputstext | Digesta8d7602ade5f | Download1.5 GB | Parameters2b | QuantizationQ4_K_S | Context128K | Est. memory≈ 3 GB | ollama run granite3.1-dense:2b-instruct-q4_K_S |
| 2b-instruct-q5_0 | Typelocal | Inputstext | Digestf26890da1451 | Download1.8 GB | Parameters2b | QuantizationQ5_0 | Context128K | Est. memory≈ 3.5 GB | ollama run granite3.1-dense:2b-instruct-q5_0 |
| 2b-instruct-q5_1 | Typelocal | Inputstext | Digest35c067239cb5 | Download1.9 GB | Parameters2b | QuantizationQ5_1 | Context128K | Est. memory≈ 3.5 GB | ollama run granite3.1-dense:2b-instruct-q5_1 |
| 2b-instruct-q5_K_M | Typelocal | Inputstext | Digest86cdcdb94cd6 | Download1.8 GB | Parameters2b | QuantizationQ5_K_M | Context128K | Est. memory≈ 3.5 GB | ollama run granite3.1-dense:2b-instruct-q5_K_M |
| 2b-instruct-q5_K_S | Typelocal | Inputstext | Digest1a2b39f6e69c | Download1.8 GB | Parameters2b | QuantizationQ5_K_S | Context128K | Est. memory≈ 3.5 GB | ollama run granite3.1-dense:2b-instruct-q5_K_S |
| 2b-instruct-q6_K | Typelocal | Inputstext | Digest66d07595e1dc | Download2.1 GB | Parameters2b | QuantizationQ6_K | Context128K | Est. memory≈ 3.5 GB | ollama run granite3.1-dense:2b-instruct-q6_K |
| 2b-instruct-q8_0 | Typelocal | Inputstext | Digestef1441680161 | Download2.7 GB | Parameters2b | QuantizationQ8_0 | Context128K | Est. memory≈ 4.5 GB | ollama run granite3.1-dense:2b-instruct-q8_0 |
| 8b | Typelocal | Inputstext | Digest34d3be74ec54 | Download5.0 GB | Parameters8b | QuantizationUnknown | Context128K | Est. memory≈ 7 GB | ollama run granite3.1-dense:8b |
| 8b-instruct-fp16 | Typelocal | Inputstext | Digest51d4ae6e2b23 | Download16 GB | Parameters8b | QuantizationFP16 | Context128K | Est. memory≈ 19 GB | ollama run granite3.1-dense:8b-instruct-fp16 |
| 8b-instruct-q2_K | Typelocal | Inputstext | Digest4b18119a5086 | Download3.2 GB | Parameters8b | QuantizationQ2_K | Context128K | Est. memory≈ 5 GB | ollama run granite3.1-dense:8b-instruct-q2_K |
| 8b-instruct-q3_K_L | Typelocal | Inputstext | Digest8f28ec28aafc | Download4.4 GB | Parameters8b | QuantizationQ3_K_L | Context128K | Est. memory≈ 6 GB | ollama run granite3.1-dense:8b-instruct-q3_K_L |
| 8b-instruct-q3_K_M | Typelocal | Inputstext | Digest0dc5c3ac8a1e | Download4.0 GB | Parameters8b | QuantizationQ3_K_M | Context128K | Est. memory≈ 5.5 GB | ollama run granite3.1-dense:8b-instruct-q3_K_M |
| 8b-instruct-q3_K_S | Typelocal | Inputstext | Digest338340c340cb | Download3.6 GB | Parameters8b | QuantizationQ3_K_S | Context128K | Est. memory≈ 5.5 GB | ollama run granite3.1-dense:8b-instruct-q3_K_S |
| 8b-instruct-q4_0 | Typelocal | Inputstext | Digestfc2c18155205 | Download4.7 GB | Parameters8b | QuantizationQ4_0 | Context128K | Est. memory≈ 6.5 GB | ollama run granite3.1-dense:8b-instruct-q4_0 |
| 8b-instruct-q4_1 | Typelocal | Inputstext | Digesta94882d992cf | Download5.2 GB | Parameters8b | QuantizationQ4_1 | Context128K | Est. memory≈ 7 GB | ollama run granite3.1-dense:8b-instruct-q4_1 |
| 8b-instruct-q4_K_M | Typelocal | Inputstext | Digest34d3be74ec54 | Download5.0 GB | Parameters8b | QuantizationQ4_K_M | Context128K | Est. memory≈ 7 GB | ollama run granite3.1-dense:8b-instruct-q4_K_M |
| 8b-instruct-q4_K_S | Typelocal | Inputstext | Digest4707086b3bed | Download4.7 GB | Parameters8b | QuantizationQ4_K_S | Context128K | Est. memory≈ 6.5 GB | ollama run granite3.1-dense:8b-instruct-q4_K_S |
| 8b-instruct-q5_0 | Typelocal | Inputstext | Digest3ec7544ebcb8 | Download5.7 GB | Parameters8b | QuantizationQ5_0 | Context128K | Est. memory≈ 7.5 GB | ollama run granite3.1-dense:8b-instruct-q5_0 |
| 8b-instruct-q5_1 | Typelocal | Inputstext | Digest5f3faea362a7 | Download6.2 GB | Parameters8b | QuantizationQ5_1 | Context128K | Est. memory≈ 8 GB | ollama run granite3.1-dense:8b-instruct-q5_1 |
| 8b-instruct-q5_K_M | Typelocal | Inputstext | Digest4ae40e965ca7 | Download5.8 GB | Parameters8b | QuantizationQ5_K_M | Context128K | Est. memory≈ 7.5 GB | ollama run granite3.1-dense:8b-instruct-q5_K_M |
| 8b-instruct-q5_K_S | Typelocal | Inputstext | Digest8c98cd3dd70e | Download5.7 GB | Parameters8b | QuantizationQ5_K_S | Context128K | Est. memory≈ 7.5 GB | ollama run granite3.1-dense:8b-instruct-q5_K_S |
| 8b-instruct-q6_K | Typelocal | Inputstext | Digest8e5691d17175 | Download6.8 GB | Parameters8b | QuantizationQ6_K | Context128K | Est. memory≈ 9 GB | ollama run granite3.1-dense:8b-instruct-q6_K |
| 8b-instruct-q8_0 | Typelocal | Inputstext | Digestfd5499afc361 | Download8.7 GB | Parameters8b | QuantizationQ8_0 | Context128K | Est. memory≈ 11 GB | ollama run granite3.1-dense:8b-instruct-q8_0 |
| latestdefault | Typelocal | Inputstext | Digest34d3be74ec54 | Download5.0 GB | ParametersUnknown | QuantizationUnknown | Context128K | Est. memory≈ 7 GB | ollama run granite3.1-dense:latest |
Source-listed applications
Claude CodeHermes AgentOpenClawOpenCode
Related models
qwen3.5local
Qwen 3.5 is a family of open-source multimodal models that delivers exceptional utility and performance.
granite3-denselocal
The IBM Granite 2B and 8B models are designed to support tool-based use cases and support for retrieval augmented generation (RAG), streamlining code generation, translation and bug fixing.
bonsai-2local
Bonsai 2 from Prism ML is a family of vision models built for ternary weights – smaller models with close to full-precision quality.
deepseek-r1local
DeepSeek-R1 is a family of open reasoning models with performance approaching that of leading models, such as O3 and Gemini 2.5 Pro.