Quick start
ollama run granite3.2:latestRunnable variants
Memory is a rough file-size estimate; context length, runtime and GPU offload change it.
9 of 9 matching variants shown.9 of 9 variants shown.
| Tag | Type | Inputs | Digest | Download | Parameters | Quantization | Context | Est. memory | Run |
|---|---|---|---|---|---|---|---|---|---|
| 2b | Typelocal | Inputstext | Digest9d79a41f2f75 | Download1.5 GB | Parameters2b | QuantizationUnknown | Context128K | Est. memory≈ 3 GB | ollama run granite3.2:2b |
| 2b-instruct-fp16 | Typelocal | Inputstext | Digestc86bd0b2f0bd | Download5.1 GB | Parameters2b | QuantizationFP16 | Context128K | Est. memory≈ 7 GB | ollama run granite3.2:2b-instruct-fp16 |
| 2b-instruct-q4_K_M | Typelocal | Inputstext | Digest9d79a41f2f75 | Download1.5 GB | Parameters2b | QuantizationQ4_K_M | Context128K | Est. memory≈ 3 GB | ollama run granite3.2:2b-instruct-q4_K_M |
| 2b-instruct-q8_0 | Typelocal | Inputstext | Digestf6f4d0d4b4fa | Download2.7 GB | Parameters2b | QuantizationQ8_0 | Context128K | Est. memory≈ 4.5 GB | ollama run granite3.2:2b-instruct-q8_0 |
| 8b | Typelocal | Inputstext | Digest9bcb3335083f | Download4.9 GB | Parameters8b | QuantizationUnknown | Context128K | Est. memory≈ 6.5 GB | ollama run granite3.2:8b |
| 8b-instruct-fp16 | Typelocal | Inputstext | Digestb9679f6ae759 | Download16 GB | Parameters8b | QuantizationFP16 | Context128K | Est. memory≈ 19 GB | ollama run granite3.2:8b-instruct-fp16 |
| 8b-instruct-q4_K_M | Typelocal | Inputstext | Digest9bcb3335083f | Download4.9 GB | Parameters8b | QuantizationQ4_K_M | Context128K | Est. memory≈ 6.5 GB | ollama run granite3.2:8b-instruct-q4_K_M |
| 8b-instruct-q8_0 | Typelocal | Inputstext | Digest1b54499df0ff | Download8.7 GB | Parameters8b | QuantizationQ8_0 | Context128K | Est. memory≈ 11 GB | ollama run granite3.2:8b-instruct-q8_0 |
| latestdefault | Typelocal | Inputstext | Digest9bcb3335083f | Download4.9 GB | ParametersUnknown | QuantizationUnknown | Context128K | Est. memory≈ 6.5 GB | ollama run granite3.2:latest |
Source-listed applications
Related models
IBM Granite 2B and 8B models are 128K context length language models that have been fine-tuned for improved reasoning and instruction-following capabilities.
Hermes 3 is the latest version of the flagship Hermes series of LLMs by Nous Research
IBM Granite Models are a family of enterprise-ready, open foundation models that support multilingual capabilities, coding, retrieval-augmented generation (RAG), tool use, and structured JSON output. Released under Apache 2.0 license.
GLM-OCR is a multimodal OCR model for complex document understanding, built on the GLM-V encoder–decoder architecture.