Quick start
ollama run granite-code:latestRunnable variants
Memory is a rough file-size estimate; context length, runtime and GPU offload change it.
12 of 162 matching variants shown.162 of 162 variants shown.
| Tag | Type | Inputs | Digest | Download | Parameters | Quantization | Context | Est. memory | Run |
|---|---|---|---|---|---|---|---|---|---|
| 20b | Typelocal | Inputstext | Digest59db7b531bb4 | Download12 GB | Parameters20b | QuantizationUnknown | Context8K | Est. memory≈ 14.5 GB | ollama run granite-code:20b |
| 20b-base | Typelocal | Inputstext | Digest8ab7e91e85ff | Download12 GB | Parameters20b | QuantizationUnknown | Context8K | Est. memory≈ 14.5 GB | ollama run granite-code:20b-base |
| 20b-base-fp16 | Typelocal | Inputstext | Digest30d0d41d27a1 | Download40 GB | Parameters20b | QuantizationFP16 | Context8K | Est. memory≈ 46 GB | ollama run granite-code:20b-base-fp16 |
| 20b-base-q2_K | Typelocal | Inputstext | Digest80e7dd534ffd | Download7.9 GB | Parameters20b | QuantizationQ2_K | Context8K | Est. memory≈ 10 GB | ollama run granite-code:20b-base-q2_K |
| 20b-base-q3_K_L | Typelocal | Inputstext | Digestd25be157479e | Download12 GB | Parameters20b | QuantizationQ3_K_L | Context8K | Est. memory≈ 14.5 GB | ollama run granite-code:20b-base-q3_K_L |
| 20b-base-q3_K_M | Typelocal | Inputstext | Digestc7252c0c6703 | Download11 GB | Parameters20b | QuantizationQ3_K_M | Context8K | Est. memory≈ 13.5 GB | ollama run granite-code:20b-base-q3_K_M |
| 20b-base-q3_K_S | Typelocal | Inputstext | Digest67f3e156f5ba | Download8.9 GB | Parameters20b | QuantizationQ3_K_S | Context8K | Est. memory≈ 11 GB | ollama run granite-code:20b-base-q3_K_S |
| 20b-base-q4_0 | Typelocal | Inputstext | Digest8ab7e91e85ff | Download12 GB | Parameters20b | QuantizationQ4_0 | Context8K | Est. memory≈ 14.5 GB | ollama run granite-code:20b-base-q4_0 |
| 20b-base-q4_1 | Typelocal | Inputstext | Digeste3a238721ec9 | Download13 GB | Parameters20b | QuantizationQ4_1 | Context8K | Est. memory≈ 16 GB | ollama run granite-code:20b-base-q4_1 |
| 20b-base-q4_K_M | Typelocal | Inputstext | Digest81b9da645827 | Download13 GB | Parameters20b | QuantizationQ4_K_M | Context8K | Est. memory≈ 16 GB | ollama run granite-code:20b-base-q4_K_M |
| 20b-base-q4_K_S | Typelocal | Inputstext | Digest850228967095 | Download12 GB | Parameters20b | QuantizationQ4_K_S | Context8K | Est. memory≈ 14.5 GB | ollama run granite-code:20b-base-q4_K_S |
| 20b-base-q5_0 | Typelocal | Inputstext | Digest0b840e35cc32 | Download14 GB | Parameters20b | QuantizationQ5_0 | Context8K | Est. memory≈ 17 GB | ollama run granite-code:20b-base-q5_0 |
| 20b-base-q5_1 | Typelocal | Inputstext | Digesta864d1a8a08a | Download15 GB | Parameters20b | QuantizationQ5_1 | Context8K | Est. memory≈ 18 GB | ollama run granite-code:20b-base-q5_1 |
| 20b-base-q5_K_M | Typelocal | Inputstext | Digestf036fe711fb1 | Download15 GB | Parameters20b | QuantizationQ5_K_M | Context8K | Est. memory≈ 18 GB | ollama run granite-code:20b-base-q5_K_M |
| 20b-base-q5_K_S | Typelocal | Inputstext | Digeste5bdfcf66c14 | Download14 GB | Parameters20b | QuantizationQ5_K_S | Context8K | Est. memory≈ 17 GB | ollama run granite-code:20b-base-q5_K_S |
| 20b-base-q6_K | Typelocal | Inputstext | Digesta655ca093ef3 | Download17 GB | Parameters20b | QuantizationQ6_K | Context8K | Est. memory≈ 20 GB | ollama run granite-code:20b-base-q6_K |
| 20b-base-q8_0 | Typelocal | Inputstext | Digestcaf48ed2d622 | Download21 GB | Parameters20b | QuantizationQ8_0 | Context8K | Est. memory≈ 24.5 GB | ollama run granite-code:20b-base-q8_0 |
| 20b-instruct | Typelocal | Inputstext | Digest59db7b531bb4 | Download12 GB | Parameters20b | QuantizationUnknown | Context8K | Est. memory≈ 14.5 GB | ollama run granite-code:20b-instruct |
| 20b-instruct-8k-fp16 | Typelocal | Inputstext | Digestbe2ec1259ab5 | Download40 GB | Parameters20b | QuantizationFP16 | Context8K | Est. memory≈ 46 GB | ollama run granite-code:20b-instruct-8k-fp16 |
| 20b-instruct-8k-q2_K | Typelocal | Inputstext | Digest4e3dff04ee5b | Download7.9 GB | Parameters20b | QuantizationQ2_K | Context8K | Est. memory≈ 10 GB | ollama run granite-code:20b-instruct-8k-q2_K |
| 20b-instruct-8k-q3_K_L | Typelocal | Inputstext | Digest4c929cf47a4e | Download12 GB | Parameters20b | QuantizationQ3_K_L | Context8K | Est. memory≈ 14.5 GB | ollama run granite-code:20b-instruct-8k-q3_K_L |
| 20b-instruct-8k-q3_K_M | Typelocal | Inputstext | Digest9a3be6de6096 | Download11 GB | Parameters20b | QuantizationQ3_K_M | Context8K | Est. memory≈ 13.5 GB | ollama run granite-code:20b-instruct-8k-q3_K_M |
| 20b-instruct-8k-q3_K_S | Typelocal | Inputstext | Digestcbd8989e4e53 | Download8.9 GB | Parameters20b | QuantizationQ3_K_S | Context8K | Est. memory≈ 11 GB | ollama run granite-code:20b-instruct-8k-q3_K_S |
| 20b-instruct-8k-q4_0 | Typelocal | Inputstext | Digest59db7b531bb4 | Download12 GB | Parameters20b | QuantizationQ4_0 | Context8K | Est. memory≈ 14.5 GB | ollama run granite-code:20b-instruct-8k-q4_0 |
| 20b-instruct-8k-q4_1 | Typelocal | Inputstext | Digest6e6ff60ff742 | Download13 GB | Parameters20b | QuantizationQ4_1 | Context8K | Est. memory≈ 16 GB | ollama run granite-code:20b-instruct-8k-q4_1 |
| 20b-instruct-8k-q4_K_M | Typelocal | Inputstext | Digest69917162166a | Download13 GB | Parameters20b | QuantizationQ4_K_M | Context8K | Est. memory≈ 16 GB | ollama run granite-code:20b-instruct-8k-q4_K_M |
| 20b-instruct-8k-q4_K_S | Typelocal | Inputstext | Digesta012104b6642 | Download12 GB | Parameters20b | QuantizationQ4_K_S | Context8K | Est. memory≈ 14.5 GB | ollama run granite-code:20b-instruct-8k-q4_K_S |
| 20b-instruct-8k-q5_0 | Typelocal | Inputstext | Digest4670ab1f3599 | Download14 GB | Parameters20b | QuantizationQ5_0 | Context8K | Est. memory≈ 17 GB | ollama run granite-code:20b-instruct-8k-q5_0 |
| 20b-instruct-8k-q5_1 | Typelocal | Inputstext | Digest0e1290bc14f7 | Download15 GB | Parameters20b | QuantizationQ5_1 | Context8K | Est. memory≈ 18 GB | ollama run granite-code:20b-instruct-8k-q5_1 |
| 20b-instruct-8k-q5_K_M | Typelocal | Inputstext | Digest0f7b0be5131a | Download15 GB | Parameters20b | QuantizationQ5_K_M | Context8K | Est. memory≈ 18 GB | ollama run granite-code:20b-instruct-8k-q5_K_M |
| 20b-instruct-8k-q5_K_S | Typelocal | Inputstext | Digestf9f9a21acb5f | Download14 GB | Parameters20b | QuantizationQ5_K_S | Context8K | Est. memory≈ 17 GB | ollama run granite-code:20b-instruct-8k-q5_K_S |
| 20b-instruct-8k-q6_K | Typelocal | Inputstext | Digesta6b84d465ddc | Download17 GB | Parameters20b | QuantizationQ6_K | Context8K | Est. memory≈ 20 GB | ollama run granite-code:20b-instruct-8k-q6_K |
| 20b-instruct-8k-q8_0 | Typelocal | Inputstext | Digestd0054322b45c | Download21 GB | Parameters20b | QuantizationQ8_0 | Context8K | Est. memory≈ 24.5 GB | ollama run granite-code:20b-instruct-8k-q8_0 |
| 20b-instruct-q2_K | Typelocal | Inputstext | Digestdec9b6ea432f | Download7.9 GB | Parameters20b | QuantizationQ2_K | Context8K | Est. memory≈ 10 GB | ollama run granite-code:20b-instruct-q2_K |
| 20b-instruct-q3_K_L | Typelocal | Inputstext | Digest461f5d8eba68 | Download12 GB | Parameters20b | QuantizationQ3_K_L | Context8K | Est. memory≈ 14.5 GB | ollama run granite-code:20b-instruct-q3_K_L |
| 20b-instruct-q3_K_M | Typelocal | Inputstext | Digest71837d435f0c | Download11 GB | Parameters20b | QuantizationQ3_K_M | Context8K | Est. memory≈ 13.5 GB | ollama run granite-code:20b-instruct-q3_K_M |
| 20b-instruct-q3_K_S | Typelocal | Inputstext | Digestc06f1e43b32b | Download8.9 GB | Parameters20b | QuantizationQ3_K_S | Context8K | Est. memory≈ 11 GB | ollama run granite-code:20b-instruct-q3_K_S |
| 20b-instruct-q4_0 | Typelocal | Inputstext | Digest31d8bc61e506 | Download12 GB | Parameters20b | QuantizationQ4_0 | Context8K | Est. memory≈ 14.5 GB | ollama run granite-code:20b-instruct-q4_0 |
| 20b-instruct-q4_1 | Typelocal | Inputstext | Digestf9efbe4f8959 | Download13 GB | Parameters20b | QuantizationQ4_1 | Context8K | Est. memory≈ 16 GB | ollama run granite-code:20b-instruct-q4_1 |
| 20b-instruct-q4_K_M | Typelocal | Inputstext | Digest47eeb409e478 | Download13 GB | Parameters20b | QuantizationQ4_K_M | Context8K | Est. memory≈ 16 GB | ollama run granite-code:20b-instruct-q4_K_M |
| 20b-instruct-q4_K_S | Typelocal | Inputstext | Digest644444b999f8 | Download12 GB | Parameters20b | QuantizationQ4_K_S | Context8K | Est. memory≈ 14.5 GB | ollama run granite-code:20b-instruct-q4_K_S |
| 20b-instruct-q5_0 | Typelocal | Inputstext | Digest5db756969808 | Download14 GB | Parameters20b | QuantizationQ5_0 | Context8K | Est. memory≈ 17 GB | ollama run granite-code:20b-instruct-q5_0 |
| 20b-instruct-q5_1 | Typelocal | Inputstext | Digest7b08c7a6dc75 | Download15 GB | Parameters20b | QuantizationQ5_1 | Context8K | Est. memory≈ 18 GB | ollama run granite-code:20b-instruct-q5_1 |
| 20b-instruct-q5_K_M | Typelocal | Inputstext | Digest818c70f50940 | Download15 GB | Parameters20b | QuantizationQ5_K_M | Context8K | Est. memory≈ 18 GB | ollama run granite-code:20b-instruct-q5_K_M |
| 20b-instruct-q5_K_S | Typelocal | Inputstext | Digestb5d7d53400a9 | Download14 GB | Parameters20b | QuantizationQ5_K_S | Context8K | Est. memory≈ 17 GB | ollama run granite-code:20b-instruct-q5_K_S |
| 20b-instruct-q6_K | Typelocal | Inputstext | Digestbd2f4bcf34bb | Download17 GB | Parameters20b | QuantizationQ6_K | Context8K | Est. memory≈ 20 GB | ollama run granite-code:20b-instruct-q6_K |
| 20b-instruct-q8_0 | Typelocal | Inputstext | Digestb10dca01d737 | Download21 GB | Parameters20b | QuantizationQ8_0 | Context8K | Est. memory≈ 24.5 GB | ollama run granite-code:20b-instruct-q8_0 |
| 34b | Typelocal | Inputstext | Digest4ce00960ca84 | Download19 GB | Parameters34b | QuantizationUnknown | Context8K | Est. memory≈ 22.5 GB | ollama run granite-code:34b |
| 34b-base | Typelocal | Inputstext | Digest42c7e6e2af53 | Download19 GB | Parameters34b | QuantizationUnknown | Context8K | Est. memory≈ 22.5 GB | ollama run granite-code:34b-base |
| 34b-base-q2_K | Typelocal | Inputstext | Digestc74c785f9aad | Download13 GB | Parameters34b | QuantizationQ2_K | Context8K | Est. memory≈ 16 GB | ollama run granite-code:34b-base-q2_K |
| 34b-base-q3_K_L | Typelocal | Inputstext | Digest7c99e42e5deb | Download20 GB | Parameters34b | QuantizationQ3_K_L | Context8K | Est. memory≈ 23.5 GB | ollama run granite-code:34b-base-q3_K_L |
| 34b-base-q3_K_M | Typelocal | Inputstext | Digest4485e027847c | Download18 GB | Parameters34b | QuantizationQ3_K_M | Context8K | Est. memory≈ 21.5 GB | ollama run granite-code:34b-base-q3_K_M |
| 34b-base-q3_K_S | Typelocal | Inputstext | Digest31de19958232 | Download15 GB | Parameters34b | QuantizationQ3_K_S | Context8K | Est. memory≈ 18 GB | ollama run granite-code:34b-base-q3_K_S |
| 34b-base-q4_0 | Typelocal | Inputstext | Digest42c7e6e2af53 | Download19 GB | Parameters34b | QuantizationQ4_0 | Context8K | Est. memory≈ 22.5 GB | ollama run granite-code:34b-base-q4_0 |
| 34b-base-q4_1 | Typelocal | Inputstext | Digest3770a699dae1 | Download21 GB | Parameters34b | QuantizationQ4_1 | Context8K | Est. memory≈ 24.5 GB | ollama run granite-code:34b-base-q4_1 |
| 34b-base-q4_K_M | Typelocal | Inputstext | Digestf4ad76c0503a | Download21 GB | Parameters34b | QuantizationQ4_K_M | Context8K | Est. memory≈ 24.5 GB | ollama run granite-code:34b-base-q4_K_M |
| 34b-base-q4_K_S | Typelocal | Inputstext | Digestd0fbbc626c30 | Download19 GB | Parameters34b | QuantizationQ4_K_S | Context8K | Est. memory≈ 22.5 GB | ollama run granite-code:34b-base-q4_K_S |
| 34b-base-q5_0 | Typelocal | Inputstext | Digestfb7a2b093c21 | Download23 GB | Parameters34b | QuantizationQ5_0 | Context8K | Est. memory≈ 27 GB | ollama run granite-code:34b-base-q5_0 |
| 34b-base-q5_1 | Typelocal | Inputstext | Digest0d64b22fd447 | Download25 GB | Parameters34b | QuantizationQ5_1 | Context8K | Est. memory≈ 29 GB | ollama run granite-code:34b-base-q5_1 |
| 34b-base-q5_K_M | Typelocal | Inputstext | Digest3da71b98ed2b | Download25 GB | Parameters34b | QuantizationQ5_K_M | Context8K | Est. memory≈ 29 GB | ollama run granite-code:34b-base-q5_K_M |
| 34b-base-q5_K_S | Typelocal | Inputstext | Digestc5afa738c212 | Download23 GB | Parameters34b | QuantizationQ5_K_S | Context8K | Est. memory≈ 27 GB | ollama run granite-code:34b-base-q5_K_S |
| 34b-base-q6_K | Typelocal | Inputstext | Digestddf66982e605 | Download28 GB | Parameters34b | QuantizationQ6_K | Context8K | Est. memory≈ 32.5 GB | ollama run granite-code:34b-base-q6_K |
| 34b-base-q8_0 | Typelocal | Inputstext | Digesta1d04f60bc5e | Download36 GB | Parameters34b | QuantizationQ8_0 | Context8K | Est. memory≈ 41.5 GB | ollama run granite-code:34b-base-q8_0 |
| 34b-instruct | Typelocal | Inputstext | Digest4ce00960ca84 | Download19 GB | Parameters34b | QuantizationUnknown | Context8K | Est. memory≈ 22.5 GB | ollama run granite-code:34b-instruct |
| 34b-instruct-q2_K | Typelocal | Inputstext | Digestc74bd2d3910b | Download13 GB | Parameters34b | QuantizationQ2_K | Context8K | Est. memory≈ 16 GB | ollama run granite-code:34b-instruct-q2_K |
| 34b-instruct-q3_K_L | Typelocal | Inputstext | Digest51d4b46e9649 | Download20 GB | Parameters34b | QuantizationQ3_K_L | Context8K | Est. memory≈ 23.5 GB | ollama run granite-code:34b-instruct-q3_K_L |
| 34b-instruct-q3_K_M | Typelocal | Inputstext | Digest97d3df0a98fb | Download18 GB | Parameters34b | QuantizationQ3_K_M | Context8K | Est. memory≈ 21.5 GB | ollama run granite-code:34b-instruct-q3_K_M |
| 34b-instruct-q3_K_S | Typelocal | Inputstext | Digest941db8c58f05 | Download15 GB | Parameters34b | QuantizationQ3_K_S | Context8K | Est. memory≈ 18 GB | ollama run granite-code:34b-instruct-q3_K_S |
| 34b-instruct-q4_0 | Typelocal | Inputstext | Digest4ce00960ca84 | Download19 GB | Parameters34b | QuantizationQ4_0 | Context8K | Est. memory≈ 22.5 GB | ollama run granite-code:34b-instruct-q4_0 |
| 34b-instruct-q4_1 | Typelocal | Inputstext | Digesta1cca29491fd | Download21 GB | Parameters34b | QuantizationQ4_1 | Context8K | Est. memory≈ 24.5 GB | ollama run granite-code:34b-instruct-q4_1 |
| 34b-instruct-q4_K_M | Typelocal | Inputstext | Digest74723d97951a | Download21 GB | Parameters34b | QuantizationQ4_K_M | Context8K | Est. memory≈ 24.5 GB | ollama run granite-code:34b-instruct-q4_K_M |
| 34b-instruct-q4_K_S | Typelocal | Inputstext | Digest017ae7f3dba3 | Download19 GB | Parameters34b | QuantizationQ4_K_S | Context8K | Est. memory≈ 22.5 GB | ollama run granite-code:34b-instruct-q4_K_S |
| 34b-instruct-q5_0 | Typelocal | Inputstext | Digest4d276c35489e | Download23 GB | Parameters34b | QuantizationQ5_0 | Context8K | Est. memory≈ 27 GB | ollama run granite-code:34b-instruct-q5_0 |
| 34b-instruct-q5_1 | Typelocal | Inputstext | Digestf0004bc4aba0 | Download25 GB | Parameters34b | QuantizationQ5_1 | Context8K | Est. memory≈ 29 GB | ollama run granite-code:34b-instruct-q5_1 |
| 34b-instruct-q5_K_M | Typelocal | Inputstext | Digestdad8cb2d266e | Download25 GB | Parameters34b | QuantizationQ5_K_M | Context8K | Est. memory≈ 29 GB | ollama run granite-code:34b-instruct-q5_K_M |
| 34b-instruct-q5_K_S | Typelocal | Inputstext | Digestad33350a1e2c | Download23 GB | Parameters34b | QuantizationQ5_K_S | Context8K | Est. memory≈ 27 GB | ollama run granite-code:34b-instruct-q5_K_S |
| 34b-instruct-q6_K | Typelocal | Inputstext | Digestc71fa145605c | Download28 GB | Parameters34b | QuantizationQ6_K | Context8K | Est. memory≈ 32.5 GB | ollama run granite-code:34b-instruct-q6_K |
| 34b-instruct-q8_0 | Typelocal | Inputstext | Digestabc2bbc41ce5 | Download36 GB | Parameters34b | QuantizationQ8_0 | Context8K | Est. memory≈ 41.5 GB | ollama run granite-code:34b-instruct-q8_0 |
| 3b | Typelocal | Inputstext | Digestbecc94fe1876 | Download2.0 GB | Parameters3b | QuantizationUnknown | Context125K | Est. memory≈ 3.5 GB | ollama run granite-code:3b |
| 3b-base | Typelocal | Inputstext | Digest897c973ac371 | Download2.0 GB | Parameters3b | QuantizationUnknown | Context2K | Est. memory≈ 3.5 GB | ollama run granite-code:3b-base |
| 3b-base-fp16 | Typelocal | Inputstext | Digestc05254111c3b | Download7.0 GB | Parameters3b | QuantizationFP16 | Context2K | Est. memory≈ 9 GB | ollama run granite-code:3b-base-fp16 |
| 3b-base-q2_K | Typelocal | Inputstext | Digeste36887a9a821 | Download1.3 GB | Parameters3b | QuantizationQ2_K | Context2K | Est. memory≈ 2.5 GB | ollama run granite-code:3b-base-q2_K |
| 3b-base-q3_K_L | Typelocal | Inputstext | Digestefa391969797 | Download1.9 GB | Parameters3b | QuantizationQ3_K_L | Context2K | Est. memory≈ 3.5 GB | ollama run granite-code:3b-base-q3_K_L |
| 3b-base-q3_K_M | Typelocal | Inputstext | Digest6cd1bf544950 | Download1.7 GB | Parameters3b | QuantizationQ3_K_M | Context2K | Est. memory≈ 3 GB | ollama run granite-code:3b-base-q3_K_M |
| 3b-base-q3_K_S | Typelocal | Inputstext | Digest4ebfe349d653 | Download1.6 GB | Parameters3b | QuantizationQ3_K_S | Context2K | Est. memory≈ 3 GB | ollama run granite-code:3b-base-q3_K_S |
| 3b-base-q4_0 | Typelocal | Inputstext | Digest897c973ac371 | Download2.0 GB | Parameters3b | QuantizationQ4_0 | Context2K | Est. memory≈ 3.5 GB | ollama run granite-code:3b-base-q4_0 |
| 3b-base-q4_1 | Typelocal | Inputstext | Digest289762e9c2de | Download2.2 GB | Parameters3b | QuantizationQ4_1 | Context2K | Est. memory≈ 3.5 GB | ollama run granite-code:3b-base-q4_1 |
| 3b-base-q4_K_M | Typelocal | Inputstext | Digest074272cf1192 | Download2.1 GB | Parameters3b | QuantizationQ4_K_M | Context2K | Est. memory≈ 3.5 GB | ollama run granite-code:3b-base-q4_K_M |
| 3b-base-q4_K_S | Typelocal | Inputstext | Digest05d91372ce79 | Download2.0 GB | Parameters3b | QuantizationQ4_K_S | Context2K | Est. memory≈ 3.5 GB | ollama run granite-code:3b-base-q4_K_S |
| 3b-base-q5_0 | Typelocal | Inputstext | Digest564f8e0abfff | Download2.4 GB | Parameters3b | QuantizationQ5_0 | Context2K | Est. memory≈ 4 GB | ollama run granite-code:3b-base-q5_0 |
| 3b-base-q5_1 | Typelocal | Inputstext | Digestbdb3c9b7c5e4 | Download2.6 GB | Parameters3b | QuantizationQ5_1 | Context2K | Est. memory≈ 4 GB | ollama run granite-code:3b-base-q5_1 |
| 3b-base-q5_K_M | Typelocal | Inputstext | Digest9f543ec02c81 | Download2.5 GB | Parameters3b | QuantizationQ5_K_M | Context2K | Est. memory≈ 4 GB | ollama run granite-code:3b-base-q5_K_M |
| 3b-base-q5_K_S | Typelocal | Inputstext | Digestc2b4985e3261 | Download2.4 GB | Parameters3b | QuantizationQ5_K_S | Context2K | Est. memory≈ 4 GB | ollama run granite-code:3b-base-q5_K_S |
| 3b-base-q6_K | Typelocal | Inputstext | Digestef18db8d2afc | Download2.9 GB | Parameters3b | QuantizationQ6_K | Context2K | Est. memory≈ 4.5 GB | ollama run granite-code:3b-base-q6_K |
| 3b-base-q8_0 | Typelocal | Inputstext | Digestc3464b5e457a | Download3.7 GB | Parameters3b | QuantizationQ8_0 | Context2K | Est. memory≈ 5.5 GB | ollama run granite-code:3b-base-q8_0 |
| 3b-instruct | Typelocal | Inputstext | Digestbecc94fe1876 | Download2.0 GB | Parameters3b | QuantizationUnknown | Context125K | Est. memory≈ 3.5 GB | ollama run granite-code:3b-instruct |
| 3b-instruct-128k-fp16 | Typelocal | Inputstext | Digest0a85292e9c4c | Download7.0 GB | Parameters3b | QuantizationFP16 | Context125K | Est. memory≈ 9 GB | ollama run granite-code:3b-instruct-128k-fp16 |
| 3b-instruct-128k-q2_K | Typelocal | Inputstext | Digest72154d08acee | Download1.3 GB | Parameters3b | QuantizationQ2_K | Context125K | Est. memory≈ 2.5 GB | ollama run granite-code:3b-instruct-128k-q2_K |
| 3b-instruct-128k-q3_K_L | Typelocal | Inputstext | Digestc794c5813849 | Download1.9 GB | Parameters3b | QuantizationQ3_K_L | Context125K | Est. memory≈ 3.5 GB | ollama run granite-code:3b-instruct-128k-q3_K_L |
| 3b-instruct-128k-q3_K_M | Typelocal | Inputstext | Digest27350580d3ea | Download1.7 GB | Parameters3b | QuantizationQ3_K_M | Context125K | Est. memory≈ 3 GB | ollama run granite-code:3b-instruct-128k-q3_K_M |
| 3b-instruct-128k-q3_K_S | Typelocal | Inputstext | Digestc5827e0a7a55 | Download1.6 GB | Parameters3b | QuantizationQ3_K_S | Context125K | Est. memory≈ 3 GB | ollama run granite-code:3b-instruct-128k-q3_K_S |
| 3b-instruct-128k-q4_0 | Typelocal | Inputstext | Digestbecc94fe1876 | Download2.0 GB | Parameters3b | QuantizationQ4_0 | Context125K | Est. memory≈ 3.5 GB | ollama run granite-code:3b-instruct-128k-q4_0 |
| 3b-instruct-128k-q4_1 | Typelocal | Inputstext | Digest7e9329333607 | Download2.2 GB | Parameters3b | QuantizationQ4_1 | Context125K | Est. memory≈ 3.5 GB | ollama run granite-code:3b-instruct-128k-q4_1 |
| 3b-instruct-128k-q4_K_M | Typelocal | Inputstext | Digest4702f6327ab5 | Download2.1 GB | Parameters3b | QuantizationQ4_K_M | Context125K | Est. memory≈ 3.5 GB | ollama run granite-code:3b-instruct-128k-q4_K_M |
| 3b-instruct-128k-q4_K_S | Typelocal | Inputstext | Digesta6c4b37f0dc7 | Download2.0 GB | Parameters3b | QuantizationQ4_K_S | Context125K | Est. memory≈ 3.5 GB | ollama run granite-code:3b-instruct-128k-q4_K_S |
| 3b-instruct-128k-q5_0 | Typelocal | Inputstext | Digestdece491ce896 | Download2.4 GB | Parameters3b | QuantizationQ5_0 | Context125K | Est. memory≈ 4 GB | ollama run granite-code:3b-instruct-128k-q5_0 |
| 3b-instruct-128k-q5_1 | Typelocal | Inputstext | Digest275d6e2f4fcc | Download2.6 GB | Parameters3b | QuantizationQ5_1 | Context125K | Est. memory≈ 4 GB | ollama run granite-code:3b-instruct-128k-q5_1 |
| 3b-instruct-128k-q5_K_M | Typelocal | Inputstext | Digest39570a508075 | Download2.5 GB | Parameters3b | QuantizationQ5_K_M | Context125K | Est. memory≈ 4 GB | ollama run granite-code:3b-instruct-128k-q5_K_M |
| 3b-instruct-128k-q5_K_S | Typelocal | Inputstext | Digest07bebb9f1381 | Download2.4 GB | Parameters3b | QuantizationQ5_K_S | Context125K | Est. memory≈ 4 GB | ollama run granite-code:3b-instruct-128k-q5_K_S |
| 3b-instruct-128k-q6_K | Typelocal | Inputstext | Digestaac7fdd35a84 | Download2.9 GB | Parameters3b | QuantizationQ6_K | Context125K | Est. memory≈ 4.5 GB | ollama run granite-code:3b-instruct-128k-q6_K |
| 3b-instruct-128k-q8_0 | Typelocal | Inputstext | Digest3ffa9e883e62 | Download3.7 GB | Parameters3b | QuantizationQ8_0 | Context125K | Est. memory≈ 5.5 GB | ollama run granite-code:3b-instruct-128k-q8_0 |
| 3b-instruct-fp16 | Typelocal | Inputstext | Digest788453573810 | Download7.0 GB | Parameters3b | QuantizationFP16 | Context2K | Est. memory≈ 9 GB | ollama run granite-code:3b-instruct-fp16 |
| 3b-instruct-q2_K | Typelocal | Inputstext | Digest7f3ad6ca25f4 | Download1.3 GB | Parameters3b | QuantizationQ2_K | Context2K | Est. memory≈ 2.5 GB | ollama run granite-code:3b-instruct-q2_K |
| 3b-instruct-q3_K_L | Typelocal | Inputstext | Digestd9060e45c47c | Download1.9 GB | Parameters3b | QuantizationQ3_K_L | Context2K | Est. memory≈ 3.5 GB | ollama run granite-code:3b-instruct-q3_K_L |
| 3b-instruct-q3_K_M | Typelocal | Inputstext | Digest70ec21a3004e | Download1.7 GB | Parameters3b | QuantizationQ3_K_M | Context2K | Est. memory≈ 3 GB | ollama run granite-code:3b-instruct-q3_K_M |
| 3b-instruct-q3_K_S | Typelocal | Inputstext | Digest991c2ca80baf | Download1.6 GB | Parameters3b | QuantizationQ3_K_S | Context2K | Est. memory≈ 3 GB | ollama run granite-code:3b-instruct-q3_K_S |
| 3b-instruct-q4_0 | Typelocal | Inputstext | Digest63bedbdffbf0 | Download2.0 GB | Parameters3b | QuantizationQ4_0 | Context2K | Est. memory≈ 3.5 GB | ollama run granite-code:3b-instruct-q4_0 |
| 3b-instruct-q4_1 | Typelocal | Inputstext | Digest07c153ea8ba3 | Download2.2 GB | Parameters3b | QuantizationQ4_1 | Context2K | Est. memory≈ 3.5 GB | ollama run granite-code:3b-instruct-q4_1 |
| 3b-instruct-q4_K_M | Typelocal | Inputstext | Digest65861823ce7a | Download2.1 GB | Parameters3b | QuantizationQ4_K_M | Context2K | Est. memory≈ 3.5 GB | ollama run granite-code:3b-instruct-q4_K_M |
| 3b-instruct-q4_K_S | Typelocal | Inputstext | Digestc681b8a19c05 | Download2.0 GB | Parameters3b | QuantizationQ4_K_S | Context2K | Est. memory≈ 3.5 GB | ollama run granite-code:3b-instruct-q4_K_S |
| 3b-instruct-q5_0 | Typelocal | Inputstext | Digest8a64d99caa8b | Download2.4 GB | Parameters3b | QuantizationQ5_0 | Context2K | Est. memory≈ 4 GB | ollama run granite-code:3b-instruct-q5_0 |
| 3b-instruct-q5_1 | Typelocal | Inputstext | Digestc7b815a477d2 | Download2.6 GB | Parameters3b | QuantizationQ5_1 | Context2K | Est. memory≈ 4 GB | ollama run granite-code:3b-instruct-q5_1 |
| 3b-instruct-q5_K_M | Typelocal | Inputstext | Digest2db2e42160a0 | Download2.5 GB | Parameters3b | QuantizationQ5_K_M | Context2K | Est. memory≈ 4 GB | ollama run granite-code:3b-instruct-q5_K_M |
| 3b-instruct-q5_K_S | Typelocal | Inputstext | Digestc1cb0d4855f6 | Download2.4 GB | Parameters3b | QuantizationQ5_K_S | Context2K | Est. memory≈ 4 GB | ollama run granite-code:3b-instruct-q5_K_S |
| 3b-instruct-q6_K | Typelocal | Inputstext | Digestf9bad785d4c6 | Download2.9 GB | Parameters3b | QuantizationQ6_K | Context2K | Est. memory≈ 4.5 GB | ollama run granite-code:3b-instruct-q6_K |
| 3b-instruct-q8_0 | Typelocal | Inputstext | Digestb93b1a15197d | Download3.7 GB | Parameters3b | QuantizationQ8_0 | Context2K | Est. memory≈ 5.5 GB | ollama run granite-code:3b-instruct-q8_0 |
| 8b | Typelocal | Inputstext | Digest36c3c3b9683b | Download4.6 GB | Parameters8b | QuantizationUnknown | Context125K | Est. memory≈ 6.5 GB | ollama run granite-code:8b |
| 8b-base | Typelocal | Inputstext | Digest446b079c08d8 | Download4.6 GB | Parameters8b | QuantizationUnknown | Context4K | Est. memory≈ 6.5 GB | ollama run granite-code:8b-base |
| 8b-base-fp16 | Typelocal | Inputstext | Digestb9ad7693117c | Download16 GB | Parameters8b | QuantizationFP16 | Context4K | Est. memory≈ 19 GB | ollama run granite-code:8b-base-fp16 |
| 8b-base-q2_K | Typelocal | Inputstext | Digeste63080a27380 | Download3.1 GB | Parameters8b | QuantizationQ2_K | Context4K | Est. memory≈ 4.5 GB | ollama run granite-code:8b-base-q2_K |
| 8b-base-q3_K_L | Typelocal | Inputstext | Digest3e786e80fe43 | Download4.3 GB | Parameters8b | QuantizationQ3_K_L | Context4K | Est. memory≈ 6 GB | ollama run granite-code:8b-base-q3_K_L |
| 8b-base-q3_K_M | Typelocal | Inputstext | Digestca4d1a480357 | Download3.9 GB | Parameters8b | QuantizationQ3_K_M | Context4K | Est. memory≈ 5.5 GB | ollama run granite-code:8b-base-q3_K_M |
| 8b-base-q3_K_S | Typelocal | Inputstext | Digest2ea64f1e1696 | Download3.5 GB | Parameters8b | QuantizationQ3_K_S | Context4K | Est. memory≈ 5 GB | ollama run granite-code:8b-base-q3_K_S |
| 8b-base-q4_0 | Typelocal | Inputstext | Digest446b079c08d8 | Download4.6 GB | Parameters8b | QuantizationQ4_0 | Context4K | Est. memory≈ 6.5 GB | ollama run granite-code:8b-base-q4_0 |
| 8b-base-q4_1 | Typelocal | Inputstext | Digest8188ceec7ebb | Download5.1 GB | Parameters8b | QuantizationQ4_1 | Context4K | Est. memory≈ 7 GB | ollama run granite-code:8b-base-q4_1 |
| 8b-base-q4_K_M | Typelocal | Inputstext | Digestd1ff254e3ce3 | Download4.9 GB | Parameters8b | QuantizationQ4_K_M | Context4K | Est. memory≈ 6.5 GB | ollama run granite-code:8b-base-q4_K_M |
| 8b-base-q4_K_S | Typelocal | Inputstext | Digest8b5439b8f8fa | Download4.6 GB | Parameters8b | QuantizationQ4_K_S | Context4K | Est. memory≈ 6.5 GB | ollama run granite-code:8b-base-q4_K_S |
| 8b-base-q5_0 | Typelocal | Inputstext | Digesta2683a6426c6 | Download5.6 GB | Parameters8b | QuantizationQ5_0 | Context4K | Est. memory≈ 7.5 GB | ollama run granite-code:8b-base-q5_0 |
| 8b-base-q5_1 | Typelocal | Inputstext | Digest1ac225f4921f | Download6.1 GB | Parameters8b | QuantizationQ5_1 | Context4K | Est. memory≈ 8 GB | ollama run granite-code:8b-base-q5_1 |
| 8b-base-q5_K_M | Typelocal | Inputstext | Digest571e48fd3f79 | Download5.7 GB | Parameters8b | QuantizationQ5_K_M | Context4K | Est. memory≈ 7.5 GB | ollama run granite-code:8b-base-q5_K_M |
| 8b-base-q5_K_S | Typelocal | Inputstext | Digestac18787cbd38 | Download5.6 GB | Parameters8b | QuantizationQ5_K_S | Context4K | Est. memory≈ 7.5 GB | ollama run granite-code:8b-base-q5_K_S |
| 8b-base-q6_K | Typelocal | Inputstext | Digest85c68aed2abf | Download6.6 GB | Parameters8b | QuantizationQ6_K | Context4K | Est. memory≈ 8.5 GB | ollama run granite-code:8b-base-q6_K |
| 8b-base-q8_0 | Typelocal | Inputstext | Digest98d17f9b29f7 | Download8.6 GB | Parameters8b | QuantizationQ8_0 | Context4K | Est. memory≈ 11 GB | ollama run granite-code:8b-base-q8_0 |
| 8b-instruct | Typelocal | Inputstext | Digest36c3c3b9683b | Download4.6 GB | Parameters8b | QuantizationUnknown | Context125K | Est. memory≈ 6.5 GB | ollama run granite-code:8b-instruct |
| 8b-instruct-128k-q4_0 | Typelocal | Inputstext | Digest36c3c3b9683b | Download4.6 GB | Parameters8b | QuantizationQ4_0 | Context125K | Est. memory≈ 6.5 GB | ollama run granite-code:8b-instruct-128k-q4_0 |
| 8b-instruct-128k-q4_1 | Typelocal | Inputstext | Digest0f53e9c9d8be | Download5.1 GB | Parameters8b | QuantizationQ4_1 | Context125K | Est. memory≈ 7 GB | ollama run granite-code:8b-instruct-128k-q4_1 |
| 8b-instruct-fp16 | Typelocal | Inputstext | Digestba8f7888f7cd | Download16 GB | Parameters8b | QuantizationFP16 | Context4K | Est. memory≈ 19 GB | ollama run granite-code:8b-instruct-fp16 |
| 8b-instruct-q2_K | Typelocal | Inputstext | Digeste19d9843758d | Download3.1 GB | Parameters8b | QuantizationQ2_K | Context4K | Est. memory≈ 4.5 GB | ollama run granite-code:8b-instruct-q2_K |
| 8b-instruct-q3_K_L | Typelocal | Inputstext | Digeste7a83854c109 | Download4.3 GB | Parameters8b | QuantizationQ3_K_L | Context4K | Est. memory≈ 6 GB | ollama run granite-code:8b-instruct-q3_K_L |
| 8b-instruct-q3_K_M | Typelocal | Inputstext | Digestbf18f4d1eac9 | Download3.9 GB | Parameters8b | QuantizationQ3_K_M | Context4K | Est. memory≈ 5.5 GB | ollama run granite-code:8b-instruct-q3_K_M |
| 8b-instruct-q3_K_S | Typelocal | Inputstext | Digestf432fe584c50 | Download3.5 GB | Parameters8b | QuantizationQ3_K_S | Context4K | Est. memory≈ 5 GB | ollama run granite-code:8b-instruct-q3_K_S |
| 8b-instruct-q4_0 | Typelocal | Inputstext | Digest998bce918de0 | Download4.6 GB | Parameters8b | QuantizationQ4_0 | Context4K | Est. memory≈ 6.5 GB | ollama run granite-code:8b-instruct-q4_0 |
| 8b-instruct-q4_1 | Typelocal | Inputstext | Digestd7b2698267fc | Download5.1 GB | Parameters8b | QuantizationQ4_1 | Context4K | Est. memory≈ 7 GB | ollama run granite-code:8b-instruct-q4_1 |
| 8b-instruct-q4_K_M | Typelocal | Inputstext | Digest6b6cc77a3094 | Download4.9 GB | Parameters8b | QuantizationQ4_K_M | Context4K | Est. memory≈ 6.5 GB | ollama run granite-code:8b-instruct-q4_K_M |
| 8b-instruct-q4_K_S | Typelocal | Inputstext | Digestfd077fe10167 | Download4.6 GB | Parameters8b | QuantizationQ4_K_S | Context4K | Est. memory≈ 6.5 GB | ollama run granite-code:8b-instruct-q4_K_S |
| 8b-instruct-q5_0 | Typelocal | Inputstext | Digestc577f70d1bcb | Download5.6 GB | Parameters8b | QuantizationQ5_0 | Context4K | Est. memory≈ 7.5 GB | ollama run granite-code:8b-instruct-q5_0 |
| 8b-instruct-q5_1 | Typelocal | Inputstext | Digestf5c70f717cd7 | Download6.1 GB | Parameters8b | QuantizationQ5_1 | Context4K | Est. memory≈ 8 GB | ollama run granite-code:8b-instruct-q5_1 |
| 8b-instruct-q5_K_M | Typelocal | Inputstext | Digesta8781d67d804 | Download5.7 GB | Parameters8b | QuantizationQ5_K_M | Context4K | Est. memory≈ 7.5 GB | ollama run granite-code:8b-instruct-q5_K_M |
| 8b-instruct-q5_K_S | Typelocal | Inputstext | Digest47b0d1d1779c | Download5.6 GB | Parameters8b | QuantizationQ5_K_S | Context4K | Est. memory≈ 7.5 GB | ollama run granite-code:8b-instruct-q5_K_S |
| 8b-instruct-q6_K | Typelocal | Inputstext | Digesta929c1ec4cda | Download6.6 GB | Parameters8b | QuantizationQ6_K | Context4K | Est. memory≈ 8.5 GB | ollama run granite-code:8b-instruct-q6_K |
| 8b-instruct-q8_0 | Typelocal | Inputstext | Digest068b1c745db2 | Download8.6 GB | Parameters8b | QuantizationQ8_0 | Context4K | Est. memory≈ 11 GB | ollama run granite-code:8b-instruct-q8_0 |
| latestdefault | Typelocal | Inputstext | Digestbecc94fe1876 | Download2.0 GB | ParametersUnknown | QuantizationUnknown | Context125K | Est. memory≈ 3.5 GB | ollama run granite-code:latest |
Related models
strands-deciderlocal
A 2B decision model from Strands Agents for fast classification, routing, and scoring.
phi3local
Phi-3 is a family of lightweight 3B (Mini) and 14B (Medium) state-of-the-art open models by Microsoft.
hermes3local
Hermes 3 is the latest version of the flagship Hermes series of LLMs by Nous Research
phi3.5local
A lightweight AI model with 3.8 billion parameters with performance overtaking similarly and larger sized models.