Quick start
ollama run hermes3:latestRunnable variants
Memory is a rough file-size estimate; context length, runtime and GPU offload change it.
12 of 65 matching variants shown.65 of 65 variants shown.
| Tag | Type | Inputs | Digest | Download | Parameters | Quantization | Context | Est. memory | Run |
|---|---|---|---|---|---|---|---|---|---|
| 3b | Typelocal | Inputstext | Digesta8851c5041d4 | Download2.0 GB | Parameters3b | QuantizationUnknown | Context128K | Est. memory≈ 3.5 GB | ollama run hermes3:3b |
| 3b-llama3.2-fp16 | Typelocal | Inputstext | Digest1818cdb4d27a | Download6.4 GB | Parameters3b | QuantizationFP16 | Context128K | Est. memory≈ 8.5 GB | ollama run hermes3:3b-llama3.2-fp16 |
| 3b-llama3.2-q2_K | Typelocal | Inputstext | Digest5e016053462e | Download1.4 GB | Parameters3b | QuantizationQ2_K | Context128K | Est. memory≈ 3 GB | ollama run hermes3:3b-llama3.2-q2_K |
| 3b-llama3.2-q3_K_L | Typelocal | Inputstext | Digest398338d75e51 | Download1.8 GB | Parameters3b | QuantizationQ3_K_L | Context128K | Est. memory≈ 3.5 GB | ollama run hermes3:3b-llama3.2-q3_K_L |
| 3b-llama3.2-q3_K_M | Typelocal | Inputstext | Digest8412e43ba04b | Download1.7 GB | Parameters3b | QuantizationQ3_K_M | Context128K | Est. memory≈ 3 GB | ollama run hermes3:3b-llama3.2-q3_K_M |
| 3b-llama3.2-q3_K_S | Typelocal | Inputstext | Digest9534cf45dcad | Download1.5 GB | Parameters3b | QuantizationQ3_K_S | Context128K | Est. memory≈ 3 GB | ollama run hermes3:3b-llama3.2-q3_K_S |
| 3b-llama3.2-q4_0 | Typelocal | Inputstext | Digest1e1401fe4ac6 | Download1.9 GB | Parameters3b | QuantizationQ4_0 | Context128K | Est. memory≈ 3.5 GB | ollama run hermes3:3b-llama3.2-q4_0 |
| 3b-llama3.2-q4_1 | Typelocal | Inputstext | Digest789b254cc3a2 | Download2.1 GB | Parameters3b | QuantizationQ4_1 | Context128K | Est. memory≈ 3.5 GB | ollama run hermes3:3b-llama3.2-q4_1 |
| 3b-llama3.2-q4_K_M | Typelocal | Inputstext | Digesta8851c5041d4 | Download2.0 GB | Parameters3b | QuantizationQ4_K_M | Context128K | Est. memory≈ 3.5 GB | ollama run hermes3:3b-llama3.2-q4_K_M |
| 3b-llama3.2-q4_K_S | Typelocal | Inputstext | Digest2319fe585b75 | Download1.9 GB | Parameters3b | QuantizationQ4_K_S | Context128K | Est. memory≈ 3.5 GB | ollama run hermes3:3b-llama3.2-q4_K_S |
| 3b-llama3.2-q5_0 | Typelocal | Inputstext | Digest8ba0b60c0fbb | Download2.3 GB | Parameters3b | QuantizationQ5_0 | Context128K | Est. memory≈ 4 GB | ollama run hermes3:3b-llama3.2-q5_0 |
| 3b-llama3.2-q5_1 | Typelocal | Inputstext | Digest5bc19c8f34a0 | Download2.4 GB | Parameters3b | QuantizationQ5_1 | Context128K | Est. memory≈ 4 GB | ollama run hermes3:3b-llama3.2-q5_1 |
| 3b-llama3.2-q5_K_M | Typelocal | Inputstext | Digestadff680f9846 | Download2.3 GB | Parameters3b | QuantizationQ5_K_M | Context128K | Est. memory≈ 4 GB | ollama run hermes3:3b-llama3.2-q5_K_M |
| 3b-llama3.2-q5_K_S | Typelocal | Inputstext | Digest2825a14d8a2e | Download2.3 GB | Parameters3b | QuantizationQ5_K_S | Context128K | Est. memory≈ 4 GB | ollama run hermes3:3b-llama3.2-q5_K_S |
| 3b-llama3.2-q6_K | Typelocal | Inputstext | Digest618f493da20f | Download2.6 GB | Parameters3b | QuantizationQ6_K | Context128K | Est. memory≈ 4 GB | ollama run hermes3:3b-llama3.2-q6_K |
| 3b-llama3.2-q8_0 | Typelocal | Inputstext | Digest81e132c6f32b | Download3.4 GB | Parameters3b | QuantizationQ8_0 | Context128K | Est. memory≈ 5 GB | ollama run hermes3:3b-llama3.2-q8_0 |
| 405b | Typelocal | Inputstext | Digest7e675bc10887 | Download229 GB | Parameters405b | QuantizationUnknown | Context128K | Est. memory≈ 257 GB | ollama run hermes3:405b |
| 405b-llama3.1-fp16 | Typelocal | Inputstext | Digest9666944d1b48 | Download812 GB | Parameters405b | QuantizationFP16 | Context128K | Est. memory≈ 908.5 GB | ollama run hermes3:405b-llama3.1-fp16 |
| 405b-llama3.1-q2_K | Typelocal | Inputstext | Digestf12827971c1b | Download149 GB | Parameters405b | QuantizationQ2_K | Context128K | Est. memory≈ 168 GB | ollama run hermes3:405b-llama3.1-q2_K |
| 405b-llama3.1-q3_K_L | Typelocal | Inputstext | Digest8e48e8f6acc9 | Download213 GB | Parameters405b | QuantizationQ3_K_L | Context128K | Est. memory≈ 239.5 GB | ollama run hermes3:405b-llama3.1-q3_K_L |
| 405b-llama3.1-q3_K_M | Typelocal | Inputstext | Digest87c4bb79d492 | Download195 GB | Parameters405b | QuantizationQ3_K_M | Context128K | Est. memory≈ 219 GB | ollama run hermes3:405b-llama3.1-q3_K_M |
| 405b-llama3.1-q3_K_S | Typelocal | Inputstext | Digestd5d61b34af07 | Download175 GB | Parameters405b | QuantizationQ3_K_S | Context128K | Est. memory≈ 197 GB | ollama run hermes3:405b-llama3.1-q3_K_S |
| 405b-llama3.1-q4_0 | Typelocal | Inputstext | Digest7e675bc10887 | Download229 GB | Parameters405b | QuantizationQ4_0 | Context128K | Est. memory≈ 257 GB | ollama run hermes3:405b-llama3.1-q4_0 |
| 405b-llama3.1-q4_1 | Typelocal | Inputstext | Digestd2069f77b555 | Download254 GB | Parameters405b | QuantizationQ4_1 | Context128K | Est. memory≈ 285 GB | ollama run hermes3:405b-llama3.1-q4_1 |
| 405b-llama3.1-q4_K_M | Typelocal | Inputstext | Digest7e95da5e5e87 | Download243 GB | Parameters405b | QuantizationQ4_K_M | Context128K | Est. memory≈ 273 GB | ollama run hermes3:405b-llama3.1-q4_K_M |
| 405b-llama3.1-q4_K_S | Typelocal | Inputstext | Digest51d83954f208 | Download231 GB | Parameters405b | QuantizationQ4_K_S | Context128K | Est. memory≈ 259.5 GB | ollama run hermes3:405b-llama3.1-q4_K_S |
| 405b-llama3.1-q5_0 | Typelocal | Inputstext | Digest1330c3882956 | Download279 GB | Parameters405b | QuantizationQ5_0 | Context128K | Est. memory≈ 313 GB | ollama run hermes3:405b-llama3.1-q5_0 |
| 405b-llama3.1-q5_1 | Typelocal | Inputstext | Digest645be110f228 | Download305 GB | Parameters405b | QuantizationQ5_1 | Context128K | Est. memory≈ 342 GB | ollama run hermes3:405b-llama3.1-q5_1 |
| 405b-llama3.1-q5_K_M | Typelocal | Inputstext | Digest859937457c29 | Download287 GB | Parameters405b | QuantizationQ5_K_M | Context128K | Est. memory≈ 322 GB | ollama run hermes3:405b-llama3.1-q5_K_M |
| 405b-llama3.1-q5_K_S | Typelocal | Inputstext | Digest6e8f5fe76c99 | Download279 GB | Parameters405b | QuantizationQ5_K_S | Context128K | Est. memory≈ 313 GB | ollama run hermes3:405b-llama3.1-q5_K_S |
| 405b-llama3.1-q6_K | Typelocal | Inputstext | Digest2d0919bbe03f | Download333 GB | Parameters405b | QuantizationQ6_K | Context128K | Est. memory≈ 373.5 GB | ollama run hermes3:405b-llama3.1-q6_K |
| 405b-llama3.1-q8_0 | Typelocal | Inputstext | Digestd2ca25940e61 | Download431 GB | Parameters405b | QuantizationQ8_0 | Context128K | Est. memory≈ 483 GB | ollama run hermes3:405b-llama3.1-q8_0 |
| 70b | Typelocal | Inputstext | Digest60ef54cd913f | Download40 GB | Parameters70b | QuantizationUnknown | Context128K | Est. memory≈ 46 GB | ollama run hermes3:70b |
| 70b-llama3.1-fp16 | Typelocal | Inputstext | Digeste95c7ce02c58 | Download141 GB | Parameters70b | QuantizationFP16 | Context128K | Est. memory≈ 159 GB | ollama run hermes3:70b-llama3.1-fp16 |
| 70b-llama3.1-q2_K | Typelocal | Inputstext | Digestd494e51db58c | Download26 GB | Parameters70b | QuantizationQ2_K | Context128K | Est. memory≈ 30.5 GB | ollama run hermes3:70b-llama3.1-q2_K |
| 70b-llama3.1-q3_K_L | Typelocal | Inputstext | Digestef3556ba09b4 | Download37 GB | Parameters70b | QuantizationQ3_K_L | Context128K | Est. memory≈ 42.5 GB | ollama run hermes3:70b-llama3.1-q3_K_L |
| 70b-llama3.1-q3_K_M | Typelocal | Inputstext | Digest85e9f18d5139 | Download34 GB | Parameters70b | QuantizationQ3_K_M | Context128K | Est. memory≈ 39 GB | ollama run hermes3:70b-llama3.1-q3_K_M |
| 70b-llama3.1-q3_K_S | Typelocal | Inputstext | Digest0a99e8a6fa35 | Download31 GB | Parameters70b | QuantizationQ3_K_S | Context128K | Est. memory≈ 36 GB | ollama run hermes3:70b-llama3.1-q3_K_S |
| 70b-llama3.1-q4_0 | Typelocal | Inputstext | Digest60ef54cd913f | Download40 GB | Parameters70b | QuantizationQ4_0 | Context128K | Est. memory≈ 46 GB | ollama run hermes3:70b-llama3.1-q4_0 |
| 70b-llama3.1-q4_1 | Typelocal | Inputstext | Digest5439d89973fa | Download44 GB | Parameters70b | QuantizationQ4_1 | Context128K | Est. memory≈ 50.5 GB | ollama run hermes3:70b-llama3.1-q4_1 |
| 70b-llama3.1-q4_K_M | Typelocal | Inputstext | Digest830dc29f92d1 | Download43 GB | Parameters70b | QuantizationQ4_K_M | Context128K | Est. memory≈ 49.5 GB | ollama run hermes3:70b-llama3.1-q4_K_M |
| 70b-llama3.1-q4_K_S | Typelocal | Inputstext | Digest3c54000f925c | Download40 GB | Parameters70b | QuantizationQ4_K_S | Context128K | Est. memory≈ 46 GB | ollama run hermes3:70b-llama3.1-q4_K_S |
| 70b-llama3.1-q5_0 | Typelocal | Inputstext | Digest25749edb3917 | Download49 GB | Parameters70b | QuantizationQ5_0 | Context128K | Est. memory≈ 56 GB | ollama run hermes3:70b-llama3.1-q5_0 |
| 70b-llama3.1-q5_1 | Typelocal | Inputstext | Digest5deeeb686c50 | Download53 GB | Parameters70b | QuantizationQ5_1 | Context128K | Est. memory≈ 60.5 GB | ollama run hermes3:70b-llama3.1-q5_1 |
| 70b-llama3.1-q5_K_M | Typelocal | Inputstext | Digest20b9f43d13a2 | Download50 GB | Parameters70b | QuantizationQ5_K_M | Context128K | Est. memory≈ 57 GB | ollama run hermes3:70b-llama3.1-q5_K_M |
| 70b-llama3.1-q5_K_S | Typelocal | Inputstext | Digest187535b64096 | Download49 GB | Parameters70b | QuantizationQ5_K_S | Context128K | Est. memory≈ 56 GB | ollama run hermes3:70b-llama3.1-q5_K_S |
| 70b-llama3.1-q6_K | Typelocal | Inputstext | Digestec4ea041b516 | Download58 GB | Parameters70b | QuantizationQ6_K | Context128K | Est. memory≈ 66 GB | ollama run hermes3:70b-llama3.1-q6_K |
| 70b-llama3.1-q8_0 | Typelocal | Inputstext | Digest72f0aa5b30bb | Download75 GB | Parameters70b | QuantizationQ8_0 | Context128K | Est. memory≈ 85 GB | ollama run hermes3:70b-llama3.1-q8_0 |
| 8b | Typelocal | Inputstext | Digest4f6b83f30b62 | Download4.7 GB | Parameters8b | QuantizationUnknown | Context128K | Est. memory≈ 6.5 GB | ollama run hermes3:8b |
| 8b-llama3.1-fp16 | Typelocal | Inputstext | Digest33a87105fb24 | Download16 GB | Parameters8b | QuantizationFP16 | Context128K | Est. memory≈ 19 GB | ollama run hermes3:8b-llama3.1-fp16 |
| 8b-llama3.1-q2_K | Typelocal | Inputstext | Digest6285707c1724 | Download3.2 GB | Parameters8b | QuantizationQ2_K | Context128K | Est. memory≈ 5 GB | ollama run hermes3:8b-llama3.1-q2_K |
| 8b-llama3.1-q3_K_L | Typelocal | Inputstext | Digest01fb1c8fffcb | Download4.3 GB | Parameters8b | QuantizationQ3_K_L | Context128K | Est. memory≈ 6 GB | ollama run hermes3:8b-llama3.1-q3_K_L |
| 8b-llama3.1-q3_K_M | Typelocal | Inputstext | Digestf6b6eb85884d | Download4.0 GB | Parameters8b | QuantizationQ3_K_M | Context128K | Est. memory≈ 5.5 GB | ollama run hermes3:8b-llama3.1-q3_K_M |
| 8b-llama3.1-q3_K_S | Typelocal | Inputstext | Digeste2a8a0424e1b | Download3.7 GB | Parameters8b | QuantizationQ3_K_S | Context128K | Est. memory≈ 5.5 GB | ollama run hermes3:8b-llama3.1-q3_K_S |
| 8b-llama3.1-q4_0 | Typelocal | Inputstext | Digest4f6b83f30b62 | Download4.7 GB | Parameters8b | QuantizationQ4_0 | Context128K | Est. memory≈ 6.5 GB | ollama run hermes3:8b-llama3.1-q4_0 |
| 8b-llama3.1-q4_1 | Typelocal | Inputstext | Digestd5b8d4f560a3 | Download5.1 GB | Parameters8b | QuantizationQ4_1 | Context128K | Est. memory≈ 7 GB | ollama run hermes3:8b-llama3.1-q4_1 |
| 8b-llama3.1-q4_K_M | Typelocal | Inputstext | Digest81e633795347 | Download4.9 GB | Parameters8b | QuantizationQ4_K_M | Context128K | Est. memory≈ 6.5 GB | ollama run hermes3:8b-llama3.1-q4_K_M |
| 8b-llama3.1-q4_K_S | Typelocal | Inputstext | Digestc8edbc90a188 | Download4.7 GB | Parameters8b | QuantizationQ4_K_S | Context128K | Est. memory≈ 6.5 GB | ollama run hermes3:8b-llama3.1-q4_K_S |
| 8b-llama3.1-q5_0 | Typelocal | Inputstext | Digestf1e10ae7c0e6 | Download5.6 GB | Parameters8b | QuantizationQ5_0 | Context128K | Est. memory≈ 7.5 GB | ollama run hermes3:8b-llama3.1-q5_0 |
| 8b-llama3.1-q5_1 | Typelocal | Inputstext | Digestbebd5029ac2b | Download6.1 GB | Parameters8b | QuantizationQ5_1 | Context128K | Est. memory≈ 8 GB | ollama run hermes3:8b-llama3.1-q5_1 |
| 8b-llama3.1-q5_K_M | Typelocal | Inputstext | Digest836396825b44 | Download5.7 GB | Parameters8b | QuantizationQ5_K_M | Context128K | Est. memory≈ 7.5 GB | ollama run hermes3:8b-llama3.1-q5_K_M |
| 8b-llama3.1-q5_K_S | Typelocal | Inputstext | Digestc0a2d5445266 | Download5.6 GB | Parameters8b | QuantizationQ5_K_S | Context128K | Est. memory≈ 7.5 GB | ollama run hermes3:8b-llama3.1-q5_K_S |
| 8b-llama3.1-q6_K | Typelocal | Inputstext | Digestfbcaa05c32d0 | Download6.6 GB | Parameters8b | QuantizationQ6_K | Context128K | Est. memory≈ 8.5 GB | ollama run hermes3:8b-llama3.1-q6_K |
| 8b-llama3.1-q8_0 | Typelocal | Inputstext | Digest1c94cf8f1046 | Download8.5 GB | Parameters8b | QuantizationQ8_0 | Context128K | Est. memory≈ 10.5 GB | ollama run hermes3:8b-llama3.1-q8_0 |
| latestdefault | Typelocal | Inputstext | Digest4f6b83f30b62 | Download4.7 GB | ParametersUnknown | QuantizationUnknown | Context128K | Est. memory≈ 6.5 GB | ollama run hermes3:latest |
Source-listed applications
Related models
IBM Granite Models are a family of enterprise-ready, open foundation models that support multilingual capabilities, coding, retrieval-augmented generation (RAG), tool use, and structured JSON output. Released under Apache 2.0 license.
IBM Granite 2B and 8B models are 128K context length language models that have been fine-tuned for improved reasoning and instruction-following capabilities.
Granite-3.2 is a family of long-context AI models from IBM Granite fine-tuned for thinking capabilities.
DeepSeek-R1 is a family of open reasoning models with performance approaching that of leading models, such as O3 and Gemini 2.5 Pro.