Quick start
ollama run nous-hermes2:latestRunnable variants
Memory is a rough file-size estimate; context length, runtime and GPU offload change it.
12 of 33 matching variants shown.33 of 33 variants shown.
| Tag | Type | Inputs | Digest | Download | Parameters | Quantization | Context | Est. memory | Run |
|---|---|---|---|---|---|---|---|---|---|
| 10.7b | Typelocal | Inputstext | Digestd50977d0b36a | Download6.1 GB | Parameters10.7b | QuantizationUnknown | Context4K | Est. memory≈ 8 GB | ollama run nous-hermes2:10.7b |
| 10.7b-solar-fp16 | Typelocal | Inputstext | Digestd1a6005a734e | Download21 GB | Parameters10.7b | QuantizationFP16 | Context4K | Est. memory≈ 24.5 GB | ollama run nous-hermes2:10.7b-solar-fp16 |
| 10.7b-solar-q2_K | Typelocal | Inputstext | Digest2931d5c846b2 | Download4.5 GB | Parameters10.7b | QuantizationQ2_K | Context4K | Est. memory≈ 6.5 GB | ollama run nous-hermes2:10.7b-solar-q2_K |
| 10.7b-solar-q3_K_L | Typelocal | Inputstext | Digest36b57986a223 | Download5.7 GB | Parameters10.7b | QuantizationQ3_K_L | Context4K | Est. memory≈ 7.5 GB | ollama run nous-hermes2:10.7b-solar-q3_K_L |
| 10.7b-solar-q3_K_M | Typelocal | Inputstext | Digest20bed3473bc5 | Download5.2 GB | Parameters10.7b | QuantizationQ3_K_M | Context4K | Est. memory≈ 7 GB | ollama run nous-hermes2:10.7b-solar-q3_K_M |
| 10.7b-solar-q3_K_S | Typelocal | Inputstext | Digest5b55664515d5 | Download4.7 GB | Parameters10.7b | QuantizationQ3_K_S | Context4K | Est. memory≈ 6.5 GB | ollama run nous-hermes2:10.7b-solar-q3_K_S |
| 10.7b-solar-q4_0 | Typelocal | Inputstext | Digestd50977d0b36a | Download6.1 GB | Parameters10.7b | QuantizationQ4_0 | Context4K | Est. memory≈ 8 GB | ollama run nous-hermes2:10.7b-solar-q4_0 |
| 10.7b-solar-q4_1 | Typelocal | Inputstext | Digest7486b76cccbc | Download6.7 GB | Parameters10.7b | QuantizationQ4_1 | Context4K | Est. memory≈ 8.5 GB | ollama run nous-hermes2:10.7b-solar-q4_1 |
| 10.7b-solar-q4_K_M | Typelocal | Inputstext | Digest3901698f9529 | Download6.5 GB | Parameters10.7b | QuantizationQ4_K_M | Context4K | Est. memory≈ 8.5 GB | ollama run nous-hermes2:10.7b-solar-q4_K_M |
| 10.7b-solar-q4_K_S | Typelocal | Inputstext | Digest674107bfb50e | Download6.1 GB | Parameters10.7b | QuantizationQ4_K_S | Context4K | Est. memory≈ 8 GB | ollama run nous-hermes2:10.7b-solar-q4_K_S |
| 10.7b-solar-q5_0 | Typelocal | Inputstext | Digest9b7a0ddf5539 | Download7.4 GB | Parameters10.7b | QuantizationQ5_0 | Context4K | Est. memory≈ 9.5 GB | ollama run nous-hermes2:10.7b-solar-q5_0 |
| 10.7b-solar-q5_1 | Typelocal | Inputstext | Digestade17e89ce44 | Download8.1 GB | Parameters10.7b | QuantizationQ5_1 | Context4K | Est. memory≈ 10.5 GB | ollama run nous-hermes2:10.7b-solar-q5_1 |
| 10.7b-solar-q5_K_M | Typelocal | Inputstext | Digestc21ad0ffb1e8 | Download7.6 GB | Parameters10.7b | QuantizationQ5_K_M | Context4K | Est. memory≈ 9.5 GB | ollama run nous-hermes2:10.7b-solar-q5_K_M |
| 10.7b-solar-q5_K_S | Typelocal | Inputstext | Digestb0a593650c5a | Download7.4 GB | Parameters10.7b | QuantizationQ5_K_S | Context4K | Est. memory≈ 9.5 GB | ollama run nous-hermes2:10.7b-solar-q5_K_S |
| 10.7b-solar-q6_K | Typelocal | Inputstext | Digest46a4c005c00c | Download8.8 GB | Parameters10.7b | QuantizationQ6_K | Context4K | Est. memory≈ 11 GB | ollama run nous-hermes2:10.7b-solar-q6_K |
| 10.7b-solar-q8_0 | Typelocal | Inputstext | Digest04509546373b | Download11 GB | Parameters10.7b | QuantizationQ8_0 | Context4K | Est. memory≈ 13.5 GB | ollama run nous-hermes2:10.7b-solar-q8_0 |
| 34b | Typelocal | Inputstext | Digest1fbb49caabbd | Download19 GB | Parameters34b | QuantizationUnknown | Context4K | Est. memory≈ 22.5 GB | ollama run nous-hermes2:34b |
| 34b-yi-fp16 | Typelocal | Inputstext | Digestba6742bba2e3 | Download69 GB | Parameters34b | QuantizationFP16 | Context4K | Est. memory≈ 78.5 GB | ollama run nous-hermes2:34b-yi-fp16 |
| 34b-yi-q2_K | Typelocal | Inputstext | Digest5880153d6216 | Download15 GB | Parameters34b | QuantizationQ2_K | Context4K | Est. memory≈ 18 GB | ollama run nous-hermes2:34b-yi-q2_K |
| 34b-yi-q3_K_L | Typelocal | Inputstext | Digestd9e569fe62f4 | Download18 GB | Parameters34b | QuantizationQ3_K_L | Context4K | Est. memory≈ 21.5 GB | ollama run nous-hermes2:34b-yi-q3_K_L |
| 34b-yi-q3_K_M | Typelocal | Inputstext | Digestf2531c88caf1 | Download17 GB | Parameters34b | QuantizationQ3_K_M | Context4K | Est. memory≈ 20 GB | ollama run nous-hermes2:34b-yi-q3_K_M |
| 34b-yi-q3_K_S | Typelocal | Inputstext | Digest0bc80f2f5fd8 | Download15 GB | Parameters34b | QuantizationQ3_K_S | Context4K | Est. memory≈ 18 GB | ollama run nous-hermes2:34b-yi-q3_K_S |
| 34b-yi-q4_0 | Typelocal | Inputstext | Digest1fbb49caabbd | Download19 GB | Parameters34b | QuantizationQ4_0 | Context4K | Est. memory≈ 22.5 GB | ollama run nous-hermes2:34b-yi-q4_0 |
| 34b-yi-q4_1 | Typelocal | Inputstext | Digest692a7d97562c | Download22 GB | Parameters34b | QuantizationQ4_1 | Context4K | Est. memory≈ 26 GB | ollama run nous-hermes2:34b-yi-q4_1 |
| 34b-yi-q4_K_M | Typelocal | Inputstext | Digestd0e1b2a20bbd | Download21 GB | Parameters34b | QuantizationQ4_K_M | Context4K | Est. memory≈ 24.5 GB | ollama run nous-hermes2:34b-yi-q4_K_M |
| 34b-yi-q4_K_S | Typelocal | Inputstext | Digest83c068cc2a03 | Download20 GB | Parameters34b | QuantizationQ4_K_S | Context4K | Est. memory≈ 23.5 GB | ollama run nous-hermes2:34b-yi-q4_K_S |
| 34b-yi-q5_0 | Typelocal | Inputstext | Digestb3a3236a26f1 | Download24 GB | Parameters34b | QuantizationQ5_0 | Context4K | Est. memory≈ 28 GB | ollama run nous-hermes2:34b-yi-q5_0 |
| 34b-yi-q5_1 | Typelocal | Inputstext | Digest9a77070e0a87 | Download26 GB | Parameters34b | QuantizationQ5_1 | Context4K | Est. memory≈ 30.5 GB | ollama run nous-hermes2:34b-yi-q5_1 |
| 34b-yi-q5_K_M | Typelocal | Inputstext | Digest9f0dea62722f | Download24 GB | Parameters34b | QuantizationQ5_K_M | Context4K | Est. memory≈ 28 GB | ollama run nous-hermes2:34b-yi-q5_K_M |
| 34b-yi-q5_K_S | Typelocal | Inputstext | Digest8f6909b8327b | Download24 GB | Parameters34b | QuantizationQ5_K_S | Context4K | Est. memory≈ 28 GB | ollama run nous-hermes2:34b-yi-q5_K_S |
| 34b-yi-q6_K | Typelocal | Inputstext | Digest2e9855cc9f21 | Download28 GB | Parameters34b | QuantizationQ6_K | Context4K | Est. memory≈ 32.5 GB | ollama run nous-hermes2:34b-yi-q6_K |
| 34b-yi-q8_0 | Typelocal | Inputstext | Digesta1e70aa6a163 | Download37 GB | Parameters34b | QuantizationQ8_0 | Context4K | Est. memory≈ 42.5 GB | ollama run nous-hermes2:34b-yi-q8_0 |
| latestdefault | Typelocal | Inputstext | Digestd50977d0b36a | Download6.1 GB | ParametersUnknown | QuantizationUnknown | Context4K | Est. memory≈ 8 GB | ollama run nous-hermes2:latest |
Related models
OLMo 2 is a new family of 7B and 13B models trained on up to 5T tokens. These models are on par with or better than equivalently sized fully open models, and competitive with open-weight models such as Llama 3.1 on English academic benchmarks.
A compact, yet powerful 10.7B large language model designed for single-turn conversation.
Olmo is a series of Open language models designed to enable the science of language models. These models are pre-trained on the Dolma 3 dataset and post-trained on the Dolci datasets.
A fully open-source family of reasoning models built using a dataset derived by distilling DeepSeek-R1.