Quick start
ollama run openhermes:latestRunnable variants
Memory is a rough file-size estimate; context length, runtime and GPU offload change it.
12 of 35 matching variants shown.35 of 35 variants shown.
| Tag | Type | Inputs | Digest | Download | Parameters | Quantization | Context | Est. memory | Run |
|---|---|---|---|---|---|---|---|---|---|
| 7b-mistral-v2-fp16 | Typelocal | Inputstext | Digest7363c7974aad | Download14 GB | Parameters7b | QuantizationFP16 | Context32K | Est. memory≈ 17 GB | ollama run openhermes:7b-mistral-v2-fp16 |
| 7b-mistral-v2-q2_K | Typelocal | Inputstext | Digest7382e175bc40 | Download3.1 GB | Parameters7b | QuantizationQ2_K | Context32K | Est. memory≈ 4.5 GB | ollama run openhermes:7b-mistral-v2-q2_K |
| 7b-mistral-v2-q3_K_L | Typelocal | Inputstext | Digest92639a59090e | Download3.8 GB | Parameters7b | QuantizationQ3_K_L | Context32K | Est. memory≈ 5.5 GB | ollama run openhermes:7b-mistral-v2-q3_K_L |
| 7b-mistral-v2-q3_K_M | Typelocal | Inputstext | Digest943cbcfdf34c | Download3.5 GB | Parameters7b | QuantizationQ3_K_M | Context32K | Est. memory≈ 5 GB | ollama run openhermes:7b-mistral-v2-q3_K_M |
| 7b-mistral-v2-q3_K_S | Typelocal | Inputstext | Digest9293e87ebeee | Download3.2 GB | Parameters7b | QuantizationQ3_K_S | Context32K | Est. memory≈ 5 GB | ollama run openhermes:7b-mistral-v2-q3_K_S |
| 7b-mistral-v2-q4_0 | Typelocal | Inputstext | Digestf04d5fa80594 | Download4.1 GB | Parameters7b | QuantizationQ4_0 | Context32K | Est. memory≈ 6 GB | ollama run openhermes:7b-mistral-v2-q4_0 |
| 7b-mistral-v2-q4_1 | Typelocal | Inputstext | Digest578862b7c2c4 | Download4.6 GB | Parameters7b | QuantizationQ4_1 | Context32K | Est. memory≈ 6.5 GB | ollama run openhermes:7b-mistral-v2-q4_1 |
| 7b-mistral-v2-q4_K_M | Typelocal | Inputstext | Digestc834aea088da | Download4.4 GB | Parameters7b | QuantizationQ4_K_M | Context32K | Est. memory≈ 6 GB | ollama run openhermes:7b-mistral-v2-q4_K_M |
| 7b-mistral-v2-q4_K_S | Typelocal | Inputstext | Digest2b693162c0b1 | Download4.1 GB | Parameters7b | QuantizationQ4_K_S | Context32K | Est. memory≈ 6 GB | ollama run openhermes:7b-mistral-v2-q4_K_S |
| 7b-mistral-v2-q5_0 | Typelocal | Inputstext | Digestc7ee3129a817 | Download5.0 GB | Parameters7b | QuantizationQ5_0 | Context32K | Est. memory≈ 7 GB | ollama run openhermes:7b-mistral-v2-q5_0 |
| 7b-mistral-v2-q5_1 | Typelocal | Inputstext | Digest6c0627dce78f | Download5.4 GB | Parameters7b | QuantizationQ5_1 | Context32K | Est. memory≈ 7.5 GB | ollama run openhermes:7b-mistral-v2-q5_1 |
| 7b-mistral-v2-q5_K_M | Typelocal | Inputstext | Digestd021fbb0cb08 | Download5.1 GB | Parameters7b | QuantizationQ5_K_M | Context32K | Est. memory≈ 7 GB | ollama run openhermes:7b-mistral-v2-q5_K_M |
| 7b-mistral-v2-q5_K_S | Typelocal | Inputstext | Digest0e5722600e00 | Download5.0 GB | Parameters7b | QuantizationQ5_K_S | Context32K | Est. memory≈ 7 GB | ollama run openhermes:7b-mistral-v2-q5_K_S |
| 7b-mistral-v2-q6_K | Typelocal | Inputstext | Digestcfc008d96677 | Download5.9 GB | Parameters7b | QuantizationQ6_K | Context32K | Est. memory≈ 8 GB | ollama run openhermes:7b-mistral-v2-q6_K |
| 7b-mistral-v2-q8_0 | Typelocal | Inputstext | Digest911a100c0637 | Download7.7 GB | Parameters7b | QuantizationQ8_0 | Context32K | Est. memory≈ 10 GB | ollama run openhermes:7b-mistral-v2-q8_0 |
| 7b-mistral-v2.5-fp16 | Typelocal | Inputstext | Digest579d40574c77 | Download14 GB | Parameters7b | QuantizationFP16 | Context32K | Est. memory≈ 17 GB | ollama run openhermes:7b-mistral-v2.5-fp16 |
| 7b-mistral-v2.5-q2_K | Typelocal | Inputstext | Digest44645d418862 | Download3.1 GB | Parameters7b | QuantizationQ2_K | Context32K | Est. memory≈ 4.5 GB | ollama run openhermes:7b-mistral-v2.5-q2_K |
| 7b-mistral-v2.5-q3_K_L | Typelocal | Inputstext | Digest4d3c347d9140 | Download3.8 GB | Parameters7b | QuantizationQ3_K_L | Context32K | Est. memory≈ 5.5 GB | ollama run openhermes:7b-mistral-v2.5-q3_K_L |
| 7b-mistral-v2.5-q3_K_M | Typelocal | Inputstext | Digest2356b5964d77 | Download3.5 GB | Parameters7b | QuantizationQ3_K_M | Context32K | Est. memory≈ 5 GB | ollama run openhermes:7b-mistral-v2.5-q3_K_M |
| 7b-mistral-v2.5-q3_K_S | Typelocal | Inputstext | Digeste7a7de3e60a0 | Download3.2 GB | Parameters7b | QuantizationQ3_K_S | Context32K | Est. memory≈ 5 GB | ollama run openhermes:7b-mistral-v2.5-q3_K_S |
| 7b-mistral-v2.5-q4_0 | Typelocal | Inputstext | Digest95477a2659b7 | Download4.1 GB | Parameters7b | QuantizationQ4_0 | Context32K | Est. memory≈ 6 GB | ollama run openhermes:7b-mistral-v2.5-q4_0 |
| 7b-mistral-v2.5-q4_1 | Typelocal | Inputstext | Digestc8ceb7530412 | Download4.6 GB | Parameters7b | QuantizationQ4_1 | Context32K | Est. memory≈ 6.5 GB | ollama run openhermes:7b-mistral-v2.5-q4_1 |
| 7b-mistral-v2.5-q4_K_M | Typelocal | Inputstext | Digeste898ef9a562f | Download4.4 GB | Parameters7b | QuantizationQ4_K_M | Context32K | Est. memory≈ 6 GB | ollama run openhermes:7b-mistral-v2.5-q4_K_M |
| 7b-mistral-v2.5-q4_K_S | Typelocal | Inputstext | Digest2528f369c9e5 | Download4.1 GB | Parameters7b | QuantizationQ4_K_S | Context32K | Est. memory≈ 6 GB | ollama run openhermes:7b-mistral-v2.5-q4_K_S |
| 7b-mistral-v2.5-q5_0 | Typelocal | Inputstext | Digest67bd911a9e96 | Download5.0 GB | Parameters7b | QuantizationQ5_0 | Context32K | Est. memory≈ 7 GB | ollama run openhermes:7b-mistral-v2.5-q5_0 |
| 7b-mistral-v2.5-q5_1 | Typelocal | Inputstext | Digest1e67d8f3ad40 | Download5.4 GB | Parameters7b | QuantizationQ5_1 | Context32K | Est. memory≈ 7.5 GB | ollama run openhermes:7b-mistral-v2.5-q5_1 |
| 7b-mistral-v2.5-q5_K_M | Typelocal | Inputstext | Digest16eab97b0cd1 | Download5.1 GB | Parameters7b | QuantizationQ5_K_M | Context32K | Est. memory≈ 7 GB | ollama run openhermes:7b-mistral-v2.5-q5_K_M |
| 7b-mistral-v2.5-q5_K_S | Typelocal | Inputstext | Digest90f1eb6110b6 | Download5.0 GB | Parameters7b | QuantizationQ5_K_S | Context32K | Est. memory≈ 7 GB | ollama run openhermes:7b-mistral-v2.5-q5_K_S |
| 7b-mistral-v2.5-q6_K | Typelocal | Inputstext | Digesta63bb944ae62 | Download5.9 GB | Parameters7b | QuantizationQ6_K | Context32K | Est. memory≈ 8 GB | ollama run openhermes:7b-mistral-v2.5-q6_K |
| 7b-mistral-v2.5-q8_0 | Typelocal | Inputstext | Digest1617b8a38b70 | Download7.7 GB | Parameters7b | QuantizationQ8_0 | Context32K | Est. memory≈ 10 GB | ollama run openhermes:7b-mistral-v2.5-q8_0 |
| 7b-v2 | Typelocal | Inputstext | Digestf04d5fa80594 | Download4.1 GB | Parameters7b | QuantizationUnknown | Context32K | Est. memory≈ 6 GB | ollama run openhermes:7b-v2 |
| 7b-v2.5 | Typelocal | Inputstext | Digest95477a2659b7 | Download4.1 GB | Parameters7b | QuantizationUnknown | Context32K | Est. memory≈ 6 GB | ollama run openhermes:7b-v2.5 |
| latestdefault | Typelocal | Inputstext | Digest95477a2659b7 | Download4.1 GB | ParametersUnknown | QuantizationUnknown | Context32K | Est. memory≈ 6 GB | ollama run openhermes:latest |
| v2 | Typelocal | Inputstext | Digestf04d5fa80594 | Download4.1 GB | ParametersUnknown | QuantizationUnknown | Context32K | Est. memory≈ 6 GB | ollama run openhermes:v2 |
| v2.5 | Typelocal | Inputstext | Digest95477a2659b7 | Download4.1 GB | ParametersUnknown | QuantizationUnknown | Context32K | Est. memory≈ 6 GB | ollama run openhermes:v2.5 |
Related models
sqlcoderlocal
SQLCoder is a code completion model fined-tuned on StarCoder for SQL generation tasks
openchatlocal
A family of open-source models trained on a wide variety of data, surpassing ChatGPT on various benchmarks. Updated to version 3.5-0106.
zephyrlocal
Zephyr is a series of fine-tuned versions of the Mistral and Mixtral models that are trained to act as helpful assistants.
neural-chatlocal
A fine-tuned model based on Mistral with good coverage of domain and language.