Quick start
ollama run mistral-openorca:latestRunnable variants
Memory is a rough file-size estimate; context length, runtime and GPU offload change it.
12 of 17 matching variants shown.17 of 17 variants shown.
| Tag | Type | Inputs | Digest | Download | Parameters | Quantization | Context | Est. memory | Run |
|---|---|---|---|---|---|---|---|---|---|
| 7b | Typelocal | Inputstext | Digest12dc6acc14d0 | Download4.1 GB | Parameters7b | QuantizationUnknown | Context32K | Est. memory≈ 6 GB | ollama run mistral-openorca:7b |
| 7b-fp16 | Typelocal | Inputstext | Digestc3544390282f | Download14 GB | Parameters7b | QuantizationFP16 | Context32K | Est. memory≈ 17 GB | ollama run mistral-openorca:7b-fp16 |
| 7b-q2_K | Typelocal | Inputstext | Digest977fdfe52b7c | Download3.1 GB | Parameters7b | QuantizationQ2_K | Context32K | Est. memory≈ 4.5 GB | ollama run mistral-openorca:7b-q2_K |
| 7b-q3_K_L | Typelocal | Inputstext | Digeste80eba13740d | Download3.8 GB | Parameters7b | QuantizationQ3_K_L | Context32K | Est. memory≈ 5.5 GB | ollama run mistral-openorca:7b-q3_K_L |
| 7b-q3_K_M | Typelocal | Inputstext | Digest1c71a3f469da | Download3.5 GB | Parameters7b | QuantizationQ3_K_M | Context32K | Est. memory≈ 5 GB | ollama run mistral-openorca:7b-q3_K_M |
| 7b-q3_K_S | Typelocal | Inputstext | Digest2274bf658e73 | Download3.2 GB | Parameters7b | QuantizationQ3_K_S | Context32K | Est. memory≈ 5 GB | ollama run mistral-openorca:7b-q3_K_S |
| 7b-q4_0 | Typelocal | Inputstext | Digest12dc6acc14d0 | Download4.1 GB | Parameters7b | QuantizationQ4_0 | Context32K | Est. memory≈ 6 GB | ollama run mistral-openorca:7b-q4_0 |
| 7b-q4_1 | Typelocal | Inputstext | Digest185461182e00 | Download4.6 GB | Parameters7b | QuantizationQ4_1 | Context32K | Est. memory≈ 6.5 GB | ollama run mistral-openorca:7b-q4_1 |
| 7b-q4_K_M | Typelocal | Inputstext | Digestd4fd6870e8eb | Download4.4 GB | Parameters7b | QuantizationQ4_K_M | Context32K | Est. memory≈ 6 GB | ollama run mistral-openorca:7b-q4_K_M |
| 7b-q4_K_S | Typelocal | Inputstext | Digestb8b68de9a6c0 | Download4.1 GB | Parameters7b | QuantizationQ4_K_S | Context32K | Est. memory≈ 6 GB | ollama run mistral-openorca:7b-q4_K_S |
| 7b-q5_0 | Typelocal | Inputstext | Digestda128676aa71 | Download5.0 GB | Parameters7b | QuantizationQ5_0 | Context32K | Est. memory≈ 7 GB | ollama run mistral-openorca:7b-q5_0 |
| 7b-q5_1 | Typelocal | Inputstext | Digest864f8be0fd03 | Download5.4 GB | Parameters7b | QuantizationQ5_1 | Context32K | Est. memory≈ 7.5 GB | ollama run mistral-openorca:7b-q5_1 |
| 7b-q5_K_M | Typelocal | Inputstext | Digest30b5e000fa20 | Download5.1 GB | Parameters7b | QuantizationQ5_K_M | Context32K | Est. memory≈ 7 GB | ollama run mistral-openorca:7b-q5_K_M |
| 7b-q5_K_S | Typelocal | Inputstext | Digestdc071e3647c7 | Download5.0 GB | Parameters7b | QuantizationQ5_K_S | Context32K | Est. memory≈ 7 GB | ollama run mistral-openorca:7b-q5_K_S |
| 7b-q6_K | Typelocal | Inputstext | Digest74e3eb59f041 | Download5.9 GB | Parameters7b | QuantizationQ6_K | Context32K | Est. memory≈ 8 GB | ollama run mistral-openorca:7b-q6_K |
| 7b-q8_0 | Typelocal | Inputstext | Digestd7fd37191d96 | Download7.7 GB | Parameters7b | QuantizationQ8_0 | Context32K | Est. memory≈ 10 GB | ollama run mistral-openorca:7b-q8_0 |
| latestdefault | Typelocal | Inputstext | Digest12dc6acc14d0 | Download4.1 GB | ParametersUnknown | QuantizationUnknown | Context32K | Est. memory≈ 6 GB | ollama run mistral-openorca:latest |
Related models
sqlcoderlocal
SQLCoder is a code completion model fined-tuned on StarCoder for SQL generation tasks
openchatlocal
A family of open-source models trained on a wide variety of data, surpassing ChatGPT on various benchmarks. Updated to version 3.5-0106.
openhermeslocal
OpenHermes 2.5 is a 7B model fine-tuned by Teknium on Mistral with fully open datasets.
zephyrlocal
Zephyr is a series of fine-tuned versions of the Mistral and Mixtral models that are trained to act as helpful assistants.