Quick start
ollama run wizard-vicuna:latestRunnable variants
Memory is a rough file-size estimate; context length, runtime and GPU offload change it.
12 of 17 matching variants shown.17 of 17 variants shown.
| Tag | Type | Inputs | Digest | Download | Parameters | Quantization | Context | Est. memory | Run |
|---|---|---|---|---|---|---|---|---|---|
| 13b | Typelocal | Inputstext | Digesta8fb469ef6bd | Download7.4 GB | Parameters13b | QuantizationUnknown | Context2K | Est. memory≈ 9.5 GB | ollama run wizard-vicuna:13b |
| 13b-fp16 | Typelocal | Inputstext | Digestcc8594c08ee8 | Download26 GB | Parameters13b | QuantizationFP16 | Context2K | Est. memory≈ 30.5 GB | ollama run wizard-vicuna:13b-fp16 |
| 13b-q2_K | Typelocal | Inputstext | Digest53b417f93f69 | Download5.4 GB | Parameters13b | QuantizationQ2_K | Context2K | Est. memory≈ 7.5 GB | ollama run wizard-vicuna:13b-q2_K |
| 13b-q3_K_L | Typelocal | Inputstext | Digesta3a73c2bdaf5 | Download6.9 GB | Parameters13b | QuantizationQ3_K_L | Context2K | Est. memory≈ 9 GB | ollama run wizard-vicuna:13b-q3_K_L |
| 13b-q3_K_M | Typelocal | Inputstext | Digestd02e7a6ee062 | Download6.3 GB | Parameters13b | QuantizationQ3_K_M | Context2K | Est. memory≈ 8.5 GB | ollama run wizard-vicuna:13b-q3_K_M |
| 13b-q3_K_S | Typelocal | Inputstext | Digestf402ed00ddb9 | Download5.7 GB | Parameters13b | QuantizationQ3_K_S | Context2K | Est. memory≈ 7.5 GB | ollama run wizard-vicuna:13b-q3_K_S |
| 13b-q4_0 | Typelocal | Inputstext | Digesta8fb469ef6bd | Download7.4 GB | Parameters13b | QuantizationQ4_0 | Context2K | Est. memory≈ 9.5 GB | ollama run wizard-vicuna:13b-q4_0 |
| 13b-q4_1 | Typelocal | Inputstext | Digest46f8af4817cc | Download8.2 GB | Parameters13b | QuantizationQ4_1 | Context2K | Est. memory≈ 10.5 GB | ollama run wizard-vicuna:13b-q4_1 |
| 13b-q4_K_M | Typelocal | Inputstext | Digest864c6cb42228 | Download7.9 GB | Parameters13b | QuantizationQ4_K_M | Context2K | Est. memory≈ 10 GB | ollama run wizard-vicuna:13b-q4_K_M |
| 13b-q4_K_S | Typelocal | Inputstext | Digest3af3cb8591e3 | Download7.4 GB | Parameters13b | QuantizationQ4_K_S | Context2K | Est. memory≈ 9.5 GB | ollama run wizard-vicuna:13b-q4_K_S |
| 13b-q5_0 | Typelocal | Inputstext | Digestd962b9bd1ae4 | Download9.0 GB | Parameters13b | QuantizationQ5_0 | Context2K | Est. memory≈ 11.5 GB | ollama run wizard-vicuna:13b-q5_0 |
| 13b-q5_1 | Typelocal | Inputstext | Digestc6e46ce79965 | Download9.8 GB | Parameters13b | QuantizationQ5_1 | Context2K | Est. memory≈ 12 GB | ollama run wizard-vicuna:13b-q5_1 |
| 13b-q5_K_M | Typelocal | Inputstext | Digest11bdc7bdd978 | Download9.2 GB | Parameters13b | QuantizationQ5_K_M | Context2K | Est. memory≈ 11.5 GB | ollama run wizard-vicuna:13b-q5_K_M |
| 13b-q5_K_S | Typelocal | Inputstext | Digest2e19ac68ead6 | Download9.0 GB | Parameters13b | QuantizationQ5_K_S | Context2K | Est. memory≈ 11.5 GB | ollama run wizard-vicuna:13b-q5_K_S |
| 13b-q6_K | Typelocal | Inputstext | Digestbfc227743375 | Download11 GB | Parameters13b | QuantizationQ6_K | Context2K | Est. memory≈ 13.5 GB | ollama run wizard-vicuna:13b-q6_K |
| 13b-q8_0 | Typelocal | Inputstext | Digest4d8e29e58cdd | Download14 GB | Parameters13b | QuantizationQ8_0 | Context2K | Est. memory≈ 17 GB | ollama run wizard-vicuna:13b-q8_0 |
| latestdefault | Typelocal | Inputstext | Digesta8fb469ef6bd | Download7.4 GB | ParametersUnknown | QuantizationUnknown | Context2K | Est. memory≈ 9.5 GB | ollama run wizard-vicuna:latest |