Quick start
ollama run exaone3.5:latestRunnable variants
Memory is a rough file-size estimate; context length, runtime and GPU offload change it.
12 of 13 matching variants shown.13 of 13 variants shown.
| Tag | Type | Inputs | Digest | Download | Parameters | Quantization | Context | Est. memory | Run |
|---|---|---|---|---|---|---|---|---|---|
| 2.4b | Typelocal | Inputstext | Digest13644fc3d28e | Download1.6 GB | Parameters2.4b | QuantizationUnknown | Context32K | Est. memory≈ 3 GB | ollama run exaone3.5:2.4b |
| 2.4b-instruct-fp16 | Typelocal | Inputstext | Digest599ce5e8a3bb | Download5.3 GB | Parameters2.4b | QuantizationFP16 | Context32K | Est. memory≈ 7 GB | ollama run exaone3.5:2.4b-instruct-fp16 |
| 2.4b-instruct-q4_K_M | Typelocal | Inputstext | Digest13644fc3d28e | Download1.6 GB | Parameters2.4b | QuantizationQ4_K_M | Context32K | Est. memory≈ 3 GB | ollama run exaone3.5:2.4b-instruct-q4_K_M |
| 2.4b-instruct-q8_0 | Typelocal | Inputstext | Digest283184b139f7 | Download2.8 GB | Parameters2.4b | QuantizationQ8_0 | Context32K | Est. memory≈ 4.5 GB | ollama run exaone3.5:2.4b-instruct-q8_0 |
| 32b | Typelocal | Inputstext | Digestf2f69abac3da | Download19 GB | Parameters32b | QuantizationUnknown | Context32K | Est. memory≈ 22.5 GB | ollama run exaone3.5:32b |
| 32b-instruct-fp16 | Typelocal | Inputstext | Digest323957e0b2cf | Download64 GB | Parameters32b | QuantizationFP16 | Context32K | Est. memory≈ 73 GB | ollama run exaone3.5:32b-instruct-fp16 |
| 32b-instruct-q4_K_M | Typelocal | Inputstext | Digestf2f69abac3da | Download19 GB | Parameters32b | QuantizationQ4_K_M | Context32K | Est. memory≈ 22.5 GB | ollama run exaone3.5:32b-instruct-q4_K_M |
| 32b-instruct-q8_0 | Typelocal | Inputstext | Digestaa9dadfef613 | Download34 GB | Parameters32b | QuantizationQ8_0 | Context32K | Est. memory≈ 39 GB | ollama run exaone3.5:32b-instruct-q8_0 |
| 7.8b | Typelocal | Inputstext | Digestc7c4e3d1ca22 | Download4.8 GB | Parameters7.8b | QuantizationUnknown | Context32K | Est. memory≈ 6.5 GB | ollama run exaone3.5:7.8b |
| 7.8b-instruct-fp16 | Typelocal | Inputstext | Digest5b3ebd118bcc | Download16 GB | Parameters7.8b | QuantizationFP16 | Context32K | Est. memory≈ 19 GB | ollama run exaone3.5:7.8b-instruct-fp16 |
| 7.8b-instruct-q4_K_M | Typelocal | Inputstext | Digestc7c4e3d1ca22 | Download4.8 GB | Parameters7.8b | QuantizationQ4_K_M | Context32K | Est. memory≈ 6.5 GB | ollama run exaone3.5:7.8b-instruct-q4_K_M |
| 7.8b-instruct-q8_0 | Typelocal | Inputstext | Digestdc6fcd786b42 | Download8.3 GB | Parameters7.8b | QuantizationQ8_0 | Context32K | Est. memory≈ 10.5 GB | ollama run exaone3.5:7.8b-instruct-q8_0 |
| latestdefault | Typelocal | Inputstext | Digestc7c4e3d1ca22 | Download4.8 GB | ParametersUnknown | QuantizationUnknown | Context32K | Est. memory≈ 6.5 GB | ollama run exaone3.5:latest |
Related models
EXAONE Deep exhibits superior capabilities in various reasoning tasks including math and coding benchmarks, ranging from 2.4B to 32B parameters developed and released by LG AI Research.
A Pocket-Sized MLLM for Ultra-Efficient Image and Video Understanding on Your Phone
moondream2 is a small vision language model designed to run efficiently on edge devices.
IBM Granite 2B and 8B models are 128K context length language models that have been fine-tuned for improved reasoning and instruction-following capabilities.