Quick start
ollama run exaone-deep:latestRunnable variants
Memory is a rough file-size estimate; context length, runtime and GPU offload change it.
12 of 13 matching variants shown.13 of 13 variants shown.
| Tag | Type | Inputs | Digest | Download | Parameters | Quantization | Context | Est. memory | Run |
|---|---|---|---|---|---|---|---|---|---|
| 2.4b | Typelocal | Inputstext | Digest37d6b495c16c | Download1.6 GB | Parameters2.4b | QuantizationUnknown | Context32K | Est. memory≈ 3 GB | ollama run exaone-deep:2.4b |
| 2.4b-fp16 | Typelocal | Inputstext | Digeste62ec685eda1 | Download5.3 GB | Parameters2.4b | QuantizationFP16 | Context32K | Est. memory≈ 7 GB | ollama run exaone-deep:2.4b-fp16 |
| 2.4b-q4_K_M | Typelocal | Inputstext | Digest37d6b495c16c | Download1.6 GB | Parameters2.4b | QuantizationQ4_K_M | Context32K | Est. memory≈ 3 GB | ollama run exaone-deep:2.4b-q4_K_M |
| 2.4b-q8_0 | Typelocal | Inputstext | Digest1ef8421dff40 | Download2.8 GB | Parameters2.4b | QuantizationQ8_0 | Context32K | Est. memory≈ 4.5 GB | ollama run exaone-deep:2.4b-q8_0 |
| 32b | Typelocal | Inputstext | Digesta9422f9a5071 | Download19 GB | Parameters32b | QuantizationUnknown | Context32K | Est. memory≈ 22.5 GB | ollama run exaone-deep:32b |
| 32b-fp16 | Typelocal | Inputstext | Digest3c652371e959 | Download64 GB | Parameters32b | QuantizationFP16 | Context32K | Est. memory≈ 73 GB | ollama run exaone-deep:32b-fp16 |
| 32b-q4_K_M | Typelocal | Inputstext | Digesta9422f9a5071 | Download19 GB | Parameters32b | QuantizationQ4_K_M | Context32K | Est. memory≈ 22.5 GB | ollama run exaone-deep:32b-q4_K_M |
| 32b-q8_0 | Typelocal | Inputstext | Digeste400e2287c21 | Download34 GB | Parameters32b | QuantizationQ8_0 | Context32K | Est. memory≈ 39 GB | ollama run exaone-deep:32b-q8_0 |
| 7.8b | Typelocal | Inputstext | Digest106afe416a9e | Download4.8 GB | Parameters7.8b | QuantizationUnknown | Context32K | Est. memory≈ 6.5 GB | ollama run exaone-deep:7.8b |
| 7.8b-fp16 | Typelocal | Inputstext | Digest3445461cbc49 | Download16 GB | Parameters7.8b | QuantizationFP16 | Context32K | Est. memory≈ 19 GB | ollama run exaone-deep:7.8b-fp16 |
| 7.8b-q4_K_M | Typelocal | Inputstext | Digest106afe416a9e | Download4.8 GB | Parameters7.8b | QuantizationQ4_K_M | Context32K | Est. memory≈ 6.5 GB | ollama run exaone-deep:7.8b-q4_K_M |
| 7.8b-q8_0 | Typelocal | Inputstext | Digestb1c039797694 | Download8.3 GB | Parameters7.8b | QuantizationQ8_0 | Context32K | Est. memory≈ 10.5 GB | ollama run exaone-deep:7.8b-q8_0 |
| latestdefault | Typelocal | Inputstext | Digest106afe416a9e | Download4.8 GB | ParametersUnknown | QuantizationUnknown | Context32K | Est. memory≈ 6.5 GB | ollama run exaone-deep:latest |
Related models
EXAONE 3.5 is a collection of instruction-tuned bilingual (English and Korean) generative models ranging from 2.4B to 32B parameters, developed and released by LG AI Research.
A Pocket-Sized MLLM for Ultra-Efficient Image and Video Understanding on Your Phone
moondream2 is a small vision language model designed to run efficiently on edge devices.
IBM Granite 2B and 8B models are 128K context length language models that have been fine-tuned for improved reasoning and instruction-following capabilities.