Quick start

ollama run deepseek-v2:latest

Runnable variants

Memory is a rough file-size estimate; context length, runtime and GPU offload change it.

12 of 34 matching variants shown.34 of 34 variants shown.

Tag	Type	Inputs	Digest	Download	Parameters	Quantization	Context	Est. memory	Run
16b	Typelocal	Inputstext	Digest7c8c332f2df7	Download8.9 GB	Parameters16b	QuantizationUnknown	Context160K	Est. memory≈ 11 GB	`ollama run deepseek-v2:16b`
16b-lite-chat-fp16	Typelocal	Inputstext	Digest15c96490eeee	Download31 GB	Parameters16b	QuantizationFP16	Context4K	Est. memory≈ 36 GB	`ollama run deepseek-v2:16b-lite-chat-fp16`
16b-lite-chat-q2_K	Typelocal	Inputstext	Digest5868c72b4e1f	Download6.4 GB	Parameters16b	QuantizationQ2_K	Context4K	Est. memory≈ 8.5 GB	`ollama run deepseek-v2:16b-lite-chat-q2_K`
16b-lite-chat-q3_K_L	Typelocal	Inputstext	Digestc8183500d92e	Download8.5 GB	Parameters16b	QuantizationQ3_K_L	Context4K	Est. memory≈ 10.5 GB	`ollama run deepseek-v2:16b-lite-chat-q3_K_L`
16b-lite-chat-q3_K_M	Typelocal	Inputstext	Digestf6da52f6d22c	Download8.1 GB	Parameters16b	QuantizationQ3_K_M	Context4K	Est. memory≈ 10.5 GB	`ollama run deepseek-v2:16b-lite-chat-q3_K_M`
16b-lite-chat-q3_K_S	Typelocal	Inputstext	Digestd36b0e4f46c1	Download7.5 GB	Parameters16b	QuantizationQ3_K_S	Context160K	Est. memory≈ 9.5 GB	`ollama run deepseek-v2:16b-lite-chat-q3_K_S`
16b-lite-chat-q4_0	Typelocal	Inputstext	Digest7c8c332f2df7	Download8.9 GB	Parameters16b	QuantizationQ4_0	Context160K	Est. memory≈ 11 GB	`ollama run deepseek-v2:16b-lite-chat-q4_0`
16b-lite-chat-q4_1	Typelocal	Inputstext	Digestaf64dfc98c26	Download9.9 GB	Parameters16b	QuantizationQ4_1	Context4K	Est. memory≈ 12.5 GB	`ollama run deepseek-v2:16b-lite-chat-q4_1`
16b-lite-chat-q4_K_M	Typelocal	Inputstext	Digest52fe6d77050a	Download10 GB	Parameters16b	QuantizationQ4_K_M	Context4K	Est. memory≈ 12.5 GB	`ollama run deepseek-v2:16b-lite-chat-q4_K_M`
16b-lite-chat-q4_K_S	Typelocal	Inputstext	Digestf605f2eeaf9e	Download9.5 GB	Parameters16b	QuantizationQ4_K_S	Context160K	Est. memory≈ 12 GB	`ollama run deepseek-v2:16b-lite-chat-q4_K_S`
16b-lite-chat-q5_0	Typelocal	Inputstext	Digestb01c353f491f	Download11 GB	Parameters16b	QuantizationQ5_0	Context4K	Est. memory≈ 13.5 GB	`ollama run deepseek-v2:16b-lite-chat-q5_0`
16b-lite-chat-q5_1	Typelocal	Inputstext	Digest9cd31f73558a	Download12 GB	Parameters16b	QuantizationQ5_1	Context4K	Est. memory≈ 14.5 GB	`ollama run deepseek-v2:16b-lite-chat-q5_1`
16b-lite-chat-q5_K_M	Typelocal	Inputstext	Digest597226602255	Download12 GB	Parameters16b	QuantizationQ5_K_M	Context4K	Est. memory≈ 14.5 GB	`ollama run deepseek-v2:16b-lite-chat-q5_K_M`
16b-lite-chat-q5_K_S	Typelocal	Inputstext	Digestd904df1d3b59	Download11 GB	Parameters16b	QuantizationQ5_K_S	Context4K	Est. memory≈ 13.5 GB	`ollama run deepseek-v2:16b-lite-chat-q5_K_S`
16b-lite-chat-q6_K	Typelocal	Inputstext	Digest94a6c57d6c9d	Download14 GB	Parameters16b	QuantizationQ6_K	Context4K	Est. memory≈ 17 GB	`ollama run deepseek-v2:16b-lite-chat-q6_K`
16b-lite-chat-q8_0	Typelocal	Inputstext	Digest1d62ef756269	Download17 GB	Parameters16b	QuantizationQ8_0	Context4K	Est. memory≈ 20 GB	`ollama run deepseek-v2:16b-lite-chat-q8_0`
236b	Typelocal	Inputstext	Digest459de16b5a9e	Download133 GB	Parameters236b	QuantizationUnknown	Context4K	Est. memory≈ 150 GB	`ollama run deepseek-v2:236b`
236b-chat-fp16	Typelocal	Inputstext	Digest190dd01cb12e	Download472 GB	Parameters236b	QuantizationFP16	Context4K	Est. memory≈ 529 GB	`ollama run deepseek-v2:236b-chat-fp16`
236b-chat-q2_K	Typelocal	Inputstext	Digestab49a8da3233	Download86 GB	Parameters236b	QuantizationQ2_K	Context4K	Est. memory≈ 97.5 GB	`ollama run deepseek-v2:236b-chat-q2_K`
236b-chat-q3_K_L	Typelocal	Inputstext	Digest8b50480a0f69	Download122 GB	Parameters236b	QuantizationQ3_K_L	Context4K	Est. memory≈ 137.5 GB	`ollama run deepseek-v2:236b-chat-q3_K_L`
236b-chat-q3_K_M	Typelocal	Inputstext	Digested3e5b18dfdf	Download113 GB	Parameters236b	QuantizationQ3_K_M	Context4K	Est. memory≈ 127.5 GB	`ollama run deepseek-v2:236b-chat-q3_K_M`
236b-chat-q3_K_S	Typelocal	Inputstext	Digest0f85c13f95a5	Download102 GB	Parameters236b	QuantizationQ3_K_S	Context4K	Est. memory≈ 115 GB	`ollama run deepseek-v2:236b-chat-q3_K_S`
236b-chat-q4_0	Typelocal	Inputstext	Digest459de16b5a9e	Download133 GB	Parameters236b	QuantizationQ4_0	Context4K	Est. memory≈ 150 GB	`ollama run deepseek-v2:236b-chat-q4_0`
236b-chat-q4_1	Typelocal	Inputstext	Digest8ba51e080b59	Download148 GB	Parameters236b	QuantizationQ4_1	Context4K	Est. memory≈ 166.5 GB	`ollama run deepseek-v2:236b-chat-q4_1`
236b-chat-q4_K_M	Typelocal	Inputstext	Digestdc16a9f67701	Download142 GB	Parameters236b	QuantizationQ4_K_M	Context4K	Est. memory≈ 160 GB	`ollama run deepseek-v2:236b-chat-q4_K_M`
236b-chat-q4_K_S	Typelocal	Inputstext	Digest89b6c7579a77	Download134 GB	Parameters236b	QuantizationQ4_K_S	Context4K	Est. memory≈ 151 GB	`ollama run deepseek-v2:236b-chat-q4_K_S`
236b-chat-q5_0	Typelocal	Inputstext	Digestd0c79ad6c4d8	Download162 GB	Parameters236b	QuantizationQ5_0	Context4K	Est. memory≈ 182.5 GB	`ollama run deepseek-v2:236b-chat-q5_0`
236b-chat-q5_1	Typelocal	Inputstext	Digestbd9e0b0c8aa1	Download177 GB	Parameters236b	QuantizationQ5_1	Context4K	Est. memory≈ 199 GB	`ollama run deepseek-v2:236b-chat-q5_1`
236b-chat-q5_K_M	Typelocal	Inputstext	Digestbaeb44164dcf	Download167 GB	Parameters236b	QuantizationQ5_K_M	Context4K	Est. memory≈ 188 GB	`ollama run deepseek-v2:236b-chat-q5_K_M`
236b-chat-q5_K_S	Typelocal	Inputstext	Digest26f0f5933712	Download162 GB	Parameters236b	QuantizationQ5_K_S	Context4K	Est. memory≈ 182.5 GB	`ollama run deepseek-v2:236b-chat-q5_K_S`
236b-chat-q6_K	Typelocal	Inputstext	Digest40e1adc07959	Download194 GB	Parameters236b	QuantizationQ6_K	Context4K	Est. memory≈ 218 GB	`ollama run deepseek-v2:236b-chat-q6_K`
236b-chat-q8_0	Typelocal	Inputstext	Digeste0ae3350cb1a	Download251 GB	Parameters236b	QuantizationQ8_0	Context4K	Est. memory≈ 282 GB	`ollama run deepseek-v2:236b-chat-q8_0`
latestdefault	Typelocal	Inputstext	Digest7c8c332f2df7	Download8.9 GB	ParametersUnknown	QuantizationUnknown	Context160K	Est. memory≈ 11 GB	`ollama run deepseek-v2:latest`
lite	Typelocal	Inputstext	Digest7c8c332f2df7	Download8.9 GB	ParametersUnknown	QuantizationUnknown	Context160K	Est. memory≈ 11 GB	`ollama run deepseek-v2:lite`

Related models

deepseek-coder-v2local

An open-source Mixture-of-Experts code language model that achieves performance comparable to GPT4-Turbo in code-specific tasks.

ornith-1.5local

Chirp Chirp! 🐦 We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement.

deepseek-ocrlocal

DeepSeek-OCR is a vision-language model that can perform token-efficient OCR.

gemma3nlocal

Gemma 3n models are designed for efficient execution on everyday devices such as laptops, tablets or phones.