Quick start

ollama run deepseek-llm:latest

Runnable variants

Memory is a rough file-size estimate; context length, runtime and GPU offload change it.

12 of 64 matching variants shown.64 of 64 variants shown.

Tag	Type	Inputs	Digest	Download	Parameters	Quantization	Context	Est. memory	Run
67b	Typelocal	Inputstext	Digest52e3a994907e	Download38 GB	Parameters67b	QuantizationUnknown	Context4K	Est. memory≈ 43.5 GB	`ollama run deepseek-llm:67b`
67b-base	Typelocal	Inputstext	Digest812fa9900ddf	Download38 GB	Parameters67b	QuantizationUnknown	Context4K	Est. memory≈ 43.5 GB	`ollama run deepseek-llm:67b-base`
67b-base-fp16	Typelocal	Inputstext	Digeste6df5550194c	Download135 GB	Parameters67b	QuantizationFP16	Context4K	Est. memory≈ 152 GB	`ollama run deepseek-llm:67b-base-fp16`
67b-base-q2_K	Typelocal	Inputstext	Digeste825785a2f93	Download28 GB	Parameters67b	QuantizationQ2_K	Context4K	Est. memory≈ 32.5 GB	`ollama run deepseek-llm:67b-base-q2_K`
67b-base-q3_K_L	Typelocal	Inputstext	Digest5732c7a17baf	Download36 GB	Parameters67b	QuantizationQ3_K_L	Context4K	Est. memory≈ 41.5 GB	`ollama run deepseek-llm:67b-base-q3_K_L`
67b-base-q3_K_M	Typelocal	Inputstext	Digest528e5a0d9578	Download33 GB	Parameters67b	QuantizationQ3_K_M	Context4K	Est. memory≈ 38 GB	`ollama run deepseek-llm:67b-base-q3_K_M`
67b-base-q3_K_S	Typelocal	Inputstext	Digest408a98a3aa39	Download29 GB	Parameters67b	QuantizationQ3_K_S	Context4K	Est. memory≈ 33.5 GB	`ollama run deepseek-llm:67b-base-q3_K_S`
67b-base-q4_0	Typelocal	Inputstext	Digeste0030d0a130c	Download38 GB	Parameters67b	QuantizationQ4_0	Context4K	Est. memory≈ 43.5 GB	`ollama run deepseek-llm:67b-base-q4_0`
67b-base-q4_1	Typelocal	Inputstext	Digestedfd62087900	Download42 GB	Parameters67b	QuantizationQ4_1	Context4K	Est. memory≈ 48 GB	`ollama run deepseek-llm:67b-base-q4_1`
67b-base-q4_K_M	Typelocal	Inputstext	Digest2e28115fbaa2	Download40 GB	Parameters67b	QuantizationQ4_K_M	Context4K	Est. memory≈ 46 GB	`ollama run deepseek-llm:67b-base-q4_K_M`
67b-base-q4_K_S	Typelocal	Inputstext	Digest54fcea7dbb8c	Download38 GB	Parameters67b	QuantizationQ4_K_S	Context4K	Est. memory≈ 43.5 GB	`ollama run deepseek-llm:67b-base-q4_K_S`
67b-base-q5_0	Typelocal	Inputstext	Digest17e77ba3d4e0	Download46 GB	Parameters67b	QuantizationQ5_0	Context4K	Est. memory≈ 52.5 GB	`ollama run deepseek-llm:67b-base-q5_0`
67b-base-q5_1	Typelocal	Inputstext	Digestf53172d11749	Download51 GB	Parameters67b	QuantizationQ5_1	Context4K	Est. memory≈ 58 GB	`ollama run deepseek-llm:67b-base-q5_1`
67b-base-q5_K_M	Typelocal	Inputstext	Digesteb54db87f46b	Download48 GB	Parameters67b	QuantizationQ5_K_M	Context4K	Est. memory≈ 55 GB	`ollama run deepseek-llm:67b-base-q5_K_M`
67b-base-q5_K_S	Typelocal	Inputstext	Digest7520f31e16ab	Download46 GB	Parameters67b	QuantizationQ5_K_S	Context4K	Est. memory≈ 52.5 GB	`ollama run deepseek-llm:67b-base-q5_K_S`
67b-base-q6_K	Typelocal	Inputstext	Digeste3c177377638	Download55 GB	Parameters67b	QuantizationQ6_K	Context4K	Est. memory≈ 62.5 GB	`ollama run deepseek-llm:67b-base-q6_K`
67b-base-q8_0	Typelocal	Inputstext	Digesta761daaf2ef3	Download72 GB	Parameters67b	QuantizationQ8_0	Context4K	Est. memory≈ 81.5 GB	`ollama run deepseek-llm:67b-base-q8_0`
67b-chat	Typelocal	Inputstext	Digest52e3a994907e	Download38 GB	Parameters67b	QuantizationUnknown	Context4K	Est. memory≈ 43.5 GB	`ollama run deepseek-llm:67b-chat`
67b-chat-fp16	Typelocal	Inputstext	Digestd6b76eec8c4d	Download135 GB	Parameters67b	QuantizationFP16	Context4K	Est. memory≈ 152 GB	`ollama run deepseek-llm:67b-chat-fp16`
67b-chat-q2_K	Typelocal	Inputstext	Digestc3ed3a6823d9	Download28 GB	Parameters67b	QuantizationQ2_K	Context4K	Est. memory≈ 32.5 GB	`ollama run deepseek-llm:67b-chat-q2_K`
67b-chat-q3_K_L	Typelocal	Inputstext	Digesta3c982459f4b	Download36 GB	Parameters67b	QuantizationQ3_K_L	Context4K	Est. memory≈ 41.5 GB	`ollama run deepseek-llm:67b-chat-q3_K_L`
67b-chat-q3_K_M	Typelocal	Inputstext	Digestb1b9aa6f99e5	Download33 GB	Parameters67b	QuantizationQ3_K_M	Context4K	Est. memory≈ 38 GB	`ollama run deepseek-llm:67b-chat-q3_K_M`
67b-chat-q3_K_S	Typelocal	Inputstext	Digestc895ed448eb0	Download29 GB	Parameters67b	QuantizationQ3_K_S	Context4K	Est. memory≈ 33.5 GB	`ollama run deepseek-llm:67b-chat-q3_K_S`
67b-chat-q4_0	Typelocal	Inputstext	Digest52e3a994907e	Download38 GB	Parameters67b	QuantizationQ4_0	Context4K	Est. memory≈ 43.5 GB	`ollama run deepseek-llm:67b-chat-q4_0`
67b-chat-q4_1	Typelocal	Inputstext	Digest40876e9c44d1	Download42 GB	Parameters67b	QuantizationQ4_1	Context4K	Est. memory≈ 48 GB	`ollama run deepseek-llm:67b-chat-q4_1`
67b-chat-q4_K_M	Typelocal	Inputstext	Digest725af9db4539	Download40 GB	Parameters67b	QuantizationQ4_K_M	Context4K	Est. memory≈ 46 GB	`ollama run deepseek-llm:67b-chat-q4_K_M`
67b-chat-q4_K_S	Typelocal	Inputstext	Digest423d421ad0d5	Download38 GB	Parameters67b	QuantizationQ4_K_S	Context4K	Est. memory≈ 43.5 GB	`ollama run deepseek-llm:67b-chat-q4_K_S`
67b-chat-q5_0	Typelocal	Inputstext	Digest1c18f10ba2e4	Download46 GB	Parameters67b	QuantizationQ5_0	Context4K	Est. memory≈ 52.5 GB	`ollama run deepseek-llm:67b-chat-q5_0`
67b-chat-q5_1	Typelocal	Inputstext	Digestb8d2c6772755	Download51 GB	Parameters67b	QuantizationQ5_1	Context4K	Est. memory≈ 58 GB	`ollama run deepseek-llm:67b-chat-q5_1`
67b-chat-q5_K_S	Typelocal	Inputstext	Digestb36dd4fb3d5e	Download46 GB	Parameters67b	QuantizationQ5_K_S	Context4K	Est. memory≈ 52.5 GB	`ollama run deepseek-llm:67b-chat-q5_K_S`
7b	Typelocal	Inputstext	Digest9aab369a853b	Download4.0 GB	Parameters7b	QuantizationUnknown	Context4K	Est. memory≈ 5.5 GB	`ollama run deepseek-llm:7b`
7b-base	Typelocal	Inputstext	Digest4203036ff5c6	Download4.0 GB	Parameters7b	QuantizationUnknown	Context4K	Est. memory≈ 5.5 GB	`ollama run deepseek-llm:7b-base`
7b-base-fp16	Typelocal	Inputstext	Digest9734e95557cb	Download14 GB	Parameters7b	QuantizationFP16	Context4K	Est. memory≈ 17 GB	`ollama run deepseek-llm:7b-base-fp16`
7b-base-q2_K	Typelocal	Inputstext	Digestf60ec77b8e40	Download3.0 GB	Parameters7b	QuantizationQ2_K	Context4K	Est. memory≈ 4.5 GB	`ollama run deepseek-llm:7b-base-q2_K`
7b-base-q3_K_L	Typelocal	Inputstext	Digest5cfddffa852a	Download3.7 GB	Parameters7b	QuantizationQ3_K_L	Context4K	Est. memory≈ 5.5 GB	`ollama run deepseek-llm:7b-base-q3_K_L`
7b-base-q3_K_M	Typelocal	Inputstext	Digest103a0ee8b936	Download3.5 GB	Parameters7b	QuantizationQ3_K_M	Context4K	Est. memory≈ 5 GB	`ollama run deepseek-llm:7b-base-q3_K_M`
7b-base-q3_K_S	Typelocal	Inputstext	Digest1cb2f80e4f56	Download3.1 GB	Parameters7b	QuantizationQ3_K_S	Context4K	Est. memory≈ 4.5 GB	`ollama run deepseek-llm:7b-base-q3_K_S`
7b-base-q4_0	Typelocal	Inputstext	Digest4203036ff5c6	Download4.0 GB	Parameters7b	QuantizationQ4_0	Context4K	Est. memory≈ 5.5 GB	`ollama run deepseek-llm:7b-base-q4_0`
7b-base-q4_1	Typelocal	Inputstext	Digest46f074d9e65d	Download4.4 GB	Parameters7b	QuantizationQ4_1	Context4K	Est. memory≈ 6 GB	`ollama run deepseek-llm:7b-base-q4_1`
7b-base-q4_K_M	Typelocal	Inputstext	Digest5642a7c42df6	Download4.2 GB	Parameters7b	QuantizationQ4_K_M	Context4K	Est. memory≈ 6 GB	`ollama run deepseek-llm:7b-base-q4_K_M`
7b-base-q4_K_S	Typelocal	Inputstext	Digest533d51f259e0	Download4.0 GB	Parameters7b	QuantizationQ4_K_S	Context4K	Est. memory≈ 5.5 GB	`ollama run deepseek-llm:7b-base-q4_K_S`
7b-base-q5_0	Typelocal	Inputstext	Digestf80b2a0aafa3	Download4.8 GB	Parameters7b	QuantizationQ5_0	Context4K	Est. memory≈ 6.5 GB	`ollama run deepseek-llm:7b-base-q5_0`
7b-base-q5_1	Typelocal	Inputstext	Digesta4945c0aad33	Download5.2 GB	Parameters7b	QuantizationQ5_1	Context4K	Est. memory≈ 7 GB	`ollama run deepseek-llm:7b-base-q5_1`
7b-base-q5_K_M	Typelocal	Inputstext	Digest947b7d710d2a	Download4.9 GB	Parameters7b	QuantizationQ5_K_M	Context4K	Est. memory≈ 6.5 GB	`ollama run deepseek-llm:7b-base-q5_K_M`
7b-base-q5_K_S	Typelocal	Inputstext	Digest752d030cca1f	Download4.8 GB	Parameters7b	QuantizationQ5_K_S	Context4K	Est. memory≈ 6.5 GB	`ollama run deepseek-llm:7b-base-q5_K_S`
7b-base-q6_K	Typelocal	Inputstext	Digest5aa79848f58a	Download5.7 GB	Parameters7b	QuantizationQ6_K	Context4K	Est. memory≈ 7.5 GB	`ollama run deepseek-llm:7b-base-q6_K`
7b-base-q8_0	Typelocal	Inputstext	Digest290d6e4a492a	Download7.3 GB	Parameters7b	QuantizationQ8_0	Context4K	Est. memory≈ 9.5 GB	`ollama run deepseek-llm:7b-base-q8_0`
7b-chat	Typelocal	Inputstext	Digest9aab369a853b	Download4.0 GB	Parameters7b	QuantizationUnknown	Context4K	Est. memory≈ 5.5 GB	`ollama run deepseek-llm:7b-chat`
7b-chat-fp16	Typelocal	Inputstext	Digestae8dc23002ea	Download14 GB	Parameters7b	QuantizationFP16	Context4K	Est. memory≈ 17 GB	`ollama run deepseek-llm:7b-chat-fp16`
7b-chat-q2_K	Typelocal	Inputstext	Digesta4b98c76e2cb	Download3.0 GB	Parameters7b	QuantizationQ2_K	Context4K	Est. memory≈ 4.5 GB	`ollama run deepseek-llm:7b-chat-q2_K`
7b-chat-q3_K_L	Typelocal	Inputstext	Digestc673aa801a81	Download3.7 GB	Parameters7b	QuantizationQ3_K_L	Context4K	Est. memory≈ 5.5 GB	`ollama run deepseek-llm:7b-chat-q3_K_L`
7b-chat-q3_K_M	Typelocal	Inputstext	Digest04a0bfbcef69	Download3.5 GB	Parameters7b	QuantizationQ3_K_M	Context4K	Est. memory≈ 5 GB	`ollama run deepseek-llm:7b-chat-q3_K_M`
7b-chat-q3_K_S	Typelocal	Inputstext	Digesta9871e41151d	Download3.1 GB	Parameters7b	QuantizationQ3_K_S	Context4K	Est. memory≈ 4.5 GB	`ollama run deepseek-llm:7b-chat-q3_K_S`
7b-chat-q4_0	Typelocal	Inputstext	Digest9aab369a853b	Download4.0 GB	Parameters7b	QuantizationQ4_0	Context4K	Est. memory≈ 5.5 GB	`ollama run deepseek-llm:7b-chat-q4_0`
7b-chat-q4_1	Typelocal	Inputstext	Digestdbbe28577e21	Download4.4 GB	Parameters7b	QuantizationQ4_1	Context4K	Est. memory≈ 6 GB	`ollama run deepseek-llm:7b-chat-q4_1`
7b-chat-q4_K_M	Typelocal	Inputstext	Digest72299d61ee1d	Download4.2 GB	Parameters7b	QuantizationQ4_K_M	Context4K	Est. memory≈ 6 GB	`ollama run deepseek-llm:7b-chat-q4_K_M`
7b-chat-q4_K_S	Typelocal	Inputstext	Digestbc8345b3132d	Download4.0 GB	Parameters7b	QuantizationQ4_K_S	Context4K	Est. memory≈ 5.5 GB	`ollama run deepseek-llm:7b-chat-q4_K_S`
7b-chat-q5_0	Typelocal	Inputstext	Digestce25c228f6ca	Download4.8 GB	Parameters7b	QuantizationQ5_0	Context4K	Est. memory≈ 6.5 GB	`ollama run deepseek-llm:7b-chat-q5_0`
7b-chat-q5_1	Typelocal	Inputstext	Digest20fda1383308	Download5.2 GB	Parameters7b	QuantizationQ5_1	Context4K	Est. memory≈ 7 GB	`ollama run deepseek-llm:7b-chat-q5_1`
7b-chat-q5_K_M	Typelocal	Inputstext	Digest1d4fc287cd19	Download4.9 GB	Parameters7b	QuantizationQ5_K_M	Context4K	Est. memory≈ 6.5 GB	`ollama run deepseek-llm:7b-chat-q5_K_M`
7b-chat-q5_K_S	Typelocal	Inputstext	Digestbabfe64fb008	Download4.8 GB	Parameters7b	QuantizationQ5_K_S	Context4K	Est. memory≈ 6.5 GB	`ollama run deepseek-llm:7b-chat-q5_K_S`
7b-chat-q6_K	Typelocal	Inputstext	Digest057c2c5300aa	Download5.7 GB	Parameters7b	QuantizationQ6_K	Context4K	Est. memory≈ 7.5 GB	`ollama run deepseek-llm:7b-chat-q6_K`
7b-chat-q8_0	Typelocal	Inputstext	Digest83e5a9a28d09	Download7.3 GB	Parameters7b	QuantizationQ8_0	Context4K	Est. memory≈ 9.5 GB	`ollama run deepseek-llm:7b-chat-q8_0`
latestdefault	Typelocal	Inputstext	Digest9aab369a853b	Download4.0 GB	ParametersUnknown	QuantizationUnknown	Context4K	Est. memory≈ 5.5 GB	`ollama run deepseek-llm:latest`

Related models

ministral-3local

The Ministral 3 family is designed for edge deployment, capable of running on a wide range of hardware.

bespoke-minichecklocal

A state-of-the-art fact-checking model developed by Bespoke Labs.

sqlcoderlocal

SQLCoder is a code completion model fined-tuned on StarCoder for SQL generation tasks

openchatlocal

A family of open-source models trained on a wide variety of data, surpassing ChatGPT on various benchmarks. Updated to version 3.5-0106.