Quick start

ollama run llama3:latest

Runnable variants

Memory is a rough file-size estimate; context length, runtime and GPU offload change it.

12 of 68 matching variants shown.68 of 68 variants shown.

Tag	Type	Inputs	Digest	Download	Parameters	Quantization	Context	Est. memory	Run
70b	Typelocal	Inputstext	Digest786f3184aec0	Download40 GB	Parameters70b	QuantizationUnknown	Context8K	Est. memory≈ 46 GB	`ollama run llama3:70b`
70b-instruct	Typelocal	Inputstext	Digest786f3184aec0	Download40 GB	Parameters70b	QuantizationUnknown	Context8K	Est. memory≈ 46 GB	`ollama run llama3:70b-instruct`
70b-instruct-fp16	Typelocal	Inputstext	Digesta84c389adf03	Download141 GB	Parameters70b	QuantizationFP16	Context8K	Est. memory≈ 159 GB	`ollama run llama3:70b-instruct-fp16`
70b-instruct-q2_K	Typelocal	Inputstext	Digest693db6efd8f9	Download26 GB	Parameters70b	QuantizationQ2_K	Context8K	Est. memory≈ 30.5 GB	`ollama run llama3:70b-instruct-q2_K`
70b-instruct-q3_K_L	Typelocal	Inputstext	Digeste5d560a5f1ae	Download37 GB	Parameters70b	QuantizationQ3_K_L	Context8K	Est. memory≈ 42.5 GB	`ollama run llama3:70b-instruct-q3_K_L`
70b-instruct-q3_K_M	Typelocal	Inputstext	Digestaa0e78b2b879	Download34 GB	Parameters70b	QuantizationQ3_K_M	Context8K	Est. memory≈ 39 GB	`ollama run llama3:70b-instruct-q3_K_M`
70b-instruct-q3_K_S	Typelocal	Inputstext	Digest4c1a815173f7	Download31 GB	Parameters70b	QuantizationQ3_K_S	Context8K	Est. memory≈ 36 GB	`ollama run llama3:70b-instruct-q3_K_S`
70b-instruct-q4_0	Typelocal	Inputstext	Digest786f3184aec0	Download40 GB	Parameters70b	QuantizationQ4_0	Context8K	Est. memory≈ 46 GB	`ollama run llama3:70b-instruct-q4_0`
70b-instruct-q4_1	Typelocal	Inputstext	Digestdf99b9a013cf	Download44 GB	Parameters70b	QuantizationQ4_1	Context8K	Est. memory≈ 50.5 GB	`ollama run llama3:70b-instruct-q4_1`
70b-instruct-q4_K_M	Typelocal	Inputstext	Digestf04e196898af	Download43 GB	Parameters70b	QuantizationQ4_K_M	Context8K	Est. memory≈ 49.5 GB	`ollama run llama3:70b-instruct-q4_K_M`
70b-instruct-q4_K_S	Typelocal	Inputstext	Digest3b5ca57de719	Download40 GB	Parameters70b	QuantizationQ4_K_S	Context8K	Est. memory≈ 46 GB	`ollama run llama3:70b-instruct-q4_K_S`
70b-instruct-q5_0	Typelocal	Inputstext	Digest4b557d9edc8f	Download49 GB	Parameters70b	QuantizationQ5_0	Context8K	Est. memory≈ 56 GB	`ollama run llama3:70b-instruct-q5_0`
70b-instruct-q5_1	Typelocal	Inputstext	Digest8fc800ccfec4	Download53 GB	Parameters70b	QuantizationQ5_1	Context8K	Est. memory≈ 60.5 GB	`ollama run llama3:70b-instruct-q5_1`
70b-instruct-q5_K_M	Typelocal	Inputstext	Digest4e84a5514862	Download50 GB	Parameters70b	QuantizationQ5_K_M	Context8K	Est. memory≈ 57 GB	`ollama run llama3:70b-instruct-q5_K_M`
70b-instruct-q5_K_S	Typelocal	Inputstext	Digest639ad63d3803	Download49 GB	Parameters70b	QuantizationQ5_K_S	Context8K	Est. memory≈ 56 GB	`ollama run llama3:70b-instruct-q5_K_S`
70b-instruct-q6_K	Typelocal	Inputstext	Digesta50a7631e818	Download58 GB	Parameters70b	QuantizationQ6_K	Context8K	Est. memory≈ 66 GB	`ollama run llama3:70b-instruct-q6_K`
70b-instruct-q8_0	Typelocal	Inputstext	Digest13ef6d4ac2af	Download75 GB	Parameters70b	QuantizationQ8_0	Context8K	Est. memory≈ 85 GB	`ollama run llama3:70b-instruct-q8_0`
70b-text	Typelocal	Inputstext	Digest0b88ea68f949	Download40 GB	Parameters70b	QuantizationUnknown	Context8K	Est. memory≈ 46 GB	`ollama run llama3:70b-text`
70b-text-fp16	Typelocal	Inputstext	Digestf698d14954d3	Download141 GB	Parameters70b	QuantizationFP16	Context8K	Est. memory≈ 159 GB	`ollama run llama3:70b-text-fp16`
70b-text-q2_K	Typelocal	Inputstext	Digest8e7acd975e4c	Download26 GB	Parameters70b	QuantizationQ2_K	Context8K	Est. memory≈ 30.5 GB	`ollama run llama3:70b-text-q2_K`
70b-text-q3_K_L	Typelocal	Inputstext	Digesta59e68b60a66	Download37 GB	Parameters70b	QuantizationQ3_K_L	Context8K	Est. memory≈ 42.5 GB	`ollama run llama3:70b-text-q3_K_L`
70b-text-q3_K_M	Typelocal	Inputstext	Digest05a42206e81a	Download34 GB	Parameters70b	QuantizationQ3_K_M	Context8K	Est. memory≈ 39 GB	`ollama run llama3:70b-text-q3_K_M`
70b-text-q3_K_S	Typelocal	Inputstext	Digest85adac3167c3	Download31 GB	Parameters70b	QuantizationQ3_K_S	Context8K	Est. memory≈ 36 GB	`ollama run llama3:70b-text-q3_K_S`
70b-text-q4_0	Typelocal	Inputstext	Digest0b88ea68f949	Download40 GB	Parameters70b	QuantizationQ4_0	Context8K	Est. memory≈ 46 GB	`ollama run llama3:70b-text-q4_0`
70b-text-q4_1	Typelocal	Inputstext	Digest0568b52cd894	Download44 GB	Parameters70b	QuantizationQ4_1	Context8K	Est. memory≈ 50.5 GB	`ollama run llama3:70b-text-q4_1`
70b-text-q4_K_M	Typelocal	Inputstext	Digestd1a70936a292	Download43 GB	Parameters70b	QuantizationQ4_K_M	Context8K	Est. memory≈ 49.5 GB	`ollama run llama3:70b-text-q4_K_M`
70b-text-q4_K_S	Typelocal	Inputstext	Digest13aba0c20a4a	Download40 GB	Parameters70b	QuantizationQ4_K_S	Context8K	Est. memory≈ 46 GB	`ollama run llama3:70b-text-q4_K_S`
70b-text-q5_0	Typelocal	Inputstext	Digest878949e474d3	Download49 GB	Parameters70b	QuantizationQ5_0	Context8K	Est. memory≈ 56 GB	`ollama run llama3:70b-text-q5_0`
70b-text-q5_1	Typelocal	Inputstext	Digestf26e4666536b	Download53 GB	Parameters70b	QuantizationQ5_1	Context8K	Est. memory≈ 60.5 GB	`ollama run llama3:70b-text-q5_1`
70b-text-q5_K_M	Typelocal	Inputstext	Digest3a9680b7a812	Download50 GB	Parameters70b	QuantizationQ5_K_M	Context8K	Est. memory≈ 57 GB	`ollama run llama3:70b-text-q5_K_M`
70b-text-q5_K_S	Typelocal	Inputstext	Digest3c9bae7f46ba	Download49 GB	Parameters70b	QuantizationQ5_K_S	Context8K	Est. memory≈ 56 GB	`ollama run llama3:70b-text-q5_K_S`
70b-text-q6_K	Typelocal	Inputstext	Digest9a3e4b9ce0a2	Download58 GB	Parameters70b	QuantizationQ6_K	Context8K	Est. memory≈ 66 GB	`ollama run llama3:70b-text-q6_K`
70b-text-q8_0	Typelocal	Inputstext	Digestec846ca4f4c2	Download75 GB	Parameters70b	QuantizationQ8_0	Context8K	Est. memory≈ 85 GB	`ollama run llama3:70b-text-q8_0`
8b	Typelocal	Inputstext	Digest365c0bd3c000	Download4.7 GB	Parameters8b	QuantizationUnknown	Context8K	Est. memory≈ 6.5 GB	`ollama run llama3:8b`
8b-instruct-fp16	Typelocal	Inputstext	Digestc666fe422df7	Download16 GB	Parameters8b	QuantizationFP16	Context8K	Est. memory≈ 19 GB	`ollama run llama3:8b-instruct-fp16`
8b-instruct-q2_K	Typelocal	Inputstext	Digest2745d547f376	Download3.2 GB	Parameters8b	QuantizationQ2_K	Context8K	Est. memory≈ 5 GB	`ollama run llama3:8b-instruct-q2_K`
8b-instruct-q3_K_L	Typelocal	Inputstext	Digestdf7624806f55	Download4.3 GB	Parameters8b	QuantizationQ3_K_L	Context8K	Est. memory≈ 6 GB	`ollama run llama3:8b-instruct-q3_K_L`
8b-instruct-q3_K_M	Typelocal	Inputstext	Digest726a1960bfed	Download4.0 GB	Parameters8b	QuantizationQ3_K_M	Context8K	Est. memory≈ 5.5 GB	`ollama run llama3:8b-instruct-q3_K_M`
8b-instruct-q3_K_S	Typelocal	Inputstext	Digest0891d012c467	Download3.7 GB	Parameters8b	QuantizationQ3_K_S	Context8K	Est. memory≈ 5.5 GB	`ollama run llama3:8b-instruct-q3_K_S`
8b-instruct-q4_0	Typelocal	Inputstext	Digest365c0bd3c000	Download4.7 GB	Parameters8b	QuantizationQ4_0	Context8K	Est. memory≈ 6.5 GB	`ollama run llama3:8b-instruct-q4_0`
8b-instruct-q4_1	Typelocal	Inputstext	Digestec0a6ea1fb9b	Download5.1 GB	Parameters8b	QuantizationQ4_1	Context8K	Est. memory≈ 7 GB	`ollama run llama3:8b-instruct-q4_1`
8b-instruct-q4_K_M	Typelocal	Inputstext	Digest9b8f3f3385bf	Download4.9 GB	Parameters8b	QuantizationQ4_K_M	Context8K	Est. memory≈ 6.5 GB	`ollama run llama3:8b-instruct-q4_K_M`
8b-instruct-q4_K_S	Typelocal	Inputstext	Digest469db3d82576	Download4.7 GB	Parameters8b	QuantizationQ4_K_S	Context8K	Est. memory≈ 6.5 GB	`ollama run llama3:8b-instruct-q4_K_S`
8b-instruct-q5_0	Typelocal	Inputstext	Digesta13deb0590c7	Download5.6 GB	Parameters8b	QuantizationQ5_0	Context8K	Est. memory≈ 7.5 GB	`ollama run llama3:8b-instruct-q5_0`
8b-instruct-q5_1	Typelocal	Inputstext	Digest662158bc9277	Download6.1 GB	Parameters8b	QuantizationQ5_1	Context8K	Est. memory≈ 8 GB	`ollama run llama3:8b-instruct-q5_1`
8b-instruct-q5_K_M	Typelocal	Inputstext	Digestaf3083b17cd4	Download5.7 GB	Parameters8b	QuantizationQ5_K_M	Context8K	Est. memory≈ 7.5 GB	`ollama run llama3:8b-instruct-q5_K_M`
8b-instruct-q5_K_S	Typelocal	Inputstext	Digest7eae3176f5b5	Download5.6 GB	Parameters8b	QuantizationQ5_K_S	Context8K	Est. memory≈ 7.5 GB	`ollama run llama3:8b-instruct-q5_K_S`
8b-instruct-q6_K	Typelocal	Inputstext	Digeste4a3943fcd76	Download6.6 GB	Parameters8b	QuantizationQ6_K	Context8K	Est. memory≈ 8.5 GB	`ollama run llama3:8b-instruct-q6_K`
8b-instruct-q8_0	Typelocal	Inputstext	Digest1b8e49cece7f	Download8.5 GB	Parameters8b	QuantizationQ8_0	Context8K	Est. memory≈ 10.5 GB	`ollama run llama3:8b-instruct-q8_0`
8b-text	Typelocal	Inputstext	Digest870a5d02cfaf	Download4.7 GB	Parameters8b	QuantizationUnknown	Context8K	Est. memory≈ 6.5 GB	`ollama run llama3:8b-text`
8b-text-fp16	Typelocal	Inputstext	Digest1a8e5e89d89c	Download16 GB	Parameters8b	QuantizationFP16	Context8K	Est. memory≈ 19 GB	`ollama run llama3:8b-text-fp16`
8b-text-q2_K	Typelocal	Inputstext	Digestddab15c8cb9c	Download3.2 GB	Parameters8b	QuantizationQ2_K	Context8K	Est. memory≈ 5 GB	`ollama run llama3:8b-text-q2_K`
8b-text-q3_K_L	Typelocal	Inputstext	Digestc8a0b2fe8826	Download4.3 GB	Parameters8b	QuantizationQ3_K_L	Context8K	Est. memory≈ 6 GB	`ollama run llama3:8b-text-q3_K_L`
8b-text-q3_K_M	Typelocal	Inputstext	Digest8dc24663264e	Download4.0 GB	Parameters8b	QuantizationQ3_K_M	Context8K	Est. memory≈ 5.5 GB	`ollama run llama3:8b-text-q3_K_M`
8b-text-q3_K_S	Typelocal	Inputstext	Digestef8314434744	Download3.7 GB	Parameters8b	QuantizationQ3_K_S	Context8K	Est. memory≈ 5.5 GB	`ollama run llama3:8b-text-q3_K_S`
8b-text-q4_0	Typelocal	Inputstext	Digest870a5d02cfaf	Download4.7 GB	Parameters8b	QuantizationQ4_0	Context8K	Est. memory≈ 6.5 GB	`ollama run llama3:8b-text-q4_0`
8b-text-q4_1	Typelocal	Inputstext	Digest6b5617036d84	Download5.1 GB	Parameters8b	QuantizationQ4_1	Context8K	Est. memory≈ 7 GB	`ollama run llama3:8b-text-q4_1`
8b-text-q4_K_M	Typelocal	Inputstext	Digest92666a9c24c8	Download4.9 GB	Parameters8b	QuantizationQ4_K_M	Context8K	Est. memory≈ 6.5 GB	`ollama run llama3:8b-text-q4_K_M`
8b-text-q4_K_S	Typelocal	Inputstext	Digest9a26d72d3e16	Download4.7 GB	Parameters8b	QuantizationQ4_K_S	Context8K	Est. memory≈ 6.5 GB	`ollama run llama3:8b-text-q4_K_S`
8b-text-q5_0	Typelocal	Inputstext	Digestfcf1eef68171	Download5.6 GB	Parameters8b	QuantizationQ5_0	Context8K	Est. memory≈ 7.5 GB	`ollama run llama3:8b-text-q5_0`
8b-text-q5_1	Typelocal	Inputstext	Digest3c3ab90050f5	Download6.1 GB	Parameters8b	QuantizationQ5_1	Context8K	Est. memory≈ 8 GB	`ollama run llama3:8b-text-q5_1`
8b-text-q5_K_M	Typelocal	Inputstext	Digestf8dbc557876f	Download5.7 GB	Parameters8b	QuantizationQ5_K_M	Context8K	Est. memory≈ 7.5 GB	`ollama run llama3:8b-text-q5_K_M`
8b-text-q5_K_S	Typelocal	Inputstext	Digest248acc1da82b	Download5.6 GB	Parameters8b	QuantizationQ5_K_S	Context8K	Est. memory≈ 7.5 GB	`ollama run llama3:8b-text-q5_K_S`
8b-text-q6_K	Typelocal	Inputstext	Digeste8210b245747	Download6.6 GB	Parameters8b	QuantizationQ6_K	Context8K	Est. memory≈ 8.5 GB	`ollama run llama3:8b-text-q6_K`
8b-text-q8_0	Typelocal	Inputstext	Digest7a0307e073ae	Download8.5 GB	Parameters8b	QuantizationQ8_0	Context8K	Est. memory≈ 10.5 GB	`ollama run llama3:8b-text-q8_0`
instruct	Typelocal	Inputstext	Digest365c0bd3c000	Download4.7 GB	ParametersUnknown	QuantizationUnknown	Context8K	Est. memory≈ 6.5 GB	`ollama run llama3:instruct`
latestdefault	Typelocal	Inputstext	Digest365c0bd3c000	Download4.7 GB	ParametersUnknown	QuantizationUnknown	Context8K	Est. memory≈ 6.5 GB	`ollama run llama3:latest`
text	Typelocal	Inputstext	Digest870a5d02cfaf	Download4.7 GB	ParametersUnknown	QuantizationUnknown	Context8K	Est. memory≈ 6.5 GB	`ollama run llama3:text`

Related models

llama3.1local

Llama 3.1 is a new state-of-the-art model from Meta available in 8B, 70B and 405B parameter sizes.

llavalocal

🌋 LLaVA is a novel end-to-end trained large multimodal model that combines a vision encoder and Vicuna for general-purpose visual and language understanding. Updated to version 1.6.

qwen2.5vllocal

Flagship vision-language model of Qwen and also a significant leap from the previous Qwen2-VL.

dolphin-llama3local

Dolphin 2.9 is a new model with 8B and 70B sizes by Eric Hartford based on Llama 3 that has a variety of instruction, conversational, and coding skills.