Quick start

ollama run llama3-chatqa:latest

Runnable variants

Memory is a rough file-size estimate; context length, runtime and GPU offload change it.

12 of 35 matching variants shown.35 of 35 variants shown.

Tag	Type	Inputs	Digest	Download	Parameters	Quantization	Context	Est. memory	Run
70b	Typelocal	Inputstext	Digestab8941f03aa3	Download40 GB	Parameters70b	QuantizationUnknown	Context8K	Est. memory≈ 46 GB	`ollama run llama3-chatqa:70b`
70b-v1.5	Typelocal	Inputstext	Digestab8941f03aa3	Download40 GB	Parameters70b	QuantizationUnknown	Context8K	Est. memory≈ 46 GB	`ollama run llama3-chatqa:70b-v1.5`
70b-v1.5-fp16	Typelocal	Inputstext	Digestd46dd05cde4c	Download141 GB	Parameters70b	QuantizationFP16	Context8K	Est. memory≈ 159 GB	`ollama run llama3-chatqa:70b-v1.5-fp16`
70b-v1.5-q2_K	Typelocal	Inputstext	Digest8fde9769839c	Download26 GB	Parameters70b	QuantizationQ2_K	Context8K	Est. memory≈ 30.5 GB	`ollama run llama3-chatqa:70b-v1.5-q2_K`
70b-v1.5-q3_K_L	Typelocal	Inputstext	Digestd894d5e58d1e	Download37 GB	Parameters70b	QuantizationQ3_K_L	Context8K	Est. memory≈ 42.5 GB	`ollama run llama3-chatqa:70b-v1.5-q3_K_L`
70b-v1.5-q3_K_M	Typelocal	Inputstext	Digest47d621963e0c	Download34 GB	Parameters70b	QuantizationQ3_K_M	Context8K	Est. memory≈ 39 GB	`ollama run llama3-chatqa:70b-v1.5-q3_K_M`
70b-v1.5-q3_K_S	Typelocal	Inputstext	Digest6c487abb0e1f	Download31 GB	Parameters70b	QuantizationQ3_K_S	Context8K	Est. memory≈ 36 GB	`ollama run llama3-chatqa:70b-v1.5-q3_K_S`
70b-v1.5-q4_0	Typelocal	Inputstext	Digestab8941f03aa3	Download40 GB	Parameters70b	QuantizationQ4_0	Context8K	Est. memory≈ 46 GB	`ollama run llama3-chatqa:70b-v1.5-q4_0`
70b-v1.5-q4_1	Typelocal	Inputstext	Digestae356afdf521	Download44 GB	Parameters70b	QuantizationQ4_1	Context8K	Est. memory≈ 50.5 GB	`ollama run llama3-chatqa:70b-v1.5-q4_1`
70b-v1.5-q4_K_M	Typelocal	Inputstext	Digestbd9cc94a71c9	Download43 GB	Parameters70b	QuantizationQ4_K_M	Context8K	Est. memory≈ 49.5 GB	`ollama run llama3-chatqa:70b-v1.5-q4_K_M`
70b-v1.5-q4_K_S	Typelocal	Inputstext	Digest7d6f62f9c1c6	Download40 GB	Parameters70b	QuantizationQ4_K_S	Context8K	Est. memory≈ 46 GB	`ollama run llama3-chatqa:70b-v1.5-q4_K_S`
70b-v1.5-q5_0	Typelocal	Inputstext	Digest29f1075baf3a	Download49 GB	Parameters70b	QuantizationQ5_0	Context8K	Est. memory≈ 56 GB	`ollama run llama3-chatqa:70b-v1.5-q5_0`
70b-v1.5-q5_1	Typelocal	Inputstext	Digest3adf827c2f0c	Download53 GB	Parameters70b	QuantizationQ5_1	Context8K	Est. memory≈ 60.5 GB	`ollama run llama3-chatqa:70b-v1.5-q5_1`
70b-v1.5-q5_K_M	Typelocal	Inputstext	Digest275a26d672ac	Download50 GB	Parameters70b	QuantizationQ5_K_M	Context8K	Est. memory≈ 57 GB	`ollama run llama3-chatqa:70b-v1.5-q5_K_M`
70b-v1.5-q5_K_S	Typelocal	Inputstext	Digest2650a0fefd9b	Download49 GB	Parameters70b	QuantizationQ5_K_S	Context8K	Est. memory≈ 56 GB	`ollama run llama3-chatqa:70b-v1.5-q5_K_S`
70b-v1.5-q6_K	Typelocal	Inputstext	Digest8cc009d2a270	Download58 GB	Parameters70b	QuantizationQ6_K	Context8K	Est. memory≈ 66 GB	`ollama run llama3-chatqa:70b-v1.5-q6_K`
70b-v1.5-q8_0	Typelocal	Inputstext	Digest1fb999cb1cad	Download75 GB	Parameters70b	QuantizationQ8_0	Context8K	Est. memory≈ 85 GB	`ollama run llama3-chatqa:70b-v1.5-q8_0`
8b	Typelocal	Inputstext	Digestb37a98d204b2	Download4.7 GB	Parameters8b	QuantizationUnknown	Context8K	Est. memory≈ 6.5 GB	`ollama run llama3-chatqa:8b`
8b-v1.5	Typelocal	Inputstext	Digestb37a98d204b2	Download4.7 GB	Parameters8b	QuantizationUnknown	Context8K	Est. memory≈ 6.5 GB	`ollama run llama3-chatqa:8b-v1.5`
8b-v1.5-fp16	Typelocal	Inputstext	Digest54f366e1115a	Download16 GB	Parameters8b	QuantizationFP16	Context8K	Est. memory≈ 19 GB	`ollama run llama3-chatqa:8b-v1.5-fp16`
8b-v1.5-q2_K	Typelocal	Inputstext	Digest010674c8ebb4	Download3.2 GB	Parameters8b	QuantizationQ2_K	Context8K	Est. memory≈ 5 GB	`ollama run llama3-chatqa:8b-v1.5-q2_K`
8b-v1.5-q3_K_L	Typelocal	Inputstext	Digest748c33a3a51f	Download4.3 GB	Parameters8b	QuantizationQ3_K_L	Context8K	Est. memory≈ 6 GB	`ollama run llama3-chatqa:8b-v1.5-q3_K_L`
8b-v1.5-q3_K_M	Typelocal	Inputstext	Digestd1cbce0911ee	Download4.0 GB	Parameters8b	QuantizationQ3_K_M	Context8K	Est. memory≈ 5.5 GB	`ollama run llama3-chatqa:8b-v1.5-q3_K_M`
8b-v1.5-q3_K_S	Typelocal	Inputstext	Digest6d4cf2ccd7df	Download3.7 GB	Parameters8b	QuantizationQ3_K_S	Context8K	Est. memory≈ 5.5 GB	`ollama run llama3-chatqa:8b-v1.5-q3_K_S`
8b-v1.5-q4_0	Typelocal	Inputstext	Digestb37a98d204b2	Download4.7 GB	Parameters8b	QuantizationQ4_0	Context8K	Est. memory≈ 6.5 GB	`ollama run llama3-chatqa:8b-v1.5-q4_0`
8b-v1.5-q4_1	Typelocal	Inputstext	Digest598e30318446	Download5.1 GB	Parameters8b	QuantizationQ4_1	Context8K	Est. memory≈ 7 GB	`ollama run llama3-chatqa:8b-v1.5-q4_1`
8b-v1.5-q4_K_M	Typelocal	Inputstext	Digest07e385a3991b	Download4.9 GB	Parameters8b	QuantizationQ4_K_M	Context8K	Est. memory≈ 6.5 GB	`ollama run llama3-chatqa:8b-v1.5-q4_K_M`
8b-v1.5-q4_K_S	Typelocal	Inputstext	Digestc4c5c98e11c6	Download4.7 GB	Parameters8b	QuantizationQ4_K_S	Context8K	Est. memory≈ 6.5 GB	`ollama run llama3-chatqa:8b-v1.5-q4_K_S`
8b-v1.5-q5_0	Typelocal	Inputstext	Digest7775bf791816	Download5.6 GB	Parameters8b	QuantizationQ5_0	Context8K	Est. memory≈ 7.5 GB	`ollama run llama3-chatqa:8b-v1.5-q5_0`
8b-v1.5-q5_1	Typelocal	Inputstext	Digest233019c7a259	Download6.1 GB	Parameters8b	QuantizationQ5_1	Context8K	Est. memory≈ 8 GB	`ollama run llama3-chatqa:8b-v1.5-q5_1`
8b-v1.5-q5_K_M	Typelocal	Inputstext	Digestd0e9675cf775	Download5.7 GB	Parameters8b	QuantizationQ5_K_M	Context8K	Est. memory≈ 7.5 GB	`ollama run llama3-chatqa:8b-v1.5-q5_K_M`
8b-v1.5-q5_K_S	Typelocal	Inputstext	Digest3eab2a2fa684	Download5.6 GB	Parameters8b	QuantizationQ5_K_S	Context8K	Est. memory≈ 7.5 GB	`ollama run llama3-chatqa:8b-v1.5-q5_K_S`
8b-v1.5-q6_K	Typelocal	Inputstext	Digest576770c27967	Download6.6 GB	Parameters8b	QuantizationQ6_K	Context8K	Est. memory≈ 8.5 GB	`ollama run llama3-chatqa:8b-v1.5-q6_K`
8b-v1.5-q8_0	Typelocal	Inputstext	Digest4b48f929dc16	Download8.5 GB	Parameters8b	QuantizationQ8_0	Context8K	Est. memory≈ 10.5 GB	`ollama run llama3-chatqa:8b-v1.5-q8_0`
latestdefault	Typelocal	Inputstext	Digestb37a98d204b2	Download4.7 GB	ParametersUnknown	QuantizationUnknown	Context8K	Est. memory≈ 6.5 GB	`ollama run llama3-chatqa:latest`

Related models

llama3.1local

Llama 3.1 is a new state-of-the-art model from Meta available in 8B, 70B and 405B parameter sizes.

llama3local

Meta Llama 3: The most capable openly available LLM to date

llavalocal

🌋 LLaVA is a novel end-to-end trained large multimodal model that combines a vision encoder and Vicuna for general-purpose visual and language understanding. Updated to version 1.6.

qwen2.5vllocal

Flagship vision-language model of Qwen and also a significant leap from the previous Qwen2-VL.