Quick start

ollama run llama3-gradient:latest

Runnable variants

Memory is a rough file-size estimate; context length, runtime and GPU offload change it.

12 of 35 matching variants shown.35 of 35 variants shown.

Tag	Type	Inputs	Digest	Download	Parameters	Quantization	Context	Est. memory	Run
1048k	Typelocal	Inputstext	Digest5d1398df5b8b	Download4.7 GB	ParametersUnknown	QuantizationUnknown	Context1M	Est. memory≈ 6.5 GB	`ollama run llama3-gradient:1048k`
70b	Typelocal	Inputstext	Digestb5d6e9d0ae61	Download40 GB	Parameters70b	QuantizationUnknown	Context1M	Est. memory≈ 46 GB	`ollama run llama3-gradient:70b`
70b-instruct-1048k-fp16	Typelocal	Inputstext	Digestcfcadecc99e9	Download141 GB	Parameters70b	QuantizationFP16	Context1M	Est. memory≈ 159 GB	`ollama run llama3-gradient:70b-instruct-1048k-fp16`
70b-instruct-1048k-q2_K	Typelocal	Inputstext	Digested7c53c8b502	Download26 GB	Parameters70b	QuantizationQ2_K	Context1M	Est. memory≈ 30.5 GB	`ollama run llama3-gradient:70b-instruct-1048k-q2_K`
70b-instruct-1048k-q3_K_L	Typelocal	Inputstext	Digesta03cb0882529	Download37 GB	Parameters70b	QuantizationQ3_K_L	Context1M	Est. memory≈ 42.5 GB	`ollama run llama3-gradient:70b-instruct-1048k-q3_K_L`
70b-instruct-1048k-q3_K_M	Typelocal	Inputstext	Digeste4fc265d59a8	Download34 GB	Parameters70b	QuantizationQ3_K_M	Context1M	Est. memory≈ 39 GB	`ollama run llama3-gradient:70b-instruct-1048k-q3_K_M`
70b-instruct-1048k-q3_K_S	Typelocal	Inputstext	Digestbdee3e061f75	Download31 GB	Parameters70b	QuantizationQ3_K_S	Context1M	Est. memory≈ 36 GB	`ollama run llama3-gradient:70b-instruct-1048k-q3_K_S`
70b-instruct-1048k-q4_0	Typelocal	Inputstext	Digestb5d6e9d0ae61	Download40 GB	Parameters70b	QuantizationQ4_0	Context1M	Est. memory≈ 46 GB	`ollama run llama3-gradient:70b-instruct-1048k-q4_0`
70b-instruct-1048k-q4_1	Typelocal	Inputstext	Digest4ecc3cc03c9a	Download44 GB	Parameters70b	QuantizationQ4_1	Context1M	Est. memory≈ 50.5 GB	`ollama run llama3-gradient:70b-instruct-1048k-q4_1`
70b-instruct-1048k-q4_K_M	Typelocal	Inputstext	Digestb68ba521fab5	Download43 GB	Parameters70b	QuantizationQ4_K_M	Context1M	Est. memory≈ 49.5 GB	`ollama run llama3-gradient:70b-instruct-1048k-q4_K_M`
70b-instruct-1048k-q4_K_S	Typelocal	Inputstext	Digest8c990ff8dd67	Download40 GB	Parameters70b	QuantizationQ4_K_S	Context1M	Est. memory≈ 46 GB	`ollama run llama3-gradient:70b-instruct-1048k-q4_K_S`
70b-instruct-1048k-q5_0	Typelocal	Inputstext	Digest31e92584c546	Download49 GB	Parameters70b	QuantizationQ5_0	Context1M	Est. memory≈ 56 GB	`ollama run llama3-gradient:70b-instruct-1048k-q5_0`
70b-instruct-1048k-q5_1	Typelocal	Inputstext	Digestfeafc730ced8	Download53 GB	Parameters70b	QuantizationQ5_1	Context1M	Est. memory≈ 60.5 GB	`ollama run llama3-gradient:70b-instruct-1048k-q5_1`
70b-instruct-1048k-q5_K_M	Typelocal	Inputstext	Digesta3db61871133	Download50 GB	Parameters70b	QuantizationQ5_K_M	Context1M	Est. memory≈ 57 GB	`ollama run llama3-gradient:70b-instruct-1048k-q5_K_M`
70b-instruct-1048k-q5_K_S	Typelocal	Inputstext	Digest841f57c74a05	Download49 GB	Parameters70b	QuantizationQ5_K_S	Context1M	Est. memory≈ 56 GB	`ollama run llama3-gradient:70b-instruct-1048k-q5_K_S`
70b-instruct-1048k-q6_K	Typelocal	Inputstext	Digestd224f1d529ea	Download58 GB	Parameters70b	QuantizationQ6_K	Context1M	Est. memory≈ 66 GB	`ollama run llama3-gradient:70b-instruct-1048k-q6_K`
70b-instruct-1048k-q8_0	Typelocal	Inputstext	Digest65fc2ffdd713	Download75 GB	Parameters70b	QuantizationQ8_0	Context1M	Est. memory≈ 85 GB	`ollama run llama3-gradient:70b-instruct-1048k-q8_0`
8b	Typelocal	Inputstext	Digest5d1398df5b8b	Download4.7 GB	Parameters8b	QuantizationUnknown	Context1M	Est. memory≈ 6.5 GB	`ollama run llama3-gradient:8b`
8b-instruct-1048k-fp16	Typelocal	Inputstext	Digest839e683046bb	Download16 GB	Parameters8b	QuantizationFP16	Context1M	Est. memory≈ 19 GB	`ollama run llama3-gradient:8b-instruct-1048k-fp16`
8b-instruct-1048k-q2_K	Typelocal	Inputstext	Digestc842eda5ddd5	Download3.2 GB	Parameters8b	QuantizationQ2_K	Context1M	Est. memory≈ 5 GB	`ollama run llama3-gradient:8b-instruct-1048k-q2_K`
8b-instruct-1048k-q3_K_L	Typelocal	Inputstext	Digest5a2ea82ad056	Download4.3 GB	Parameters8b	QuantizationQ3_K_L	Context1M	Est. memory≈ 6 GB	`ollama run llama3-gradient:8b-instruct-1048k-q3_K_L`
8b-instruct-1048k-q3_K_M	Typelocal	Inputstext	Digest786019279b07	Download4.0 GB	Parameters8b	QuantizationQ3_K_M	Context1M	Est. memory≈ 5.5 GB	`ollama run llama3-gradient:8b-instruct-1048k-q3_K_M`
8b-instruct-1048k-q3_K_S	Typelocal	Inputstext	Digestac6814bccbc9	Download3.7 GB	Parameters8b	QuantizationQ3_K_S	Context1M	Est. memory≈ 5.5 GB	`ollama run llama3-gradient:8b-instruct-1048k-q3_K_S`
8b-instruct-1048k-q4_0	Typelocal	Inputstext	Digest5d1398df5b8b	Download4.7 GB	Parameters8b	QuantizationQ4_0	Context1M	Est. memory≈ 6.5 GB	`ollama run llama3-gradient:8b-instruct-1048k-q4_0`
8b-instruct-1048k-q4_1	Typelocal	Inputstext	Digest1e76a7e4e55b	Download5.1 GB	Parameters8b	QuantizationQ4_1	Context1M	Est. memory≈ 7 GB	`ollama run llama3-gradient:8b-instruct-1048k-q4_1`
8b-instruct-1048k-q4_K_M	Typelocal	Inputstext	Digest3ba4af54f02f	Download4.9 GB	Parameters8b	QuantizationQ4_K_M	Context1M	Est. memory≈ 6.5 GB	`ollama run llama3-gradient:8b-instruct-1048k-q4_K_M`
8b-instruct-1048k-q4_K_S	Typelocal	Inputstext	Digest419da1c2bc33	Download4.7 GB	Parameters8b	QuantizationQ4_K_S	Context1M	Est. memory≈ 6.5 GB	`ollama run llama3-gradient:8b-instruct-1048k-q4_K_S`
8b-instruct-1048k-q5_0	Typelocal	Inputstext	Digestfcab91d085ad	Download5.6 GB	Parameters8b	QuantizationQ5_0	Context1M	Est. memory≈ 7.5 GB	`ollama run llama3-gradient:8b-instruct-1048k-q5_0`
8b-instruct-1048k-q5_1	Typelocal	Inputstext	Digest778b4e9deda3	Download6.1 GB	Parameters8b	QuantizationQ5_1	Context1M	Est. memory≈ 8 GB	`ollama run llama3-gradient:8b-instruct-1048k-q5_1`
8b-instruct-1048k-q5_K_M	Typelocal	Inputstext	Digest279429844582	Download5.7 GB	Parameters8b	QuantizationQ5_K_M	Context1M	Est. memory≈ 7.5 GB	`ollama run llama3-gradient:8b-instruct-1048k-q5_K_M`
8b-instruct-1048k-q5_K_S	Typelocal	Inputstext	Digesta2a68d63519c	Download5.6 GB	Parameters8b	QuantizationQ5_K_S	Context1M	Est. memory≈ 7.5 GB	`ollama run llama3-gradient:8b-instruct-1048k-q5_K_S`
8b-instruct-1048k-q6_K	Typelocal	Inputstext	Digest9851a7dbda92	Download6.6 GB	Parameters8b	QuantizationQ6_K	Context1M	Est. memory≈ 8.5 GB	`ollama run llama3-gradient:8b-instruct-1048k-q6_K`
8b-instruct-1048k-q8_0	Typelocal	Inputstext	Digest543168ef36be	Download8.5 GB	Parameters8b	QuantizationQ8_0	Context1M	Est. memory≈ 10.5 GB	`ollama run llama3-gradient:8b-instruct-1048k-q8_0`
instruct	Typelocal	Inputstext	Digest5d1398df5b8b	Download4.7 GB	ParametersUnknown	QuantizationUnknown	Context1M	Est. memory≈ 6.5 GB	`ollama run llama3-gradient:instruct`
latestdefault	Typelocal	Inputstext	Digest5d1398df5b8b	Download4.7 GB	ParametersUnknown	QuantizationUnknown	Context1M	Est. memory≈ 6.5 GB	`ollama run llama3-gradient:latest`

Related models

llama3.1local

Llama 3.1 is a new state-of-the-art model from Meta available in 8B, 70B and 405B parameter sizes.

llama3local

Meta Llama 3: The most capable openly available LLM to date

llavalocal

🌋 LLaVA is a novel end-to-end trained large multimodal model that combines a vision encoder and Vicuna for general-purpose visual and language understanding. Updated to version 1.6.

qwen2.5vllocal

Flagship vision-language model of Qwen and also a significant leap from the previous Qwen2-VL.