Quick start

ollama run llama2-uncensored:latest

Runnable variants

Memory is a rough file-size estimate; context length, runtime and GPU offload change it.

12 of 34 matching variants shown.34 of 34 variants shown.

Tag	Type	Inputs	Digest	Download	Parameters	Quantization	Context	Est. memory	Run
70b	Typelocal	Inputstext	Digestbdd0ec2f5ec5	Download39 GB	Parameters70b	QuantizationUnknown	Context2K	Est. memory≈ 45 GB	`ollama run llama2-uncensored:70b`
70b-chat	Typelocal	Inputstext	Digestbdd0ec2f5ec5	Download39 GB	Parameters70b	QuantizationUnknown	Context2K	Est. memory≈ 45 GB	`ollama run llama2-uncensored:70b-chat`
70b-chat-q2_K	Typelocal	Inputstext	Digest07eb9c33537f	Download29 GB	Parameters70b	QuantizationQ2_K	Context2K	Est. memory≈ 33.5 GB	`ollama run llama2-uncensored:70b-chat-q2_K`
70b-chat-q3_K_L	Typelocal	Inputstext	Digest36c29a76fcc6	Download36 GB	Parameters70b	QuantizationQ3_K_L	Context2K	Est. memory≈ 41.5 GB	`ollama run llama2-uncensored:70b-chat-q3_K_L`
70b-chat-q3_K_M	Typelocal	Inputstext	Digestdc1b2e6eadcb	Download33 GB	Parameters70b	QuantizationQ3_K_M	Context2K	Est. memory≈ 38 GB	`ollama run llama2-uncensored:70b-chat-q3_K_M`
70b-chat-q3_K_S	Typelocal	Inputstext	Digest493a8291671f	Download30 GB	Parameters70b	QuantizationQ3_K_S	Context2K	Est. memory≈ 35 GB	`ollama run llama2-uncensored:70b-chat-q3_K_S`
70b-chat-q4_0	Typelocal	Inputstext	Digestbdd0ec2f5ec5	Download39 GB	Parameters70b	QuantizationQ4_0	Context2K	Est. memory≈ 45 GB	`ollama run llama2-uncensored:70b-chat-q4_0`
70b-chat-q4_1	Typelocal	Inputstext	Digest26fa2e1dcc70	Download43 GB	Parameters70b	QuantizationQ4_1	Context2K	Est. memory≈ 49.5 GB	`ollama run llama2-uncensored:70b-chat-q4_1`
70b-chat-q4_K_M	Typelocal	Inputstext	Digest97d4d2728756	Download41 GB	Parameters70b	QuantizationQ4_K_M	Context2K	Est. memory≈ 47 GB	`ollama run llama2-uncensored:70b-chat-q4_K_M`
70b-chat-q4_K_S	Typelocal	Inputstext	Digestccd1d1a41ec7	Download39 GB	Parameters70b	QuantizationQ4_K_S	Context2K	Est. memory≈ 45 GB	`ollama run llama2-uncensored:70b-chat-q4_K_S`
70b-chat-q5_0	Typelocal	Inputstext	Digest16ddcf15080c	Download47 GB	Parameters70b	QuantizationQ5_0	Context2K	Est. memory≈ 54 GB	`ollama run llama2-uncensored:70b-chat-q5_0`
70b-chat-q5_1	Typelocal	Inputstext	Digest1eda65206a66	Download52 GB	Parameters70b	QuantizationQ5_1	Context2K	Est. memory≈ 59.5 GB	`ollama run llama2-uncensored:70b-chat-q5_1`
70b-chat-q5_K_M	Typelocal	Inputstext	Digestcb930df97107	Download49 GB	Parameters70b	QuantizationQ5_K_M	Context2K	Est. memory≈ 56 GB	`ollama run llama2-uncensored:70b-chat-q5_K_M`
70b-chat-q5_K_S	Typelocal	Inputstext	Digest90ac8e79f29b	Download47 GB	Parameters70b	QuantizationQ5_K_S	Context2K	Est. memory≈ 54 GB	`ollama run llama2-uncensored:70b-chat-q5_K_S`
70b-chat-q6_K	Typelocal	Inputstext	Digest38f49b2673e7	Download57 GB	Parameters70b	QuantizationQ6_K	Context2K	Est. memory≈ 65 GB	`ollama run llama2-uncensored:70b-chat-q6_K`
70b-chat-q8_0	Typelocal	Inputstext	Digest256b13d53838	Download73 GB	Parameters70b	QuantizationQ8_0	Context2K	Est. memory≈ 83 GB	`ollama run llama2-uncensored:70b-chat-q8_0`
7b	Typelocal	Inputstext	Digest44040b922233	Download3.8 GB	Parameters7b	QuantizationUnknown	Context2K	Est. memory≈ 5.5 GB	`ollama run llama2-uncensored:7b`
7b-chat	Typelocal	Inputstext	Digest44040b922233	Download3.8 GB	Parameters7b	QuantizationUnknown	Context2K	Est. memory≈ 5.5 GB	`ollama run llama2-uncensored:7b-chat`
7b-chat-fp16	Typelocal	Inputstext	Digestb29ffe78e250	Download13 GB	Parameters7b	QuantizationFP16	Context2K	Est. memory≈ 16 GB	`ollama run llama2-uncensored:7b-chat-fp16`
7b-chat-q2_K	Typelocal	Inputstext	Digest74ae83e72254	Download2.8 GB	Parameters7b	QuantizationQ2_K	Context2K	Est. memory≈ 4.5 GB	`ollama run llama2-uncensored:7b-chat-q2_K`
7b-chat-q3_K_L	Typelocal	Inputstext	Digest4c971d36df3a	Download3.6 GB	Parameters7b	QuantizationQ3_K_L	Context2K	Est. memory≈ 5.5 GB	`ollama run llama2-uncensored:7b-chat-q3_K_L`
7b-chat-q3_K_M	Typelocal	Inputstext	Digeste74d204469c8	Download3.3 GB	Parameters7b	QuantizationQ3_K_M	Context2K	Est. memory≈ 5 GB	`ollama run llama2-uncensored:7b-chat-q3_K_M`
7b-chat-q3_K_S	Typelocal	Inputstext	Digest3f56c4266b91	Download2.9 GB	Parameters7b	QuantizationQ3_K_S	Context2K	Est. memory≈ 4.5 GB	`ollama run llama2-uncensored:7b-chat-q3_K_S`
7b-chat-q4_0	Typelocal	Inputstext	Digest44040b922233	Download3.8 GB	Parameters7b	QuantizationQ4_0	Context2K	Est. memory≈ 5.5 GB	`ollama run llama2-uncensored:7b-chat-q4_0`
7b-chat-q4_1	Typelocal	Inputstext	Digest0126058e3693	Download4.2 GB	Parameters7b	QuantizationQ4_1	Context2K	Est. memory≈ 6 GB	`ollama run llama2-uncensored:7b-chat-q4_1`
7b-chat-q4_K_M	Typelocal	Inputstext	Digesta91c5baf8d31	Download4.1 GB	Parameters7b	QuantizationQ4_K_M	Context2K	Est. memory≈ 6 GB	`ollama run llama2-uncensored:7b-chat-q4_K_M`
7b-chat-q4_K_S	Typelocal	Inputstext	Digest7c0b8e49e54b	Download3.9 GB	Parameters7b	QuantizationQ4_K_S	Context2K	Est. memory≈ 5.5 GB	`ollama run llama2-uncensored:7b-chat-q4_K_S`
7b-chat-q5_0	Typelocal	Inputstext	Digest48c918f41b91	Download4.7 GB	Parameters7b	QuantizationQ5_0	Context2K	Est. memory≈ 6.5 GB	`ollama run llama2-uncensored:7b-chat-q5_0`
7b-chat-q5_1	Typelocal	Inputstext	Digest4ba18e066719	Download5.1 GB	Parameters7b	QuantizationQ5_1	Context2K	Est. memory≈ 7 GB	`ollama run llama2-uncensored:7b-chat-q5_1`
7b-chat-q5_K_M	Typelocal	Inputstext	Digestdb0d5a17b770	Download4.8 GB	Parameters7b	QuantizationQ5_K_M	Context2K	Est. memory≈ 6.5 GB	`ollama run llama2-uncensored:7b-chat-q5_K_M`
7b-chat-q5_K_S	Typelocal	Inputstext	Digestf2f04ee3b17e	Download4.7 GB	Parameters7b	QuantizationQ5_K_S	Context2K	Est. memory≈ 6.5 GB	`ollama run llama2-uncensored:7b-chat-q5_K_S`
7b-chat-q6_K	Typelocal	Inputstext	Digestf3040de79519	Download5.5 GB	Parameters7b	QuantizationQ6_K	Context2K	Est. memory≈ 7.5 GB	`ollama run llama2-uncensored:7b-chat-q6_K`
7b-chat-q8_0	Typelocal	Inputstext	Digesta3a460233379	Download7.2 GB	Parameters7b	QuantizationQ8_0	Context2K	Est. memory≈ 9.5 GB	`ollama run llama2-uncensored:7b-chat-q8_0`
latestdefault	Typelocal	Inputstext	Digest44040b922233	Download3.8 GB	ParametersUnknown	QuantizationUnknown	Context2K	Est. memory≈ 5.5 GB	`ollama run llama2-uncensored:latest`

Related models

llama2local

Llama 2 is a collection of foundation language models ranging from 7B to 70B parameters.

codellamalocal

A large language model that can use text prompts to generate and discuss code.

wizardcoderlocal

State-of-the-art code generation model

vicunalocal

General use chat model based on Llama and Llama 2 with 2K to 16K context sizes.