Quick start

ollama run llama2-chinese:latest

Runnable variants

Memory is a rough file-size estimate; context length, runtime and GPU offload change it.

12 of 35 matching variants shown.35 of 35 variants shown.

Tag	Type	Inputs	Digest	Download	Parameters	Quantization	Context	Est. memory	Run
13b	Typelocal	Inputstext	Digest990f930d55c5	Download7.4 GB	Parameters13b	QuantizationUnknown	Context4K	Est. memory≈ 9.5 GB	`ollama run llama2-chinese:13b`
13b-chat	Typelocal	Inputstext	Digest990f930d55c5	Download7.4 GB	Parameters13b	QuantizationUnknown	Context4K	Est. memory≈ 9.5 GB	`ollama run llama2-chinese:13b-chat`
13b-chat-fp16	Typelocal	Inputstext	Digest3d4c5a00962c	Download26 GB	Parameters13b	QuantizationFP16	Context4K	Est. memory≈ 30.5 GB	`ollama run llama2-chinese:13b-chat-fp16`
13b-chat-q2_K	Typelocal	Inputstext	Digest01b32d718507	Download5.4 GB	Parameters13b	QuantizationQ2_K	Context4K	Est. memory≈ 7.5 GB	`ollama run llama2-chinese:13b-chat-q2_K`
13b-chat-q3_K_L	Typelocal	Inputstext	Digest583a72ecd078	Download6.9 GB	Parameters13b	QuantizationQ3_K_L	Context4K	Est. memory≈ 9 GB	`ollama run llama2-chinese:13b-chat-q3_K_L`
13b-chat-q3_K_M	Typelocal	Inputstext	Digestd75e5c2030da	Download6.3 GB	Parameters13b	QuantizationQ3_K_M	Context4K	Est. memory≈ 8.5 GB	`ollama run llama2-chinese:13b-chat-q3_K_M`
13b-chat-q3_K_S	Typelocal	Inputstext	Digest4501e1ce728a	Download5.7 GB	Parameters13b	QuantizationQ3_K_S	Context4K	Est. memory≈ 7.5 GB	`ollama run llama2-chinese:13b-chat-q3_K_S`
13b-chat-q4_0	Typelocal	Inputstext	Digest990f930d55c5	Download7.4 GB	Parameters13b	QuantizationQ4_0	Context4K	Est. memory≈ 9.5 GB	`ollama run llama2-chinese:13b-chat-q4_0`
13b-chat-q4_1	Typelocal	Inputstext	Digestb71960852385	Download8.2 GB	Parameters13b	QuantizationQ4_1	Context4K	Est. memory≈ 10.5 GB	`ollama run llama2-chinese:13b-chat-q4_1`
13b-chat-q4_K_M	Typelocal	Inputstext	Digest94f93f5cde52	Download7.9 GB	Parameters13b	QuantizationQ4_K_M	Context4K	Est. memory≈ 10 GB	`ollama run llama2-chinese:13b-chat-q4_K_M`
13b-chat-q4_K_S	Typelocal	Inputstext	Digest8a8f954a3792	Download7.4 GB	Parameters13b	QuantizationQ4_K_S	Context4K	Est. memory≈ 9.5 GB	`ollama run llama2-chinese:13b-chat-q4_K_S`
13b-chat-q5_0	Typelocal	Inputstext	Digest4a41f66e710c	Download9.0 GB	Parameters13b	QuantizationQ5_0	Context4K	Est. memory≈ 11.5 GB	`ollama run llama2-chinese:13b-chat-q5_0`
13b-chat-q5_1	Typelocal	Inputstext	Digest349e43573fca	Download9.8 GB	Parameters13b	QuantizationQ5_1	Context4K	Est. memory≈ 12 GB	`ollama run llama2-chinese:13b-chat-q5_1`
13b-chat-q5_K_M	Typelocal	Inputstext	Digest25cf6e1c9040	Download9.2 GB	Parameters13b	QuantizationQ5_K_M	Context4K	Est. memory≈ 11.5 GB	`ollama run llama2-chinese:13b-chat-q5_K_M`
13b-chat-q5_K_S	Typelocal	Inputstext	Digest4f56da0a7657	Download9.0 GB	Parameters13b	QuantizationQ5_K_S	Context4K	Est. memory≈ 11.5 GB	`ollama run llama2-chinese:13b-chat-q5_K_S`
13b-chat-q6_K	Typelocal	Inputstext	Digestc4a78a31a576	Download11 GB	Parameters13b	QuantizationQ6_K	Context4K	Est. memory≈ 13.5 GB	`ollama run llama2-chinese:13b-chat-q6_K`
13b-chat-q8_0	Typelocal	Inputstext	Digest9fe32b8f2073	Download14 GB	Parameters13b	QuantizationQ8_0	Context4K	Est. memory≈ 17 GB	`ollama run llama2-chinese:13b-chat-q8_0`
7b	Typelocal	Inputstext	Digestcee11d703eee	Download3.8 GB	Parameters7b	QuantizationUnknown	Context4K	Est. memory≈ 5.5 GB	`ollama run llama2-chinese:7b`
7b-chat	Typelocal	Inputstext	Digestcee11d703eee	Download3.8 GB	Parameters7b	QuantizationUnknown	Context4K	Est. memory≈ 5.5 GB	`ollama run llama2-chinese:7b-chat`
7b-chat-fp16	Typelocal	Inputstext	Digestb73150f2949c	Download13 GB	Parameters7b	QuantizationFP16	Context4K	Est. memory≈ 16 GB	`ollama run llama2-chinese:7b-chat-fp16`
7b-chat-q2_K	Typelocal	Inputstext	Digest56d0f23785bc	Download2.8 GB	Parameters7b	QuantizationQ2_K	Context4K	Est. memory≈ 4.5 GB	`ollama run llama2-chinese:7b-chat-q2_K`
7b-chat-q3_K_L	Typelocal	Inputstext	Digestf6fcedae5d7e	Download3.6 GB	Parameters7b	QuantizationQ3_K_L	Context4K	Est. memory≈ 5.5 GB	`ollama run llama2-chinese:7b-chat-q3_K_L`
7b-chat-q3_K_M	Typelocal	Inputstext	Digestd55419aeb5bc	Download3.3 GB	Parameters7b	QuantizationQ3_K_M	Context4K	Est. memory≈ 5 GB	`ollama run llama2-chinese:7b-chat-q3_K_M`
7b-chat-q3_K_S	Typelocal	Inputstext	Digest6b13bc0df0ae	Download2.9 GB	Parameters7b	QuantizationQ3_K_S	Context4K	Est. memory≈ 4.5 GB	`ollama run llama2-chinese:7b-chat-q3_K_S`
7b-chat-q4_0	Typelocal	Inputstext	Digestcee11d703eee	Download3.8 GB	Parameters7b	QuantizationQ4_0	Context4K	Est. memory≈ 5.5 GB	`ollama run llama2-chinese:7b-chat-q4_0`
7b-chat-q4_1	Typelocal	Inputstext	Digestcac7c07fdb0a	Download4.2 GB	Parameters7b	QuantizationQ4_1	Context4K	Est. memory≈ 6 GB	`ollama run llama2-chinese:7b-chat-q4_1`
7b-chat-q4_K_M	Typelocal	Inputstext	Digeste31ba537c1a7	Download4.1 GB	Parameters7b	QuantizationQ4_K_M	Context4K	Est. memory≈ 6 GB	`ollama run llama2-chinese:7b-chat-q4_K_M`
7b-chat-q4_K_S	Typelocal	Inputstext	Digest1830e332cd06	Download3.9 GB	Parameters7b	QuantizationQ4_K_S	Context4K	Est. memory≈ 5.5 GB	`ollama run llama2-chinese:7b-chat-q4_K_S`
7b-chat-q5_0	Typelocal	Inputstext	Digestae1d32a03e63	Download4.7 GB	Parameters7b	QuantizationQ5_0	Context4K	Est. memory≈ 6.5 GB	`ollama run llama2-chinese:7b-chat-q5_0`
7b-chat-q5_1	Typelocal	Inputstext	Digest245741bebff6	Download5.1 GB	Parameters7b	QuantizationQ5_1	Context4K	Est. memory≈ 7 GB	`ollama run llama2-chinese:7b-chat-q5_1`
7b-chat-q5_K_M	Typelocal	Inputstext	Digest998f85f310f7	Download4.8 GB	Parameters7b	QuantizationQ5_K_M	Context4K	Est. memory≈ 6.5 GB	`ollama run llama2-chinese:7b-chat-q5_K_M`
7b-chat-q5_K_S	Typelocal	Inputstext	Digestcfe3e90e5e6a	Download4.7 GB	Parameters7b	QuantizationQ5_K_S	Context4K	Est. memory≈ 6.5 GB	`ollama run llama2-chinese:7b-chat-q5_K_S`
7b-chat-q6_K	Typelocal	Inputstext	Digest604c2c9da214	Download5.5 GB	Parameters7b	QuantizationQ6_K	Context4K	Est. memory≈ 7.5 GB	`ollama run llama2-chinese:7b-chat-q6_K`
7b-chat-q8_0	Typelocal	Inputstext	Digest0d05c88312c5	Download7.2 GB	Parameters7b	QuantizationQ8_0	Context4K	Est. memory≈ 9.5 GB	`ollama run llama2-chinese:7b-chat-q8_0`
latestdefault	Typelocal	Inputstext	Digestcee11d703eee	Download3.8 GB	ParametersUnknown	QuantizationUnknown	Context4K	Est. memory≈ 5.5 GB	`ollama run llama2-chinese:latest`

Related models

llama2local

Llama 2 is a collection of foundation language models ranging from 7B to 70B parameters.

codellamalocal

A large language model that can use text prompts to generate and discuss code.

llama2-uncensoredlocal

Uncensored Llama 2 model by George Sung and Jarrad Hope.

wizardcoderlocal

State-of-the-art code generation model