Quick start

ollama run medllama2:latest

Runnable variants

Memory is a rough file-size estimate; context length, runtime and GPU offload change it.

12 of 17 matching variants shown.17 of 17 variants shown.

Tag	Type	Inputs	Digest	Download	Parameters	Quantization	Context	Est. memory	Run
7b	Typelocal	Inputstext	Digesta53737ec0c72	Download3.8 GB	Parameters7b	QuantizationUnknown	Context4K	Est. memory≈ 5.5 GB	`ollama run medllama2:7b`
7b-fp16	Typelocal	Inputstext	Digest6f397a061510	Download13 GB	Parameters7b	QuantizationFP16	Context4K	Est. memory≈ 16 GB	`ollama run medllama2:7b-fp16`
7b-q2_K	Typelocal	Inputstext	Digestc22649a7cd87	Download2.8 GB	Parameters7b	QuantizationQ2_K	Context4K	Est. memory≈ 4.5 GB	`ollama run medllama2:7b-q2_K`
7b-q3_K_L	Typelocal	Inputstext	Digestfafc256d6f10	Download3.6 GB	Parameters7b	QuantizationQ3_K_L	Context4K	Est. memory≈ 5.5 GB	`ollama run medllama2:7b-q3_K_L`
7b-q3_K_M	Typelocal	Inputstext	Digestc9fba0828b5e	Download3.3 GB	Parameters7b	QuantizationQ3_K_M	Context4K	Est. memory≈ 5 GB	`ollama run medllama2:7b-q3_K_M`
7b-q3_K_S	Typelocal	Inputstext	Digestdb2e50ef4dfe	Download2.9 GB	Parameters7b	QuantizationQ3_K_S	Context4K	Est. memory≈ 4.5 GB	`ollama run medllama2:7b-q3_K_S`
7b-q4_0	Typelocal	Inputstext	Digesta53737ec0c72	Download3.8 GB	Parameters7b	QuantizationQ4_0	Context4K	Est. memory≈ 5.5 GB	`ollama run medllama2:7b-q4_0`
7b-q4_1	Typelocal	Inputstext	Digest1aa988b1b658	Download4.2 GB	Parameters7b	QuantizationQ4_1	Context4K	Est. memory≈ 6 GB	`ollama run medllama2:7b-q4_1`
7b-q4_K_M	Typelocal	Inputstext	Digest2943f4b668e1	Download4.1 GB	Parameters7b	QuantizationQ4_K_M	Context4K	Est. memory≈ 6 GB	`ollama run medllama2:7b-q4_K_M`
7b-q4_K_S	Typelocal	Inputstext	Digesta421e466ef1b	Download3.9 GB	Parameters7b	QuantizationQ4_K_S	Context4K	Est. memory≈ 5.5 GB	`ollama run medllama2:7b-q4_K_S`
7b-q5_0	Typelocal	Inputstext	Digest19923b8d70e7	Download4.7 GB	Parameters7b	QuantizationQ5_0	Context4K	Est. memory≈ 6.5 GB	`ollama run medllama2:7b-q5_0`
7b-q5_1	Typelocal	Inputstext	Digest04e08f5f3742	Download5.1 GB	Parameters7b	QuantizationQ5_1	Context4K	Est. memory≈ 7 GB	`ollama run medllama2:7b-q5_1`
7b-q5_K_M	Typelocal	Inputstext	Digest7f1509d663e8	Download4.8 GB	Parameters7b	QuantizationQ5_K_M	Context4K	Est. memory≈ 6.5 GB	`ollama run medllama2:7b-q5_K_M`
7b-q5_K_S	Typelocal	Inputstext	Digest23a9f20d4a00	Download4.7 GB	Parameters7b	QuantizationQ5_K_S	Context4K	Est. memory≈ 6.5 GB	`ollama run medllama2:7b-q5_K_S`
7b-q6_K	Typelocal	Inputstext	Digest7c66af1d9c4b	Download5.5 GB	Parameters7b	QuantizationQ6_K	Context4K	Est. memory≈ 7.5 GB	`ollama run medllama2:7b-q6_K`
7b-q8_0	Typelocal	Inputstext	Digest1bc066950c7a	Download7.2 GB	Parameters7b	QuantizationQ8_0	Context4K	Est. memory≈ 9.5 GB	`ollama run medllama2:7b-q8_0`
latestdefault	Typelocal	Inputstext	Digesta53737ec0c72	Download3.8 GB	ParametersUnknown	QuantizationUnknown	Context4K	Est. memory≈ 5.5 GB	`ollama run medllama2:latest`

Related models

llama2local

Llama 2 is a collection of foundation language models ranging from 7B to 70B parameters.

codellamalocal

A large language model that can use text prompts to generate and discuss code.

llama2-uncensoredlocal

Uncensored Llama 2 model by George Sung and Jarrad Hope.

wizardcoderlocal

State-of-the-art code generation model