Quick start

ollama run meditron:latest

Runnable variants

Memory is a rough file-size estimate; context length, runtime and GPU offload change it.

12 of 22 matching variants shown.22 of 22 variants shown.

Tag	Type	Inputs	Digest	Download	Parameters	Quantization	Context	Est. memory	Run
70b	Typelocal	Inputstext	Digest315d466c452f	Download39 GB	Parameters70b	QuantizationUnknown	Context4K	Est. memory≈ 45 GB	`ollama run meditron:70b`
70b-q4_0	Typelocal	Inputstext	Digest315d466c452f	Download39 GB	Parameters70b	QuantizationQ4_0	Context4K	Est. memory≈ 45 GB	`ollama run meditron:70b-q4_0`
70b-q4_1	Typelocal	Inputstext	Digestd0395a457ce6	Download43 GB	Parameters70b	QuantizationQ4_1	Context4K	Est. memory≈ 49.5 GB	`ollama run meditron:70b-q4_1`
70b-q4_K_S	Typelocal	Inputstext	Digest4f8102818cd7	Download39 GB	Parameters70b	QuantizationQ4_K_S	Context4K	Est. memory≈ 45 GB	`ollama run meditron:70b-q4_K_S`
70b-q5_1	Typelocal	Inputstext	Digestb12076361e76	Download52 GB	Parameters70b	QuantizationQ5_1	Context4K	Est. memory≈ 59.5 GB	`ollama run meditron:70b-q5_1`
7b	Typelocal	Inputstext	Digestad11a6250f54	Download3.8 GB	Parameters7b	QuantizationUnknown	Context2K	Est. memory≈ 5.5 GB	`ollama run meditron:7b`
7b-fp16	Typelocal	Inputstext	Digest809731a3f1a9	Download13 GB	Parameters7b	QuantizationFP16	Context2K	Est. memory≈ 16 GB	`ollama run meditron:7b-fp16`
7b-q2_K	Typelocal	Inputstext	Digestf330bdb16b9e	Download2.8 GB	Parameters7b	QuantizationQ2_K	Context2K	Est. memory≈ 4.5 GB	`ollama run meditron:7b-q2_K`
7b-q3_K_L	Typelocal	Inputstext	Digesta6fa27f88bbc	Download3.6 GB	Parameters7b	QuantizationQ3_K_L	Context2K	Est. memory≈ 5.5 GB	`ollama run meditron:7b-q3_K_L`
7b-q3_K_M	Typelocal	Inputstext	Digest9c9c4636a4b8	Download3.3 GB	Parameters7b	QuantizationQ3_K_M	Context2K	Est. memory≈ 5 GB	`ollama run meditron:7b-q3_K_M`
7b-q3_K_S	Typelocal	Inputstext	Digest6d5aa9319b05	Download2.9 GB	Parameters7b	QuantizationQ3_K_S	Context2K	Est. memory≈ 4.5 GB	`ollama run meditron:7b-q3_K_S`
7b-q4_0	Typelocal	Inputstext	Digestad11a6250f54	Download3.8 GB	Parameters7b	QuantizationQ4_0	Context2K	Est. memory≈ 5.5 GB	`ollama run meditron:7b-q4_0`
7b-q4_1	Typelocal	Inputstext	Digest876165f9f2df	Download4.2 GB	Parameters7b	QuantizationQ4_1	Context2K	Est. memory≈ 6 GB	`ollama run meditron:7b-q4_1`
7b-q4_K_M	Typelocal	Inputstext	Digesta917f4ff62ba	Download4.1 GB	Parameters7b	QuantizationQ4_K_M	Context2K	Est. memory≈ 6 GB	`ollama run meditron:7b-q4_K_M`
7b-q4_K_S	Typelocal	Inputstext	Digest615f994626bd	Download3.9 GB	Parameters7b	QuantizationQ4_K_S	Context2K	Est. memory≈ 5.5 GB	`ollama run meditron:7b-q4_K_S`
7b-q5_0	Typelocal	Inputstext	Digest79d156131358	Download4.7 GB	Parameters7b	QuantizationQ5_0	Context2K	Est. memory≈ 6.5 GB	`ollama run meditron:7b-q5_0`
7b-q5_1	Typelocal	Inputstext	Digest04278d55ad3f	Download5.1 GB	Parameters7b	QuantizationQ5_1	Context2K	Est. memory≈ 7 GB	`ollama run meditron:7b-q5_1`
7b-q5_K_M	Typelocal	Inputstext	Digest1e91d442c62d	Download4.8 GB	Parameters7b	QuantizationQ5_K_M	Context2K	Est. memory≈ 6.5 GB	`ollama run meditron:7b-q5_K_M`
7b-q5_K_S	Typelocal	Inputstext	Digestff3d673fc3ab	Download4.7 GB	Parameters7b	QuantizationQ5_K_S	Context2K	Est. memory≈ 6.5 GB	`ollama run meditron:7b-q5_K_S`
7b-q6_K	Typelocal	Inputstext	Digeste98363fbb20a	Download5.5 GB	Parameters7b	QuantizationQ6_K	Context2K	Est. memory≈ 7.5 GB	`ollama run meditron:7b-q6_K`
7b-q8_0	Typelocal	Inputstext	Digest902db8ed250b	Download7.2 GB	Parameters7b	QuantizationQ8_0	Context2K	Est. memory≈ 9.5 GB	`ollama run meditron:7b-q8_0`
latestdefault	Typelocal	Inputstext	Digestad11a6250f54	Download3.8 GB	ParametersUnknown	QuantizationUnknown	Context2K	Est. memory≈ 5.5 GB	`ollama run meditron:latest`

Related models

llama2local

Llama 2 is a collection of foundation language models ranging from 7B to 70B parameters.

codellamalocal

A large language model that can use text prompts to generate and discuss code.

llama2-uncensoredlocal

Uncensored Llama 2 model by George Sung and Jarrad Hope.

wizardcoderlocal

State-of-the-art code generation model