Quick start

ollama run wizardlm:7b-q2_K

Runnable variants

Memory is a rough file-size estimate; context length, runtime and GPU offload change it.

12 of 73 matching variants shown.73 of 73 variants shown.

Tag	Type	Inputs	Digest	Download	Parameters	Quantization	Context	Est. memory	Run
13b-fp16	Typelocal	Inputstext	Digest95a66502902f	Download26 GB	Parameters13b	QuantizationFP16	Context2K	Est. memory≈ 30.5 GB	`ollama run wizardlm:13b-fp16`
13b-llama2-fp16	Typelocal	Inputstext	Digest4adbfc3c9680	Download26 GB	Parameters13b	QuantizationFP16	Context4K	Est. memory≈ 30.5 GB	`ollama run wizardlm:13b-llama2-fp16`
13b-llama2-q2_K	Typelocal	Inputstext	Digestbf7912e654c5	Download5.4 GB	Parameters13b	QuantizationQ2_K	Context4K	Est. memory≈ 7.5 GB	`ollama run wizardlm:13b-llama2-q2_K`
13b-llama2-q3_K_L	Typelocal	Inputstext	Digest848e49de492f	Download6.9 GB	Parameters13b	QuantizationQ3_K_L	Context4K	Est. memory≈ 9 GB	`ollama run wizardlm:13b-llama2-q3_K_L`
13b-llama2-q3_K_M	Typelocal	Inputstext	Digestf5aadb3dbdd9	Download6.3 GB	Parameters13b	QuantizationQ3_K_M	Context4K	Est. memory≈ 8.5 GB	`ollama run wizardlm:13b-llama2-q3_K_M`
13b-llama2-q3_K_S	Typelocal	Inputstext	Digeste87c1dae586e	Download5.7 GB	Parameters13b	QuantizationQ3_K_S	Context4K	Est. memory≈ 7.5 GB	`ollama run wizardlm:13b-llama2-q3_K_S`
13b-llama2-q4_0	Typelocal	Inputstext	Digest07237eed6d44	Download7.4 GB	Parameters13b	QuantizationQ4_0	Context4K	Est. memory≈ 9.5 GB	`ollama run wizardlm:13b-llama2-q4_0`
13b-llama2-q4_1	Typelocal	Inputstext	Digest966ad219dd6e	Download8.2 GB	Parameters13b	QuantizationQ4_1	Context4K	Est. memory≈ 10.5 GB	`ollama run wizardlm:13b-llama2-q4_1`
13b-llama2-q4_K_M	Typelocal	Inputstext	Digest68d0ec94288a	Download7.9 GB	Parameters13b	QuantizationQ4_K_M	Context4K	Est. memory≈ 10 GB	`ollama run wizardlm:13b-llama2-q4_K_M`
13b-llama2-q4_K_S	Typelocal	Inputstext	Digestac3340957ac2	Download7.4 GB	Parameters13b	QuantizationQ4_K_S	Context4K	Est. memory≈ 9.5 GB	`ollama run wizardlm:13b-llama2-q4_K_S`
13b-llama2-q5_0	Typelocal	Inputstext	Digest210ef327ea9e	Download9.0 GB	Parameters13b	QuantizationQ5_0	Context4K	Est. memory≈ 11.5 GB	`ollama run wizardlm:13b-llama2-q5_0`
13b-llama2-q5_1	Typelocal	Inputstext	Digestb8505c7f2d31	Download9.8 GB	Parameters13b	QuantizationQ5_1	Context4K	Est. memory≈ 12 GB	`ollama run wizardlm:13b-llama2-q5_1`
13b-llama2-q5_K_M	Typelocal	Inputstext	Digesta8da6d573865	Download9.2 GB	Parameters13b	QuantizationQ5_K_M	Context4K	Est. memory≈ 11.5 GB	`ollama run wizardlm:13b-llama2-q5_K_M`
13b-llama2-q5_K_S	Typelocal	Inputstext	Digestb8ed8352b0bd	Download9.0 GB	Parameters13b	QuantizationQ5_K_S	Context4K	Est. memory≈ 11.5 GB	`ollama run wizardlm:13b-llama2-q5_K_S`
13b-llama2-q6_K	Typelocal	Inputstext	Digest6a9a6808f2f6	Download11 GB	Parameters13b	QuantizationQ6_K	Context4K	Est. memory≈ 13.5 GB	`ollama run wizardlm:13b-llama2-q6_K`
13b-llama2-q8_0	Typelocal	Inputstext	Digest5e403198c9b1	Download14 GB	Parameters13b	QuantizationQ8_0	Context4K	Est. memory≈ 17 GB	`ollama run wizardlm:13b-llama2-q8_0`
13b-q2_K	Typelocal	Inputstext	Digest3b8461d9b63c	Download5.4 GB	Parameters13b	QuantizationQ2_K	Context2K	Est. memory≈ 7.5 GB	`ollama run wizardlm:13b-q2_K`
13b-q3_K_L	Typelocal	Inputstext	Digest512973874eed	Download6.9 GB	Parameters13b	QuantizationQ3_K_L	Context2K	Est. memory≈ 9 GB	`ollama run wizardlm:13b-q3_K_L`
13b-q3_K_M	Typelocal	Inputstext	Digesta2397457fb74	Download6.3 GB	Parameters13b	QuantizationQ3_K_M	Context2K	Est. memory≈ 8.5 GB	`ollama run wizardlm:13b-q3_K_M`
13b-q3_K_S	Typelocal	Inputstext	Digest89db746fa2ca	Download5.7 GB	Parameters13b	QuantizationQ3_K_S	Context2K	Est. memory≈ 7.5 GB	`ollama run wizardlm:13b-q3_K_S`
13b-q4_0	Typelocal	Inputstext	Digest7e480c1b3f2f	Download7.4 GB	Parameters13b	QuantizationQ4_0	Context2K	Est. memory≈ 9.5 GB	`ollama run wizardlm:13b-q4_0`
13b-q4_1	Typelocal	Inputstext	Digestdd21b594003b	Download8.2 GB	Parameters13b	QuantizationQ4_1	Context2K	Est. memory≈ 10.5 GB	`ollama run wizardlm:13b-q4_1`
13b-q4_K_M	Typelocal	Inputstext	Digeste6d40c1b0e0d	Download7.9 GB	Parameters13b	QuantizationQ4_K_M	Context2K	Est. memory≈ 10 GB	`ollama run wizardlm:13b-q4_K_M`
13b-q4_K_S	Typelocal	Inputstext	Digest2ccfc126100e	Download7.4 GB	Parameters13b	QuantizationQ4_K_S	Context2K	Est. memory≈ 9.5 GB	`ollama run wizardlm:13b-q4_K_S`
13b-q5_0	Typelocal	Inputstext	Digestf8be29062946	Download9.0 GB	Parameters13b	QuantizationQ5_0	Context2K	Est. memory≈ 11.5 GB	`ollama run wizardlm:13b-q5_0`
13b-q5_1	Typelocal	Inputstext	Digest7a594c88f1a0	Download9.8 GB	Parameters13b	QuantizationQ5_1	Context2K	Est. memory≈ 12 GB	`ollama run wizardlm:13b-q5_1`
13b-q5_K_M	Typelocal	Inputstext	Digestd71253aa6a51	Download9.2 GB	Parameters13b	QuantizationQ5_K_M	Context2K	Est. memory≈ 11.5 GB	`ollama run wizardlm:13b-q5_K_M`
13b-q5_K_S	Typelocal	Inputstext	Digest2db6e4378d69	Download9.0 GB	Parameters13b	QuantizationQ5_K_S	Context2K	Est. memory≈ 11.5 GB	`ollama run wizardlm:13b-q5_K_S`
13b-q6_K	Typelocal	Inputstext	Digest6d11d6afcd43	Download11 GB	Parameters13b	QuantizationQ6_K	Context2K	Est. memory≈ 13.5 GB	`ollama run wizardlm:13b-q6_K`
13b-q8_0	Typelocal	Inputstext	Digest6a7fd096f78a	Download14 GB	Parameters13b	QuantizationQ8_0	Context2K	Est. memory≈ 17 GB	`ollama run wizardlm:13b-q8_0`
30b-fp16	Typelocal	Inputstext	Digest3dc4daa962ba	Download65 GB	Parameters30b	QuantizationFP16	Context2K	Est. memory≈ 74 GB	`ollama run wizardlm:30b-fp16`
30b-q2_K	Typelocal	Inputstext	Digest316a090a9db0	Download14 GB	Parameters30b	QuantizationQ2_K	Context2K	Est. memory≈ 17 GB	`ollama run wizardlm:30b-q2_K`
30b-q3_K_L	Typelocal	Inputstext	Digest7d5c5ca56029	Download17 GB	Parameters30b	QuantizationQ3_K_L	Context2K	Est. memory≈ 20 GB	`ollama run wizardlm:30b-q3_K_L`
30b-q3_K_M	Typelocal	Inputstext	Digest7603650be43d	Download16 GB	Parameters30b	QuantizationQ3_K_M	Context2K	Est. memory≈ 19 GB	`ollama run wizardlm:30b-q3_K_M`
30b-q3_K_S	Typelocal	Inputstext	Digest362bc87500d0	Download14 GB	Parameters30b	QuantizationQ3_K_S	Context2K	Est. memory≈ 17 GB	`ollama run wizardlm:30b-q3_K_S`
30b-q4_0	Typelocal	Inputstext	Digest67513d78f363	Download18 GB	Parameters30b	QuantizationQ4_0	Context2K	Est. memory≈ 21.5 GB	`ollama run wizardlm:30b-q4_0`
30b-q4_1	Typelocal	Inputstext	Digest65744dc3396a	Download20 GB	Parameters30b	QuantizationQ4_1	Context2K	Est. memory≈ 23.5 GB	`ollama run wizardlm:30b-q4_1`
30b-q4_K_M	Typelocal	Inputstext	Digest69839e566826	Download20 GB	Parameters30b	QuantizationQ4_K_M	Context2K	Est. memory≈ 23.5 GB	`ollama run wizardlm:30b-q4_K_M`
30b-q4_K_S	Typelocal	Inputstext	Digestffb56ae33932	Download18 GB	Parameters30b	QuantizationQ4_K_S	Context2K	Est. memory≈ 21.5 GB	`ollama run wizardlm:30b-q4_K_S`
30b-q5_0	Typelocal	Inputstext	Digestf29f3ee70a42	Download22 GB	Parameters30b	QuantizationQ5_0	Context2K	Est. memory≈ 26 GB	`ollama run wizardlm:30b-q5_0`
30b-q5_1	Typelocal	Inputstext	Digest8ea6a8618db0	Download24 GB	Parameters30b	QuantizationQ5_1	Context2K	Est. memory≈ 28 GB	`ollama run wizardlm:30b-q5_1`
30b-q5_K_M	Typelocal	Inputstext	Digest9c007b31c159	Download23 GB	Parameters30b	QuantizationQ5_K_M	Context2K	Est. memory≈ 27 GB	`ollama run wizardlm:30b-q5_K_M`
30b-q5_K_S	Typelocal	Inputstext	Digest5829399005b9	Download22 GB	Parameters30b	QuantizationQ5_K_S	Context2K	Est. memory≈ 26 GB	`ollama run wizardlm:30b-q5_K_S`
30b-q6_K	Typelocal	Inputstext	Digest2674ac1c84bb	Download27 GB	Parameters30b	QuantizationQ6_K	Context2K	Est. memory≈ 31.5 GB	`ollama run wizardlm:30b-q6_K`
30b-q8_0	Typelocal	Inputstext	Digesta5efdd159540	Download35 GB	Parameters30b	QuantizationQ8_0	Context2K	Est. memory≈ 40.5 GB	`ollama run wizardlm:30b-q8_0`
70b-llama2-q2_K	Typelocal	Inputstext	Digeste64d383d4616	Download29 GB	Parameters70b	QuantizationQ2_K	Context4K	Est. memory≈ 33.5 GB	`ollama run wizardlm:70b-llama2-q2_K`
70b-llama2-q3_K_L	Typelocal	Inputstext	Digesta547147dbbb2	Download36 GB	Parameters70b	QuantizationQ3_K_L	Context4K	Est. memory≈ 41.5 GB	`ollama run wizardlm:70b-llama2-q3_K_L`
70b-llama2-q3_K_M	Typelocal	Inputstext	Digest56a8ed83f414	Download33 GB	Parameters70b	QuantizationQ3_K_M	Context4K	Est. memory≈ 38 GB	`ollama run wizardlm:70b-llama2-q3_K_M`
70b-llama2-q3_K_S	Typelocal	Inputstext	Digest301b2de5cdce	Download30 GB	Parameters70b	QuantizationQ3_K_S	Context4K	Est. memory≈ 35 GB	`ollama run wizardlm:70b-llama2-q3_K_S`
70b-llama2-q4_0	Typelocal	Inputstext	Digest2d269a65a092	Download39 GB	Parameters70b	QuantizationQ4_0	Context4K	Est. memory≈ 45 GB	`ollama run wizardlm:70b-llama2-q4_0`
70b-llama2-q4_1	Typelocal	Inputstext	Digest4c5a4bf2a4bd	Download43 GB	Parameters70b	QuantizationQ4_1	Context4K	Est. memory≈ 49.5 GB	`ollama run wizardlm:70b-llama2-q4_1`
70b-llama2-q4_K_M	Typelocal	Inputstext	Digest6741c38608f1	Download41 GB	Parameters70b	QuantizationQ4_K_M	Context4K	Est. memory≈ 47 GB	`ollama run wizardlm:70b-llama2-q4_K_M`
70b-llama2-q4_K_S	Typelocal	Inputstext	Digesta5124a5418a3	Download39 GB	Parameters70b	QuantizationQ4_K_S	Context4K	Est. memory≈ 45 GB	`ollama run wizardlm:70b-llama2-q4_K_S`
70b-llama2-q5_0	Typelocal	Inputstext	Digest6a8d1d7c5360	Download47 GB	Parameters70b	QuantizationQ5_0	Context4K	Est. memory≈ 54 GB	`ollama run wizardlm:70b-llama2-q5_0`
70b-llama2-q5_K_M	Typelocal	Inputstext	Digestebfead13404c	Download49 GB	Parameters70b	QuantizationQ5_K_M	Context4K	Est. memory≈ 56 GB	`ollama run wizardlm:70b-llama2-q5_K_M`
70b-llama2-q5_K_S	Typelocal	Inputstext	Digest440dda0fbaf1	Download47 GB	Parameters70b	QuantizationQ5_K_S	Context4K	Est. memory≈ 54 GB	`ollama run wizardlm:70b-llama2-q5_K_S`
70b-llama2-q6_K	Typelocal	Inputstext	Digest20fd3a5a9146	Download57 GB	Parameters70b	QuantizationQ6_K	Context4K	Est. memory≈ 65 GB	`ollama run wizardlm:70b-llama2-q6_K`
70b-llama2-q8_0	Typelocal	Inputstext	Digest7b59877a048f	Download73 GB	Parameters70b	QuantizationQ8_0	Context4K	Est. memory≈ 83 GB	`ollama run wizardlm:70b-llama2-q8_0`
7b-fp16	Typelocal	Inputstext	Digest7b7b03c75a9c	Download13 GB	Parameters7b	QuantizationFP16	Context2K	Est. memory≈ 16 GB	`ollama run wizardlm:7b-fp16`
7b-q2_Kdefault	Typelocal	Inputstext	Digest3bd62c66bf07	Download2.8 GB	Parameters7b	QuantizationQ2_K	Context2K	Est. memory≈ 4.5 GB	`ollama run wizardlm:7b-q2_K`
7b-q3_K_L	Typelocal	Inputstext	Digestb71375c6360f	Download3.6 GB	Parameters7b	QuantizationQ3_K_L	Context2K	Est. memory≈ 5.5 GB	`ollama run wizardlm:7b-q3_K_L`
7b-q3_K_M	Typelocal	Inputstext	Digest77ee25ef2d73	Download3.3 GB	Parameters7b	QuantizationQ3_K_M	Context2K	Est. memory≈ 5 GB	`ollama run wizardlm:7b-q3_K_M`
7b-q3_K_S	Typelocal	Inputstext	Digest2f4e28f337fb	Download2.9 GB	Parameters7b	QuantizationQ3_K_S	Context2K	Est. memory≈ 4.5 GB	`ollama run wizardlm:7b-q3_K_S`
7b-q4_0	Typelocal	Inputstext	Digest2d84ad17965a	Download3.8 GB	Parameters7b	QuantizationQ4_0	Context2K	Est. memory≈ 5.5 GB	`ollama run wizardlm:7b-q4_0`
7b-q4_1	Typelocal	Inputstext	Digest39ca90eaf0fe	Download4.2 GB	Parameters7b	QuantizationQ4_1	Context2K	Est. memory≈ 6 GB	`ollama run wizardlm:7b-q4_1`
7b-q4_K_M	Typelocal	Inputstext	Digestcfe7771084ed	Download4.1 GB	Parameters7b	QuantizationQ4_K_M	Context2K	Est. memory≈ 6 GB	`ollama run wizardlm:7b-q4_K_M`
7b-q4_K_S	Typelocal	Inputstext	Digest64ff89304116	Download3.9 GB	Parameters7b	QuantizationQ4_K_S	Context2K	Est. memory≈ 5.5 GB	`ollama run wizardlm:7b-q4_K_S`
7b-q5_0	Typelocal	Inputstext	Digestae105d485aa2	Download4.7 GB	Parameters7b	QuantizationQ5_0	Context2K	Est. memory≈ 6.5 GB	`ollama run wizardlm:7b-q5_0`
7b-q5_1	Typelocal	Inputstext	Digestd0e953531965	Download5.1 GB	Parameters7b	QuantizationQ5_1	Context2K	Est. memory≈ 7 GB	`ollama run wizardlm:7b-q5_1`
7b-q5_K_M	Typelocal	Inputstext	Digestab723eb64d3c	Download4.8 GB	Parameters7b	QuantizationQ5_K_M	Context2K	Est. memory≈ 6.5 GB	`ollama run wizardlm:7b-q5_K_M`
7b-q5_K_S	Typelocal	Inputstext	Digest57343a383bbb	Download4.7 GB	Parameters7b	QuantizationQ5_K_S	Context2K	Est. memory≈ 6.5 GB	`ollama run wizardlm:7b-q5_K_S`
7b-q6_K	Typelocal	Inputstext	Digestb04432819f68	Download5.5 GB	Parameters7b	QuantizationQ6_K	Context2K	Est. memory≈ 7.5 GB	`ollama run wizardlm:7b-q6_K`
7b-q8_0	Typelocal	Inputstext	Digest754989a99c95	Download7.2 GB	Parameters7b	QuantizationQ8_0	Context2K	Est. memory≈ 9.5 GB	`ollama run wizardlm:7b-q8_0`

Related models

llama2local

Llama 2 is a collection of foundation language models ranging from 7B to 70B parameters.

codellamalocal

A large language model that can use text prompts to generate and discuss code.

llama2-uncensoredlocal

Uncensored Llama 2 model by George Sung and Jarrad Hope.

wizardcoderlocal

State-of-the-art code generation model