Quick start

ollama run wizardcoder:latest

Runnable variants

Memory is a rough file-size estimate; context length, runtime and GPU offload change it.

12 of 67 matching variants shown.67 of 67 variants shown.

Tag	Type	Inputs	Digest	Download	Parameters	Quantization	Context	Est. memory	Run
13b-python	Typelocal	Inputstext	Digestd7a182d30037	Download7.4 GB	Parameters13b	QuantizationUnknown	Context16K	Est. memory≈ 9.5 GB	`ollama run wizardcoder:13b-python`
13b-python-fp16	Typelocal	Inputstext	Digestb680f30d4604	Download26 GB	Parameters13b	QuantizationFP16	Context16K	Est. memory≈ 30.5 GB	`ollama run wizardcoder:13b-python-fp16`
13b-python-q2_K	Typelocal	Inputstext	Digest9d08f09f5a11	Download5.4 GB	Parameters13b	QuantizationQ2_K	Context16K	Est. memory≈ 7.5 GB	`ollama run wizardcoder:13b-python-q2_K`
13b-python-q3_K_L	Typelocal	Inputstext	Digest80d029502a71	Download6.9 GB	Parameters13b	QuantizationQ3_K_L	Context16K	Est. memory≈ 9 GB	`ollama run wizardcoder:13b-python-q3_K_L`
13b-python-q3_K_M	Typelocal	Inputstext	Digest879ce164f5d6	Download6.3 GB	Parameters13b	QuantizationQ3_K_M	Context16K	Est. memory≈ 8.5 GB	`ollama run wizardcoder:13b-python-q3_K_M`
13b-python-q3_K_S	Typelocal	Inputstext	Digestd37ae23270d6	Download5.7 GB	Parameters13b	QuantizationQ3_K_S	Context16K	Est. memory≈ 7.5 GB	`ollama run wizardcoder:13b-python-q3_K_S`
13b-python-q4_0	Typelocal	Inputstext	Digestd7a182d30037	Download7.4 GB	Parameters13b	QuantizationQ4_0	Context16K	Est. memory≈ 9.5 GB	`ollama run wizardcoder:13b-python-q4_0`
13b-python-q4_1	Typelocal	Inputstext	Digestb28d73532f80	Download8.2 GB	Parameters13b	QuantizationQ4_1	Context16K	Est. memory≈ 10.5 GB	`ollama run wizardcoder:13b-python-q4_1`
13b-python-q4_K_M	Typelocal	Inputstext	Digest4bd69e8c1d54	Download7.9 GB	Parameters13b	QuantizationQ4_K_M	Context16K	Est. memory≈ 10 GB	`ollama run wizardcoder:13b-python-q4_K_M`
13b-python-q4_K_S	Typelocal	Inputstext	Digest1e0d5d8584b7	Download7.4 GB	Parameters13b	QuantizationQ4_K_S	Context16K	Est. memory≈ 9.5 GB	`ollama run wizardcoder:13b-python-q4_K_S`
13b-python-q5_0	Typelocal	Inputstext	Digest5535a0b027bf	Download9.0 GB	Parameters13b	QuantizationQ5_0	Context16K	Est. memory≈ 11.5 GB	`ollama run wizardcoder:13b-python-q5_0`
13b-python-q5_1	Typelocal	Inputstext	Digestca2dfb0ddeef	Download9.8 GB	Parameters13b	QuantizationQ5_1	Context16K	Est. memory≈ 12 GB	`ollama run wizardcoder:13b-python-q5_1`
13b-python-q5_K_M	Typelocal	Inputstext	Digeste48f7ff9a44a	Download9.2 GB	Parameters13b	QuantizationQ5_K_M	Context16K	Est. memory≈ 11.5 GB	`ollama run wizardcoder:13b-python-q5_K_M`
13b-python-q5_K_S	Typelocal	Inputstext	Digest984be9aee8bb	Download9.0 GB	Parameters13b	QuantizationQ5_K_S	Context16K	Est. memory≈ 11.5 GB	`ollama run wizardcoder:13b-python-q5_K_S`
13b-python-q6_K	Typelocal	Inputstext	Digest3b010d19b3a9	Download11 GB	Parameters13b	QuantizationQ6_K	Context16K	Est. memory≈ 13.5 GB	`ollama run wizardcoder:13b-python-q6_K`
13b-python-q8_0	Typelocal	Inputstext	Digest486974de5d6c	Download14 GB	Parameters13b	QuantizationQ8_0	Context16K	Est. memory≈ 17 GB	`ollama run wizardcoder:13b-python-q8_0`
33b	Typelocal	Inputstext	Digest5b944d3546ee	Download19 GB	Parameters33b	QuantizationUnknown	Context16K	Est. memory≈ 22.5 GB	`ollama run wizardcoder:33b`
33b-v1.1	Typelocal	Inputstext	Digest5b944d3546ee	Download19 GB	Parameters33b	QuantizationUnknown	Context16K	Est. memory≈ 22.5 GB	`ollama run wizardcoder:33b-v1.1`
33b-v1.1-fp16	Typelocal	Inputstext	Digesta56de4864c5f	Download67 GB	Parameters33b	QuantizationFP16	Context16K	Est. memory≈ 76 GB	`ollama run wizardcoder:33b-v1.1-fp16`
33b-v1.1-q2_K	Typelocal	Inputstext	Digestcac60354d59f	Download14 GB	Parameters33b	QuantizationQ2_K	Context16K	Est. memory≈ 17 GB	`ollama run wizardcoder:33b-v1.1-q2_K`
33b-v1.1-q3_K_L	Typelocal	Inputstext	Digestb31ccebc7f39	Download18 GB	Parameters33b	QuantizationQ3_K_L	Context16K	Est. memory≈ 21.5 GB	`ollama run wizardcoder:33b-v1.1-q3_K_L`
33b-v1.1-q3_K_M	Typelocal	Inputstext	Digesta10f6bc2ea74	Download16 GB	Parameters33b	QuantizationQ3_K_M	Context16K	Est. memory≈ 19 GB	`ollama run wizardcoder:33b-v1.1-q3_K_M`
33b-v1.1-q3_K_S	Typelocal	Inputstext	Digest4449975a9912	Download14 GB	Parameters33b	QuantizationQ3_K_S	Context16K	Est. memory≈ 17 GB	`ollama run wizardcoder:33b-v1.1-q3_K_S`
33b-v1.1-q4_0	Typelocal	Inputstext	Digest5b944d3546ee	Download19 GB	Parameters33b	QuantizationQ4_0	Context16K	Est. memory≈ 22.5 GB	`ollama run wizardcoder:33b-v1.1-q4_0`
33b-v1.1-q4_1	Typelocal	Inputstext	Digestd487355ac46a	Download21 GB	Parameters33b	QuantizationQ4_1	Context16K	Est. memory≈ 24.5 GB	`ollama run wizardcoder:33b-v1.1-q4_1`
33b-v1.1-q4_K_M	Typelocal	Inputstext	Digest48cc48a16966	Download20 GB	Parameters33b	QuantizationQ4_K_M	Context16K	Est. memory≈ 23.5 GB	`ollama run wizardcoder:33b-v1.1-q4_K_M`
33b-v1.1-q4_K_S	Typelocal	Inputstext	Digest7e44c2801867	Download19 GB	Parameters33b	QuantizationQ4_K_S	Context16K	Est. memory≈ 22.5 GB	`ollama run wizardcoder:33b-v1.1-q4_K_S`
33b-v1.1-q5_0	Typelocal	Inputstext	Digest01d68c42eb7a	Download23 GB	Parameters33b	QuantizationQ5_0	Context16K	Est. memory≈ 27 GB	`ollama run wizardcoder:33b-v1.1-q5_0`
33b-v1.1-q5_1	Typelocal	Inputstext	Digesta7061aa66c60	Download25 GB	Parameters33b	QuantizationQ5_1	Context16K	Est. memory≈ 29 GB	`ollama run wizardcoder:33b-v1.1-q5_1`
33b-v1.1-q5_K_M	Typelocal	Inputstext	Digestc54e9691c0e5	Download24 GB	Parameters33b	QuantizationQ5_K_M	Context16K	Est. memory≈ 28 GB	`ollama run wizardcoder:33b-v1.1-q5_K_M`
33b-v1.1-q5_K_S	Typelocal	Inputstext	Digestd2b35a494eb7	Download23 GB	Parameters33b	QuantizationQ5_K_S	Context16K	Est. memory≈ 27 GB	`ollama run wizardcoder:33b-v1.1-q5_K_S`
33b-v1.1-q6_K	Typelocal	Inputstext	Digest3b8ff92e2c36	Download27 GB	Parameters33b	QuantizationQ6_K	Context16K	Est. memory≈ 31.5 GB	`ollama run wizardcoder:33b-v1.1-q6_K`
33b-v1.1-q8_0	Typelocal	Inputstext	Digeste40b547ccf3c	Download35 GB	Parameters33b	QuantizationQ8_0	Context16K	Est. memory≈ 40.5 GB	`ollama run wizardcoder:33b-v1.1-q8_0`
34b-python	Typelocal	Inputstext	Digest94b069a3c250	Download19 GB	Parameters34b	QuantizationUnknown	Context16K	Est. memory≈ 22.5 GB	`ollama run wizardcoder:34b-python`
34b-python-fp16	Typelocal	Inputstext	Digest06ce62e380d8	Download67 GB	Parameters34b	QuantizationFP16	Context16K	Est. memory≈ 76 GB	`ollama run wizardcoder:34b-python-fp16`
34b-python-q2_K	Typelocal	Inputstext	Digesta66fc80190bc	Download14 GB	Parameters34b	QuantizationQ2_K	Context16K	Est. memory≈ 17 GB	`ollama run wizardcoder:34b-python-q2_K`
34b-python-q3_K_L	Typelocal	Inputstext	Digest89b75137872a	Download18 GB	Parameters34b	QuantizationQ3_K_L	Context16K	Est. memory≈ 21.5 GB	`ollama run wizardcoder:34b-python-q3_K_L`
34b-python-q3_K_M	Typelocal	Inputstext	Digest20d614b143fc	Download16 GB	Parameters34b	QuantizationQ3_K_M	Context16K	Est. memory≈ 19 GB	`ollama run wizardcoder:34b-python-q3_K_M`
34b-python-q3_K_S	Typelocal	Inputstext	Digest5e0df15140c3	Download15 GB	Parameters34b	QuantizationQ3_K_S	Context16K	Est. memory≈ 18 GB	`ollama run wizardcoder:34b-python-q3_K_S`
34b-python-q4_0	Typelocal	Inputstext	Digest94b069a3c250	Download19 GB	Parameters34b	QuantizationQ4_0	Context16K	Est. memory≈ 22.5 GB	`ollama run wizardcoder:34b-python-q4_0`
34b-python-q4_1	Typelocal	Inputstext	Digesta3dcf8f5f9f4	Download21 GB	Parameters34b	QuantizationQ4_1	Context16K	Est. memory≈ 24.5 GB	`ollama run wizardcoder:34b-python-q4_1`
34b-python-q4_K_M	Typelocal	Inputstext	Digestd9be0b235c1a	Download20 GB	Parameters34b	QuantizationQ4_K_M	Context16K	Est. memory≈ 23.5 GB	`ollama run wizardcoder:34b-python-q4_K_M`
34b-python-q4_K_S	Typelocal	Inputstext	Digestf040233a2069	Download19 GB	Parameters34b	QuantizationQ4_K_S	Context16K	Est. memory≈ 22.5 GB	`ollama run wizardcoder:34b-python-q4_K_S`
34b-python-q5_0	Typelocal	Inputstext	Digest919631f57df4	Download23 GB	Parameters34b	QuantizationQ5_0	Context16K	Est. memory≈ 27 GB	`ollama run wizardcoder:34b-python-q5_0`
34b-python-q5_1	Typelocal	Inputstext	Digest3a87a5cc556c	Download25 GB	Parameters34b	QuantizationQ5_1	Context16K	Est. memory≈ 29 GB	`ollama run wizardcoder:34b-python-q5_1`
34b-python-q5_K_M	Typelocal	Inputstext	Digesta1e91b87cba7	Download24 GB	Parameters34b	QuantizationQ5_K_M	Context16K	Est. memory≈ 28 GB	`ollama run wizardcoder:34b-python-q5_K_M`
34b-python-q5_K_S	Typelocal	Inputstext	Digest53e9b8e3838c	Download23 GB	Parameters34b	QuantizationQ5_K_S	Context16K	Est. memory≈ 27 GB	`ollama run wizardcoder:34b-python-q5_K_S`
34b-python-q6_K	Typelocal	Inputstext	Digest7bd078e389d6	Download28 GB	Parameters34b	QuantizationQ6_K	Context16K	Est. memory≈ 32.5 GB	`ollama run wizardcoder:34b-python-q6_K`
34b-python-q8_0	Typelocal	Inputstext	Digest4175ea9836f7	Download36 GB	Parameters34b	QuantizationQ8_0	Context16K	Est. memory≈ 41.5 GB	`ollama run wizardcoder:34b-python-q8_0`
7b-python	Typelocal	Inputstext	Digestde9d848c1323	Download3.8 GB	Parameters7b	QuantizationUnknown	Context16K	Est. memory≈ 5.5 GB	`ollama run wizardcoder:7b-python`
7b-python-fp16	Typelocal	Inputstext	Digestc7922dcf56f4	Download13 GB	Parameters7b	QuantizationFP16	Context16K	Est. memory≈ 16 GB	`ollama run wizardcoder:7b-python-fp16`
7b-python-q2_K	Typelocal	Inputstext	Digestd644137a0ac3	Download2.8 GB	Parameters7b	QuantizationQ2_K	Context16K	Est. memory≈ 4.5 GB	`ollama run wizardcoder:7b-python-q2_K`
7b-python-q3_K_L	Typelocal	Inputstext	Digest679d81a8f5ac	Download3.6 GB	Parameters7b	QuantizationQ3_K_L	Context16K	Est. memory≈ 5.5 GB	`ollama run wizardcoder:7b-python-q3_K_L`
7b-python-q3_K_M	Typelocal	Inputstext	Digestaa045df3991e	Download3.3 GB	Parameters7b	QuantizationQ3_K_M	Context16K	Est. memory≈ 5 GB	`ollama run wizardcoder:7b-python-q3_K_M`
7b-python-q3_K_S	Typelocal	Inputstext	Digest708bb076c986	Download2.9 GB	Parameters7b	QuantizationQ3_K_S	Context16K	Est. memory≈ 4.5 GB	`ollama run wizardcoder:7b-python-q3_K_S`
7b-python-q4_0	Typelocal	Inputstext	Digestde9d848c1323	Download3.8 GB	Parameters7b	QuantizationQ4_0	Context16K	Est. memory≈ 5.5 GB	`ollama run wizardcoder:7b-python-q4_0`
7b-python-q4_1	Typelocal	Inputstext	Digeste2860acf8d17	Download4.2 GB	Parameters7b	QuantizationQ4_1	Context16K	Est. memory≈ 6 GB	`ollama run wizardcoder:7b-python-q4_1`
7b-python-q4_K_M	Typelocal	Inputstext	Digest3e02fecbaa9a	Download4.1 GB	Parameters7b	QuantizationQ4_K_M	Context16K	Est. memory≈ 6 GB	`ollama run wizardcoder:7b-python-q4_K_M`
7b-python-q4_K_S	Typelocal	Inputstext	Digest366cbd3b76e0	Download3.9 GB	Parameters7b	QuantizationQ4_K_S	Context16K	Est. memory≈ 5.5 GB	`ollama run wizardcoder:7b-python-q4_K_S`
7b-python-q5_0	Typelocal	Inputstext	Digestb0eab9a46be4	Download4.7 GB	Parameters7b	QuantizationQ5_0	Context16K	Est. memory≈ 6.5 GB	`ollama run wizardcoder:7b-python-q5_0`
7b-python-q5_1	Typelocal	Inputstext	Digest07ea37319f2b	Download5.1 GB	Parameters7b	QuantizationQ5_1	Context16K	Est. memory≈ 7 GB	`ollama run wizardcoder:7b-python-q5_1`
7b-python-q5_K_M	Typelocal	Inputstext	Digest6e7969881169	Download4.8 GB	Parameters7b	QuantizationQ5_K_M	Context16K	Est. memory≈ 6.5 GB	`ollama run wizardcoder:7b-python-q5_K_M`
7b-python-q5_K_S	Typelocal	Inputstext	Digest04130203ceb8	Download4.7 GB	Parameters7b	QuantizationQ5_K_S	Context16K	Est. memory≈ 6.5 GB	`ollama run wizardcoder:7b-python-q5_K_S`
7b-python-q6_K	Typelocal	Inputstext	Digest2d3281c4b417	Download5.5 GB	Parameters7b	QuantizationQ6_K	Context16K	Est. memory≈ 7.5 GB	`ollama run wizardcoder:7b-python-q6_K`
7b-python-q8_0	Typelocal	Inputstext	Digest711202346249	Download7.2 GB	Parameters7b	QuantizationQ8_0	Context16K	Est. memory≈ 9.5 GB	`ollama run wizardcoder:7b-python-q8_0`
latestdefault	Typelocal	Inputstext	Digestde9d848c1323	Download3.8 GB	ParametersUnknown	QuantizationUnknown	Context16K	Est. memory≈ 5.5 GB	`ollama run wizardcoder:latest`
python	Typelocal	Inputstext	Digestde9d848c1323	Download3.8 GB	ParametersUnknown	QuantizationUnknown	Context16K	Est. memory≈ 5.5 GB	`ollama run wizardcoder:python`

Related models

llama2local

Llama 2 is a collection of foundation language models ranging from 7B to 70B parameters.

codellamalocal

A large language model that can use text prompts to generate and discuss code.

llama2-uncensoredlocal

Uncensored Llama 2 model by George Sung and Jarrad Hope.

vicunalocal

General use chat model based on Llama and Llama 2 with 2K to 16K context sizes.