Quick start

ollama run wizardlm2:latest

Runnable variants

Memory is a rough file-size estimate; context length, runtime and GPU offload change it.

12 of 22 matching variants shown.22 of 22 variants shown.

Tag	Type	Inputs	Digest	Download	Parameters	Quantization	Context	Est. memory	Run
7b	Typelocal	Inputstext	Digestc9b1aff820f2	Download4.1 GB	Parameters7b	QuantizationUnknown	Context32K	Est. memory≈ 6 GB	`ollama run wizardlm2:7b`
7b-fp16	Typelocal	Inputstext	Digesta34a3bbd552b	Download14 GB	Parameters7b	QuantizationFP16	Context32K	Est. memory≈ 17 GB	`ollama run wizardlm2:7b-fp16`
7b-q2_K	Typelocal	Inputstext	Digest5795bd86f958	Download2.7 GB	Parameters7b	QuantizationQ2_K	Context32K	Est. memory≈ 4.5 GB	`ollama run wizardlm2:7b-q2_K`
7b-q3_K_L	Typelocal	Inputstext	Digest9bcee57837f2	Download3.8 GB	Parameters7b	QuantizationQ3_K_L	Context32K	Est. memory≈ 5.5 GB	`ollama run wizardlm2:7b-q3_K_L`
7b-q3_K_M	Typelocal	Inputstext	Digest1cfd5676dee8	Download3.5 GB	Parameters7b	QuantizationQ3_K_M	Context32K	Est. memory≈ 5 GB	`ollama run wizardlm2:7b-q3_K_M`
7b-q3_K_S	Typelocal	Inputstext	Digest7bf0381ea93d	Download3.2 GB	Parameters7b	QuantizationQ3_K_S	Context32K	Est. memory≈ 5 GB	`ollama run wizardlm2:7b-q3_K_S`
7b-q4_0	Typelocal	Inputstext	Digestc9b1aff820f2	Download4.1 GB	Parameters7b	QuantizationQ4_0	Context32K	Est. memory≈ 6 GB	`ollama run wizardlm2:7b-q4_0`
7b-q4_1	Typelocal	Inputstext	Digestc0852cdfcb53	Download4.6 GB	Parameters7b	QuantizationQ4_1	Context32K	Est. memory≈ 6.5 GB	`ollama run wizardlm2:7b-q4_1`
7b-q4_K_M	Typelocal	Inputstext	Digest3de5776b30d9	Download4.4 GB	Parameters7b	QuantizationQ4_K_M	Context32K	Est. memory≈ 6 GB	`ollama run wizardlm2:7b-q4_K_M`
7b-q4_K_S	Typelocal	Inputstext	Digest48a4adb06e0f	Download4.1 GB	Parameters7b	QuantizationQ4_K_S	Context32K	Est. memory≈ 6 GB	`ollama run wizardlm2:7b-q4_K_S`
7b-q5_0	Typelocal	Inputstext	Digeste7f2dbadd07d	Download5.0 GB	Parameters7b	QuantizationQ5_0	Context32K	Est. memory≈ 7 GB	`ollama run wizardlm2:7b-q5_0`
7b-q5_1	Typelocal	Inputstext	Digest4e51908f7cd5	Download5.4 GB	Parameters7b	QuantizationQ5_1	Context32K	Est. memory≈ 7.5 GB	`ollama run wizardlm2:7b-q5_1`
7b-q5_K_M	Typelocal	Inputstext	Digest5d60e2aefec6	Download5.1 GB	Parameters7b	QuantizationQ5_K_M	Context32K	Est. memory≈ 7 GB	`ollama run wizardlm2:7b-q5_K_M`
7b-q5_K_S	Typelocal	Inputstext	Digest895e99ce6162	Download5.0 GB	Parameters7b	QuantizationQ5_K_S	Context32K	Est. memory≈ 7 GB	`ollama run wizardlm2:7b-q5_K_S`
7b-q6_K	Typelocal	Inputstext	Digest6195668c4294	Download5.9 GB	Parameters7b	QuantizationQ6_K	Context32K	Est. memory≈ 8 GB	`ollama run wizardlm2:7b-q6_K`
7b-q8_0	Typelocal	Inputstext	Digestf74bc2dc64aa	Download7.7 GB	Parameters7b	QuantizationQ8_0	Context32K	Est. memory≈ 10 GB	`ollama run wizardlm2:7b-q8_0`
8x22b	Typelocal	Inputstext	Digestabda6e58fd1d	Download80 GB	Parameters8x22b	QuantizationUnknown	Context64K	Est. memory≈ 90.5 GB	`ollama run wizardlm2:8x22b`
8x22b-fp16	Typelocal	Inputstext	Digest39f772dd966e	Download281 GB	Parameters8x22b	QuantizationFP16	Context64K	Est. memory≈ 315.5 GB	`ollama run wizardlm2:8x22b-fp16`
8x22b-q2_K	Typelocal	Inputstext	Digest9f09573d18b6	Download52 GB	Parameters8x22b	QuantizationQ2_K	Context64K	Est. memory≈ 59.5 GB	`ollama run wizardlm2:8x22b-q2_K`
8x22b-q4_0	Typelocal	Inputstext	Digestabda6e58fd1d	Download80 GB	Parameters8x22b	QuantizationQ4_0	Context64K	Est. memory≈ 90.5 GB	`ollama run wizardlm2:8x22b-q4_0`
8x22b-q8_0	Typelocal	Inputstext	Digest07d5ea336544	Download149 GB	Parameters8x22b	QuantizationQ8_0	Context64K	Est. memory≈ 168 GB	`ollama run wizardlm2:8x22b-q8_0`
latestdefault	Typelocal	Inputstext	Digestc9b1aff820f2	Download4.1 GB	ParametersUnknown	QuantizationUnknown	Context32K	Est. memory≈ 6 GB	`ollama run wizardlm2:latest`

Related models

mistrallocal

The 7B model released by Mistral AI, updated to version 0.3.

dolphin-mistrallocal

The uncensored Dolphin model based on Mistral that excels at coding tasks. Updated to version 2.8.

starling-lmlocal

Starling is a large language model trained by reinforcement learning from AI feedback focused on improving chatbot helpfulness.

mathstrallocal

MathΣtral: a 7B model designed for math reasoning and scientific discovery by Mistral AI.