Quick start

ollama run xwinlm:latest

Runnable variants

Memory is a rough file-size estimate; context length, runtime and GPU offload change it.

12 of 80 matching variants shown.80 of 80 variants shown.

Tag	Type	Inputs	Digest	Download	Parameters	Quantization	Context	Est. memory	Run
13b	Typelocal	Inputstext	Digest630afb311638	Download7.4 GB	Parameters13b	QuantizationUnknown	Context4K	Est. memory≈ 9.5 GB	`ollama run xwinlm:13b`
13b-v0.1	Typelocal	Inputstext	Digestcf480ed8e4a7	Download7.4 GB	Parameters13b	QuantizationUnknown	Context4K	Est. memory≈ 9.5 GB	`ollama run xwinlm:13b-v0.1`
13b-v0.1-fp16	Typelocal	Inputstext	Digestd512bdbe09b5	Download26 GB	Parameters13b	QuantizationFP16	Context4K	Est. memory≈ 30.5 GB	`ollama run xwinlm:13b-v0.1-fp16`
13b-v0.1-q2_K	Typelocal	Inputstext	Digest70041388f5fc	Download5.4 GB	Parameters13b	QuantizationQ2_K	Context4K	Est. memory≈ 7.5 GB	`ollama run xwinlm:13b-v0.1-q2_K`
13b-v0.1-q3_K_L	Typelocal	Inputstext	Digestbf6792fa051c	Download6.9 GB	Parameters13b	QuantizationQ3_K_L	Context4K	Est. memory≈ 9 GB	`ollama run xwinlm:13b-v0.1-q3_K_L`
13b-v0.1-q3_K_M	Typelocal	Inputstext	Digestc10ecb514000	Download6.3 GB	Parameters13b	QuantizationQ3_K_M	Context4K	Est. memory≈ 8.5 GB	`ollama run xwinlm:13b-v0.1-q3_K_M`
13b-v0.1-q3_K_S	Typelocal	Inputstext	Digest2a0c92c37e6c	Download5.7 GB	Parameters13b	QuantizationQ3_K_S	Context4K	Est. memory≈ 7.5 GB	`ollama run xwinlm:13b-v0.1-q3_K_S`
13b-v0.1-q4_0	Typelocal	Inputstext	Digestcf480ed8e4a7	Download7.4 GB	Parameters13b	QuantizationQ4_0	Context4K	Est. memory≈ 9.5 GB	`ollama run xwinlm:13b-v0.1-q4_0`
13b-v0.1-q4_1	Typelocal	Inputstext	Digest62d523fc9d2a	Download8.2 GB	Parameters13b	QuantizationQ4_1	Context4K	Est. memory≈ 10.5 GB	`ollama run xwinlm:13b-v0.1-q4_1`
13b-v0.1-q4_K_M	Typelocal	Inputstext	Digest62d182cd9813	Download7.9 GB	Parameters13b	QuantizationQ4_K_M	Context4K	Est. memory≈ 10 GB	`ollama run xwinlm:13b-v0.1-q4_K_M`
13b-v0.1-q4_K_S	Typelocal	Inputstext	Digestdab27e0990ed	Download7.4 GB	Parameters13b	QuantizationQ4_K_S	Context4K	Est. memory≈ 9.5 GB	`ollama run xwinlm:13b-v0.1-q4_K_S`
13b-v0.1-q5_0	Typelocal	Inputstext	Digestd004f7e646a9	Download9.0 GB	Parameters13b	QuantizationQ5_0	Context4K	Est. memory≈ 11.5 GB	`ollama run xwinlm:13b-v0.1-q5_0`
13b-v0.1-q5_1	Typelocal	Inputstext	Digest15c6fd1b2094	Download9.8 GB	Parameters13b	QuantizationQ5_1	Context4K	Est. memory≈ 12 GB	`ollama run xwinlm:13b-v0.1-q5_1`
13b-v0.1-q5_K_M	Typelocal	Inputstext	Digestebc2833ad0ba	Download9.2 GB	Parameters13b	QuantizationQ5_K_M	Context4K	Est. memory≈ 11.5 GB	`ollama run xwinlm:13b-v0.1-q5_K_M`
13b-v0.1-q5_K_S	Typelocal	Inputstext	Digestc71e4af10498	Download9.0 GB	Parameters13b	QuantizationQ5_K_S	Context4K	Est. memory≈ 11.5 GB	`ollama run xwinlm:13b-v0.1-q5_K_S`
13b-v0.1-q6_K	Typelocal	Inputstext	Digest7d926962c2ea	Download11 GB	Parameters13b	QuantizationQ6_K	Context4K	Est. memory≈ 13.5 GB	`ollama run xwinlm:13b-v0.1-q6_K`
13b-v0.1-q8_0	Typelocal	Inputstext	Digest434dd50ba10e	Download14 GB	Parameters13b	QuantizationQ8_0	Context4K	Est. memory≈ 17 GB	`ollama run xwinlm:13b-v0.1-q8_0`
13b-v0.2	Typelocal	Inputstext	Digest630afb311638	Download7.4 GB	Parameters13b	QuantizationUnknown	Context4K	Est. memory≈ 9.5 GB	`ollama run xwinlm:13b-v0.2`
13b-v0.2-fp16	Typelocal	Inputstext	Digest32badafc2fc2	Download26 GB	Parameters13b	QuantizationFP16	Context4K	Est. memory≈ 30.5 GB	`ollama run xwinlm:13b-v0.2-fp16`
13b-v0.2-q2_K	Typelocal	Inputstext	Digestd1f6ddfc4287	Download5.4 GB	Parameters13b	QuantizationQ2_K	Context4K	Est. memory≈ 7.5 GB	`ollama run xwinlm:13b-v0.2-q2_K`
13b-v0.2-q3_K_L	Typelocal	Inputstext	Digestabbe73aa1d14	Download6.9 GB	Parameters13b	QuantizationQ3_K_L	Context4K	Est. memory≈ 9 GB	`ollama run xwinlm:13b-v0.2-q3_K_L`
13b-v0.2-q3_K_M	Typelocal	Inputstext	Digest0a02b867dec8	Download6.3 GB	Parameters13b	QuantizationQ3_K_M	Context4K	Est. memory≈ 8.5 GB	`ollama run xwinlm:13b-v0.2-q3_K_M`
13b-v0.2-q3_K_S	Typelocal	Inputstext	Digestf9f2141b8950	Download5.7 GB	Parameters13b	QuantizationQ3_K_S	Context4K	Est. memory≈ 7.5 GB	`ollama run xwinlm:13b-v0.2-q3_K_S`
13b-v0.2-q4_0	Typelocal	Inputstext	Digest630afb311638	Download7.4 GB	Parameters13b	QuantizationQ4_0	Context4K	Est. memory≈ 9.5 GB	`ollama run xwinlm:13b-v0.2-q4_0`
13b-v0.2-q4_1	Typelocal	Inputstext	Digest2381cac3c270	Download8.2 GB	Parameters13b	QuantizationQ4_1	Context4K	Est. memory≈ 10.5 GB	`ollama run xwinlm:13b-v0.2-q4_1`
13b-v0.2-q4_K_M	Typelocal	Inputstext	Digest103d879f0b5e	Download7.9 GB	Parameters13b	QuantizationQ4_K_M	Context4K	Est. memory≈ 10 GB	`ollama run xwinlm:13b-v0.2-q4_K_M`
13b-v0.2-q4_K_S	Typelocal	Inputstext	Digest739c78f79426	Download7.4 GB	Parameters13b	QuantizationQ4_K_S	Context4K	Est. memory≈ 9.5 GB	`ollama run xwinlm:13b-v0.2-q4_K_S`
13b-v0.2-q5_0	Typelocal	Inputstext	Digest1ba22333648b	Download9.0 GB	Parameters13b	QuantizationQ5_0	Context4K	Est. memory≈ 11.5 GB	`ollama run xwinlm:13b-v0.2-q5_0`
13b-v0.2-q5_1	Typelocal	Inputstext	Digest07a336150c6f	Download9.8 GB	Parameters13b	QuantizationQ5_1	Context4K	Est. memory≈ 12 GB	`ollama run xwinlm:13b-v0.2-q5_1`
13b-v0.2-q5_K_M	Typelocal	Inputstext	Digestcafc0e719d8c	Download9.2 GB	Parameters13b	QuantizationQ5_K_M	Context4K	Est. memory≈ 11.5 GB	`ollama run xwinlm:13b-v0.2-q5_K_M`
13b-v0.2-q5_K_S	Typelocal	Inputstext	Digest3d6c1f9aa6cc	Download9.0 GB	Parameters13b	QuantizationQ5_K_S	Context4K	Est. memory≈ 11.5 GB	`ollama run xwinlm:13b-v0.2-q5_K_S`
13b-v0.2-q6_K	Typelocal	Inputstext	Digest8e00207058b2	Download11 GB	Parameters13b	QuantizationQ6_K	Context4K	Est. memory≈ 13.5 GB	`ollama run xwinlm:13b-v0.2-q6_K`
13b-v0.2-q8_0	Typelocal	Inputstext	Digest26967662730d	Download14 GB	Parameters13b	QuantizationQ8_0	Context4K	Est. memory≈ 17 GB	`ollama run xwinlm:13b-v0.2-q8_0`
70b-v0.1	Typelocal	Inputstext	Digest375c269c0976	Download39 GB	Parameters70b	QuantizationUnknown	Context4K	Est. memory≈ 45 GB	`ollama run xwinlm:70b-v0.1`
70b-v0.1-fp16	Typelocal	Inputstext	Digest30c79e1d7858	Download138 GB	Parameters70b	QuantizationFP16	Context4K	Est. memory≈ 155.5 GB	`ollama run xwinlm:70b-v0.1-fp16`
70b-v0.1-q2_K	Typelocal	Inputstext	Digest6f4a455d60d7	Download29 GB	Parameters70b	QuantizationQ2_K	Context4K	Est. memory≈ 33.5 GB	`ollama run xwinlm:70b-v0.1-q2_K`
70b-v0.1-q3_K_L	Typelocal	Inputstext	Digest25a8677c7a5d	Download36 GB	Parameters70b	QuantizationQ3_K_L	Context4K	Est. memory≈ 41.5 GB	`ollama run xwinlm:70b-v0.1-q3_K_L`
70b-v0.1-q3_K_M	Typelocal	Inputstext	Digest05fcf445bad3	Download33 GB	Parameters70b	QuantizationQ3_K_M	Context4K	Est. memory≈ 38 GB	`ollama run xwinlm:70b-v0.1-q3_K_M`
70b-v0.1-q3_K_S	Typelocal	Inputstext	Digestde1de9349ff9	Download30 GB	Parameters70b	QuantizationQ3_K_S	Context4K	Est. memory≈ 35 GB	`ollama run xwinlm:70b-v0.1-q3_K_S`
70b-v0.1-q4_0	Typelocal	Inputstext	Digest375c269c0976	Download39 GB	Parameters70b	QuantizationQ4_0	Context4K	Est. memory≈ 45 GB	`ollama run xwinlm:70b-v0.1-q4_0`
70b-v0.1-q4_1	Typelocal	Inputstext	Digest5935a6833d26	Download43 GB	Parameters70b	QuantizationQ4_1	Context4K	Est. memory≈ 49.5 GB	`ollama run xwinlm:70b-v0.1-q4_1`
70b-v0.1-q4_K_M	Typelocal	Inputstext	Digest530efaab5085	Download41 GB	Parameters70b	QuantizationQ4_K_M	Context4K	Est. memory≈ 47 GB	`ollama run xwinlm:70b-v0.1-q4_K_M`
70b-v0.1-q4_K_S	Typelocal	Inputstext	Digest351702f698ec	Download39 GB	Parameters70b	QuantizationQ4_K_S	Context4K	Est. memory≈ 45 GB	`ollama run xwinlm:70b-v0.1-q4_K_S`
70b-v0.1-q5_0	Typelocal	Inputstext	Digest69e819a0933e	Download47 GB	Parameters70b	QuantizationQ5_0	Context4K	Est. memory≈ 54 GB	`ollama run xwinlm:70b-v0.1-q5_0`
70b-v0.1-q5_1	Typelocal	Inputstext	Digest063cf60c63ca	Download52 GB	Parameters70b	QuantizationQ5_1	Context4K	Est. memory≈ 59.5 GB	`ollama run xwinlm:70b-v0.1-q5_1`
70b-v0.1-q5_K_S	Typelocal	Inputstext	Digestb5f5af9a9e41	Download47 GB	Parameters70b	QuantizationQ5_K_S	Context4K	Est. memory≈ 54 GB	`ollama run xwinlm:70b-v0.1-q5_K_S`
70b-v0.1-q6_K	Typelocal	Inputstext	Digest003fda23145c	Download57 GB	Parameters70b	QuantizationQ6_K	Context4K	Est. memory≈ 65 GB	`ollama run xwinlm:70b-v0.1-q6_K`
70b-v0.1-q8_0	Typelocal	Inputstext	Digest16733fed6f8c	Download73 GB	Parameters70b	QuantizationQ8_0	Context4K	Est. memory≈ 83 GB	`ollama run xwinlm:70b-v0.1-q8_0`
7b	Typelocal	Inputstext	Digest0fa68068d970	Download3.8 GB	Parameters7b	QuantizationUnknown	Context4K	Est. memory≈ 5.5 GB	`ollama run xwinlm:7b`
7b-v0.1	Typelocal	Inputstext	Digestb403d658bba0	Download3.8 GB	Parameters7b	QuantizationUnknown	Context4K	Est. memory≈ 5.5 GB	`ollama run xwinlm:7b-v0.1`
7b-v0.1-fp16	Typelocal	Inputstext	Digest16c93bccfbd5	Download13 GB	Parameters7b	QuantizationFP16	Context4K	Est. memory≈ 16 GB	`ollama run xwinlm:7b-v0.1-fp16`
7b-v0.1-q2_K	Typelocal	Inputstext	Digest60a5e6fab2d2	Download2.8 GB	Parameters7b	QuantizationQ2_K	Context4K	Est. memory≈ 4.5 GB	`ollama run xwinlm:7b-v0.1-q2_K`
7b-v0.1-q3_K_L	Typelocal	Inputstext	Digestf9d3e59af420	Download3.6 GB	Parameters7b	QuantizationQ3_K_L	Context4K	Est. memory≈ 5.5 GB	`ollama run xwinlm:7b-v0.1-q3_K_L`
7b-v0.1-q3_K_M	Typelocal	Inputstext	Digestb16a6f85ae78	Download3.3 GB	Parameters7b	QuantizationQ3_K_M	Context4K	Est. memory≈ 5 GB	`ollama run xwinlm:7b-v0.1-q3_K_M`
7b-v0.1-q3_K_S	Typelocal	Inputstext	Digest94bbcf9a5f51	Download2.9 GB	Parameters7b	QuantizationQ3_K_S	Context4K	Est. memory≈ 4.5 GB	`ollama run xwinlm:7b-v0.1-q3_K_S`
7b-v0.1-q4_0	Typelocal	Inputstext	Digestb403d658bba0	Download3.8 GB	Parameters7b	QuantizationQ4_0	Context4K	Est. memory≈ 5.5 GB	`ollama run xwinlm:7b-v0.1-q4_0`
7b-v0.1-q4_1	Typelocal	Inputstext	Digest0913a3dfd094	Download4.2 GB	Parameters7b	QuantizationQ4_1	Context4K	Est. memory≈ 6 GB	`ollama run xwinlm:7b-v0.1-q4_1`
7b-v0.1-q4_K_M	Typelocal	Inputstext	Digest32c9ce4f8e94	Download4.1 GB	Parameters7b	QuantizationQ4_K_M	Context4K	Est. memory≈ 6 GB	`ollama run xwinlm:7b-v0.1-q4_K_M`
7b-v0.1-q4_K_S	Typelocal	Inputstext	Digest9fc17adbbb63	Download3.9 GB	Parameters7b	QuantizationQ4_K_S	Context4K	Est. memory≈ 5.5 GB	`ollama run xwinlm:7b-v0.1-q4_K_S`
7b-v0.1-q5_0	Typelocal	Inputstext	Digest7c6150db244e	Download4.7 GB	Parameters7b	QuantizationQ5_0	Context4K	Est. memory≈ 6.5 GB	`ollama run xwinlm:7b-v0.1-q5_0`
7b-v0.1-q5_1	Typelocal	Inputstext	Digest9c38b8b5fdd0	Download5.1 GB	Parameters7b	QuantizationQ5_1	Context4K	Est. memory≈ 7 GB	`ollama run xwinlm:7b-v0.1-q5_1`
7b-v0.1-q5_K_M	Typelocal	Inputstext	Digestf1c209d3638f	Download4.8 GB	Parameters7b	QuantizationQ5_K_M	Context4K	Est. memory≈ 6.5 GB	`ollama run xwinlm:7b-v0.1-q5_K_M`
7b-v0.1-q5_K_S	Typelocal	Inputstext	Digested0f88a710cd	Download4.7 GB	Parameters7b	QuantizationQ5_K_S	Context4K	Est. memory≈ 6.5 GB	`ollama run xwinlm:7b-v0.1-q5_K_S`
7b-v0.1-q6_K	Typelocal	Inputstext	Digest69a6eded5cbf	Download5.5 GB	Parameters7b	QuantizationQ6_K	Context4K	Est. memory≈ 7.5 GB	`ollama run xwinlm:7b-v0.1-q6_K`
7b-v0.1-q8_0	Typelocal	Inputstext	Digest7556549b5a15	Download7.2 GB	Parameters7b	QuantizationQ8_0	Context4K	Est. memory≈ 9.5 GB	`ollama run xwinlm:7b-v0.1-q8_0`
7b-v0.2	Typelocal	Inputstext	Digest0fa68068d970	Download3.8 GB	Parameters7b	QuantizationUnknown	Context4K	Est. memory≈ 5.5 GB	`ollama run xwinlm:7b-v0.2`
7b-v0.2-fp16	Typelocal	Inputstext	Digest8d01614baf49	Download13 GB	Parameters7b	QuantizationFP16	Context4K	Est. memory≈ 16 GB	`ollama run xwinlm:7b-v0.2-fp16`
7b-v0.2-q2_K	Typelocal	Inputstext	Digestfe7141ff19bb	Download2.8 GB	Parameters7b	QuantizationQ2_K	Context4K	Est. memory≈ 4.5 GB	`ollama run xwinlm:7b-v0.2-q2_K`
7b-v0.2-q3_K_L	Typelocal	Inputstext	Digest508c1edd8811	Download3.6 GB	Parameters7b	QuantizationQ3_K_L	Context4K	Est. memory≈ 5.5 GB	`ollama run xwinlm:7b-v0.2-q3_K_L`
7b-v0.2-q3_K_S	Typelocal	Inputstext	Digest1a022f2625ea	Download2.9 GB	Parameters7b	QuantizationQ3_K_S	Context4K	Est. memory≈ 4.5 GB	`ollama run xwinlm:7b-v0.2-q3_K_S`
7b-v0.2-q4_0	Typelocal	Inputstext	Digest0fa68068d970	Download3.8 GB	Parameters7b	QuantizationQ4_0	Context4K	Est. memory≈ 5.5 GB	`ollama run xwinlm:7b-v0.2-q4_0`
7b-v0.2-q4_1	Typelocal	Inputstext	Digest62d9b92fa0c0	Download4.2 GB	Parameters7b	QuantizationQ4_1	Context4K	Est. memory≈ 6 GB	`ollama run xwinlm:7b-v0.2-q4_1`
7b-v0.2-q4_K_M	Typelocal	Inputstext	Digestf67bbe322630	Download4.1 GB	Parameters7b	QuantizationQ4_K_M	Context4K	Est. memory≈ 6 GB	`ollama run xwinlm:7b-v0.2-q4_K_M`
7b-v0.2-q4_K_S	Typelocal	Inputstext	Digestc9597dee32a7	Download3.9 GB	Parameters7b	QuantizationQ4_K_S	Context4K	Est. memory≈ 5.5 GB	`ollama run xwinlm:7b-v0.2-q4_K_S`
7b-v0.2-q5_0	Typelocal	Inputstext	Digestea9caeebc2fe	Download4.7 GB	Parameters7b	QuantizationQ5_0	Context4K	Est. memory≈ 6.5 GB	`ollama run xwinlm:7b-v0.2-q5_0`
7b-v0.2-q5_K_M	Typelocal	Inputstext	Digestc19838f1c26d	Download4.8 GB	Parameters7b	QuantizationQ5_K_M	Context4K	Est. memory≈ 6.5 GB	`ollama run xwinlm:7b-v0.2-q5_K_M`
7b-v0.2-q5_K_S	Typelocal	Inputstext	Digestd3dbad83362a	Download4.7 GB	Parameters7b	QuantizationQ5_K_S	Context4K	Est. memory≈ 6.5 GB	`ollama run xwinlm:7b-v0.2-q5_K_S`
7b-v0.2-q6_K	Typelocal	Inputstext	Digest04ac3723b86a	Download5.5 GB	Parameters7b	QuantizationQ6_K	Context4K	Est. memory≈ 7.5 GB	`ollama run xwinlm:7b-v0.2-q6_K`
7b-v0.2-q8_0	Typelocal	Inputstext	Digest2c7fdd3e299a	Download7.2 GB	Parameters7b	QuantizationQ8_0	Context4K	Est. memory≈ 9.5 GB	`ollama run xwinlm:7b-v0.2-q8_0`
latestdefault	Typelocal	Inputstext	Digest0fa68068d970	Download3.8 GB	ParametersUnknown	QuantizationUnknown	Context4K	Est. memory≈ 5.5 GB	`ollama run xwinlm:latest`

Related models

llama2local

Llama 2 is a collection of foundation language models ranging from 7B to 70B parameters.

codellamalocal

A large language model that can use text prompts to generate and discuss code.

llama2-uncensoredlocal

Uncensored Llama 2 model by George Sung and Jarrad Hope.

wizardcoderlocal

State-of-the-art code generation model