Quick start

ollama run zephyr:latest

Runnable variants

Memory is a rough file-size estimate; context length, runtime and GPU offload change it.

12 of 40 matching variants shown.40 of 40 variants shown.

Tag	Type	Inputs	Digest	Download	Parameters	Quantization	Context	Est. memory	Run
141b	Typelocal	Inputstext	Digest31b0b6c9d69f	Download80 GB	Parameters141b	QuantizationUnknown	Context64K	Est. memory≈ 90.5 GB	`ollama run zephyr:141b`
141b-v0.1	Typelocal	Inputstext	Digest31b0b6c9d69f	Download80 GB	Parameters141b	QuantizationUnknown	Context64K	Est. memory≈ 90.5 GB	`ollama run zephyr:141b-v0.1`
141b-v0.1-fp16	Typelocal	Inputstext	Digest7bc5b262ff30	Download281 GB	Parameters141b	QuantizationFP16	Context64K	Est. memory≈ 315.5 GB	`ollama run zephyr:141b-v0.1-fp16`
141b-v0.1-q2_K	Typelocal	Inputstext	Digestd5c73d340d28	Download52 GB	Parameters141b	QuantizationQ2_K	Context64K	Est. memory≈ 59.5 GB	`ollama run zephyr:141b-v0.1-q2_K`
141b-v0.1-q4_0	Typelocal	Inputstext	Digest31b0b6c9d69f	Download80 GB	Parameters141b	QuantizationQ4_0	Context64K	Est. memory≈ 90.5 GB	`ollama run zephyr:141b-v0.1-q4_0`
141b-v0.1-q8_0	Typelocal	Inputstext	Digest74c478cfbe57	Download149 GB	Parameters141b	QuantizationQ8_0	Context64K	Est. memory≈ 168 GB	`ollama run zephyr:141b-v0.1-q8_0`
7b	Typelocal	Inputstext	Digestbbe38b81adec	Download4.1 GB	Parameters7b	QuantizationUnknown	Context32K	Est. memory≈ 6 GB	`ollama run zephyr:7b`
7b-alpha	Typelocal	Inputstext	Digest41db45eedfe5	Download4.1 GB	Parameters7b	QuantizationUnknown	Context32K	Est. memory≈ 6 GB	`ollama run zephyr:7b-alpha`
7b-alpha-fp16	Typelocal	Inputstext	Digestadd59b7f7dab	Download14 GB	Parameters7b	QuantizationFP16	Context32K	Est. memory≈ 17 GB	`ollama run zephyr:7b-alpha-fp16`
7b-alpha-q2_K	Typelocal	Inputstext	Digest499c406f90e6	Download3.1 GB	Parameters7b	QuantizationQ2_K	Context32K	Est. memory≈ 4.5 GB	`ollama run zephyr:7b-alpha-q2_K`
7b-alpha-q3_K_L	Typelocal	Inputstext	Digest2dca6ee2b47c	Download3.8 GB	Parameters7b	QuantizationQ3_K_L	Context32K	Est. memory≈ 5.5 GB	`ollama run zephyr:7b-alpha-q3_K_L`
7b-alpha-q3_K_M	Typelocal	Inputstext	Digestbaaa40d0a6ae	Download3.5 GB	Parameters7b	QuantizationQ3_K_M	Context32K	Est. memory≈ 5 GB	`ollama run zephyr:7b-alpha-q3_K_M`
7b-alpha-q3_K_S	Typelocal	Inputstext	Digest79e2d8538b1a	Download3.2 GB	Parameters7b	QuantizationQ3_K_S	Context32K	Est. memory≈ 5 GB	`ollama run zephyr:7b-alpha-q3_K_S`
7b-alpha-q4_0	Typelocal	Inputstext	Digest41db45eedfe5	Download4.1 GB	Parameters7b	QuantizationQ4_0	Context32K	Est. memory≈ 6 GB	`ollama run zephyr:7b-alpha-q4_0`
7b-alpha-q4_1	Typelocal	Inputstext	Digestdef2c83c706e	Download4.6 GB	Parameters7b	QuantizationQ4_1	Context32K	Est. memory≈ 6.5 GB	`ollama run zephyr:7b-alpha-q4_1`
7b-alpha-q4_K_M	Typelocal	Inputstext	Digest0fcbe7af791e	Download4.4 GB	Parameters7b	QuantizationQ4_K_M	Context32K	Est. memory≈ 6 GB	`ollama run zephyr:7b-alpha-q4_K_M`
7b-alpha-q4_K_S	Typelocal	Inputstext	Digest003038afd62d	Download4.1 GB	Parameters7b	QuantizationQ4_K_S	Context32K	Est. memory≈ 6 GB	`ollama run zephyr:7b-alpha-q4_K_S`
7b-alpha-q5_0	Typelocal	Inputstext	Digest110b09717ce9	Download5.0 GB	Parameters7b	QuantizationQ5_0	Context32K	Est. memory≈ 7 GB	`ollama run zephyr:7b-alpha-q5_0`
7b-alpha-q5_1	Typelocal	Inputstext	Digest0484ef77caf6	Download5.4 GB	Parameters7b	QuantizationQ5_1	Context32K	Est. memory≈ 7.5 GB	`ollama run zephyr:7b-alpha-q5_1`
7b-alpha-q5_K_M	Typelocal	Inputstext	Digest107c6b2c9c4f	Download5.1 GB	Parameters7b	QuantizationQ5_K_M	Context32K	Est. memory≈ 7 GB	`ollama run zephyr:7b-alpha-q5_K_M`
7b-alpha-q5_K_S	Typelocal	Inputstext	Digest82eaf5453c6b	Download5.0 GB	Parameters7b	QuantizationQ5_K_S	Context32K	Est. memory≈ 7 GB	`ollama run zephyr:7b-alpha-q5_K_S`
7b-alpha-q6_K	Typelocal	Inputstext	Digest69373e3f99d5	Download5.9 GB	Parameters7b	QuantizationQ6_K	Context32K	Est. memory≈ 8 GB	`ollama run zephyr:7b-alpha-q6_K`
7b-alpha-q8_0	Typelocal	Inputstext	Digest0e68bba39b3d	Download7.7 GB	Parameters7b	QuantizationQ8_0	Context32K	Est. memory≈ 10 GB	`ollama run zephyr:7b-alpha-q8_0`
7b-beta	Typelocal	Inputstext	Digestbbe38b81adec	Download4.1 GB	Parameters7b	QuantizationUnknown	Context32K	Est. memory≈ 6 GB	`ollama run zephyr:7b-beta`
7b-beta-fp16	Typelocal	Inputstext	Digest85a4e7a31862	Download14 GB	Parameters7b	QuantizationFP16	Context32K	Est. memory≈ 17 GB	`ollama run zephyr:7b-beta-fp16`
7b-beta-q2_K	Typelocal	Inputstext	Digest2ba2da5abef9	Download3.1 GB	Parameters7b	QuantizationQ2_K	Context32K	Est. memory≈ 4.5 GB	`ollama run zephyr:7b-beta-q2_K`
7b-beta-q3_K_L	Typelocal	Inputstext	Digest410a8b7cbfbf	Download3.8 GB	Parameters7b	QuantizationQ3_K_L	Context32K	Est. memory≈ 5.5 GB	`ollama run zephyr:7b-beta-q3_K_L`
7b-beta-q3_K_M	Typelocal	Inputstext	Digest75a7002f3885	Download3.5 GB	Parameters7b	QuantizationQ3_K_M	Context32K	Est. memory≈ 5 GB	`ollama run zephyr:7b-beta-q3_K_M`
7b-beta-q3_K_S	Typelocal	Inputstext	Digest5a359ab6ce9c	Download3.2 GB	Parameters7b	QuantizationQ3_K_S	Context32K	Est. memory≈ 5 GB	`ollama run zephyr:7b-beta-q3_K_S`
7b-beta-q4_0	Typelocal	Inputstext	Digestbbe38b81adec	Download4.1 GB	Parameters7b	QuantizationQ4_0	Context32K	Est. memory≈ 6 GB	`ollama run zephyr:7b-beta-q4_0`
7b-beta-q4_1	Typelocal	Inputstext	Digest9dda547ba87b	Download4.6 GB	Parameters7b	QuantizationQ4_1	Context32K	Est. memory≈ 6.5 GB	`ollama run zephyr:7b-beta-q4_1`
7b-beta-q4_K_M	Typelocal	Inputstext	Digest961df065a980	Download4.4 GB	Parameters7b	QuantizationQ4_K_M	Context32K	Est. memory≈ 6 GB	`ollama run zephyr:7b-beta-q4_K_M`
7b-beta-q4_K_S	Typelocal	Inputstext	Digestc9e294ff1e6f	Download4.1 GB	Parameters7b	QuantizationQ4_K_S	Context32K	Est. memory≈ 6 GB	`ollama run zephyr:7b-beta-q4_K_S`
7b-beta-q5_0	Typelocal	Inputstext	Digestd9161a2d3687	Download5.0 GB	Parameters7b	QuantizationQ5_0	Context32K	Est. memory≈ 7 GB	`ollama run zephyr:7b-beta-q5_0`
7b-beta-q5_1	Typelocal	Inputstext	Digest887c48b48ef2	Download5.4 GB	Parameters7b	QuantizationQ5_1	Context32K	Est. memory≈ 7.5 GB	`ollama run zephyr:7b-beta-q5_1`
7b-beta-q5_K_M	Typelocal	Inputstext	Digest482c06dc081a	Download5.1 GB	Parameters7b	QuantizationQ5_K_M	Context32K	Est. memory≈ 7 GB	`ollama run zephyr:7b-beta-q5_K_M`
7b-beta-q5_K_S	Typelocal	Inputstext	Digest65d372ba8784	Download5.0 GB	Parameters7b	QuantizationQ5_K_S	Context32K	Est. memory≈ 7 GB	`ollama run zephyr:7b-beta-q5_K_S`
7b-beta-q6_K	Typelocal	Inputstext	Digest705bedf05d2e	Download5.9 GB	Parameters7b	QuantizationQ6_K	Context32K	Est. memory≈ 8 GB	`ollama run zephyr:7b-beta-q6_K`
7b-beta-q8_0	Typelocal	Inputstext	Digestf684109a5a8d	Download7.7 GB	Parameters7b	QuantizationQ8_0	Context32K	Est. memory≈ 10 GB	`ollama run zephyr:7b-beta-q8_0`
latestdefault	Typelocal	Inputstext	Digestbbe38b81adec	Download4.1 GB	ParametersUnknown	QuantizationUnknown	Context32K	Est. memory≈ 6 GB	`ollama run zephyr:latest`

Related models

sqlcoderlocal

SQLCoder is a code completion model fined-tuned on StarCoder for SQL generation tasks

openchatlocal

A family of open-source models trained on a wide variety of data, surpassing ChatGPT on various benchmarks. Updated to version 3.5-0106.

openhermeslocal

OpenHermes 2.5 is a 7B model fine-tuned by Teknium on Mistral with fully open datasets.

neural-chatlocal

A fine-tuned model based on Mistral with good coverage of domain and language.