Quick start

ollama run stablelm-zephyr:latest

Runnable variants

Memory is a rough file-size estimate; context length, runtime and GPU offload change it.

12 of 17 matching variants shown.17 of 17 variants shown.

Tag	Type	Inputs	Digest	Download	Parameters	Quantization	Context	Est. memory	Run
3b	Typelocal	Inputstext	Digest0a108dbd846e	Download1.6 GB	Parameters3b	QuantizationUnknown	Context4K	Est. memory≈ 3 GB	`ollama run stablelm-zephyr:3b`
3b-fp16	Typelocal	Inputstext	Digest2d27f99af6a5	Download5.6 GB	Parameters3b	QuantizationFP16	Context4K	Est. memory≈ 7.5 GB	`ollama run stablelm-zephyr:3b-fp16`
3b-q2_K	Typelocal	Inputstext	Digest5bac743c919f	Download1.2 GB	Parameters3b	QuantizationQ2_K	Context4K	Est. memory≈ 2.5 GB	`ollama run stablelm-zephyr:3b-q2_K`
3b-q3_K_L	Typelocal	Inputstext	Digeste1c8dc5c8d34	Download1.5 GB	Parameters3b	QuantizationQ3_K_L	Context4K	Est. memory≈ 3 GB	`ollama run stablelm-zephyr:3b-q3_K_L`
3b-q3_K_M	Typelocal	Inputstext	Digestc7711232e7f3	Download1.4 GB	Parameters3b	QuantizationQ3_K_M	Context4K	Est. memory≈ 3 GB	`ollama run stablelm-zephyr:3b-q3_K_M`
3b-q3_K_S	Typelocal	Inputstext	Digeste3701c5f77dc	Download1.3 GB	Parameters3b	QuantizationQ3_K_S	Context4K	Est. memory≈ 2.5 GB	`ollama run stablelm-zephyr:3b-q3_K_S`
3b-q4_0	Typelocal	Inputstext	Digest0a108dbd846e	Download1.6 GB	Parameters3b	QuantizationQ4_0	Context4K	Est. memory≈ 3 GB	`ollama run stablelm-zephyr:3b-q4_0`
3b-q4_1	Typelocal	Inputstext	Digestcd0ff50645c6	Download1.8 GB	Parameters3b	QuantizationQ4_1	Context4K	Est. memory≈ 3.5 GB	`ollama run stablelm-zephyr:3b-q4_1`
3b-q4_K_M	Typelocal	Inputstext	Digest309d69b91219	Download1.7 GB	Parameters3b	QuantizationQ4_K_M	Context4K	Est. memory≈ 3 GB	`ollama run stablelm-zephyr:3b-q4_K_M`
3b-q4_K_S	Typelocal	Inputstext	Digest582279ce4228	Download1.6 GB	Parameters3b	QuantizationQ4_K_S	Context4K	Est. memory≈ 3 GB	`ollama run stablelm-zephyr:3b-q4_K_S`
3b-q5_0	Typelocal	Inputstext	Digestedeb9aa03418	Download1.9 GB	Parameters3b	QuantizationQ5_0	Context4K	Est. memory≈ 3.5 GB	`ollama run stablelm-zephyr:3b-q5_0`
3b-q5_1	Typelocal	Inputstext	Digesteabd69d2ce14	Download2.1 GB	Parameters3b	QuantizationQ5_1	Context4K	Est. memory≈ 3.5 GB	`ollama run stablelm-zephyr:3b-q5_1`
3b-q5_K_M	Typelocal	Inputstext	Digestd8f94059df64	Download2.0 GB	Parameters3b	QuantizationQ5_K_M	Context4K	Est. memory≈ 3.5 GB	`ollama run stablelm-zephyr:3b-q5_K_M`
3b-q5_K_S	Typelocal	Inputstext	Digest71033947149d	Download1.9 GB	Parameters3b	QuantizationQ5_K_S	Context4K	Est. memory≈ 3.5 GB	`ollama run stablelm-zephyr:3b-q5_K_S`
3b-q6_K	Typelocal	Inputstext	Digest686dc198f785	Download2.3 GB	Parameters3b	QuantizationQ6_K	Context4K	Est. memory≈ 4 GB	`ollama run stablelm-zephyr:3b-q6_K`
3b-q8_0	Typelocal	Inputstext	Digest8e11ffa757f3	Download3.0 GB	Parameters3b	QuantizationQ8_0	Context4K	Est. memory≈ 4.5 GB	`ollama run stablelm-zephyr:3b-q8_0`
latestdefault	Typelocal	Inputstext	Digest0a108dbd846e	Download1.6 GB	ParametersUnknown	QuantizationUnknown	Context4K	Est. memory≈ 3 GB	`ollama run stablelm-zephyr:latest`

Related models

gemma2local

Google Gemma 2 is a high-performing and efficient model available in three sizes: 2B, 9B, and 27B.

gemmalocal

Gemma is a family of lightweight, state-of-the-art open models built by Google DeepMind. Updated to version 1.1

bge-m3local

BGE-M3 is a new model from BAAI distinguished for its versatility in Multi-Functionality, Multi-Linguality, and Multi-Granularity.

codegemmalocal

CodeGemma is a collection of powerful, lightweight models that can perform a variety of coding tasks like fill-in-the-middle code completion, code generation, natural language understanding, mathematical reasoning, and instruction following.