Quick start

ollama run starling-lm:latest

Runnable variants

Memory is a rough file-size estimate; context length, runtime and GPU offload change it.

12 of 36 matching variants shown.36 of 36 variants shown.

Tag	Type	Inputs	Digest	Download	Parameters	Quantization	Context	Est. memory	Run
7b	Typelocal	Inputstext	Digest39153f619be6	Download4.1 GB	Parameters7b	QuantizationUnknown	Context8K	Est. memory≈ 6 GB	`ollama run starling-lm:7b`
7b-alpha	Typelocal	Inputstext	Digest00dac9119e37	Download4.1 GB	Parameters7b	QuantizationUnknown	Context8K	Est. memory≈ 6 GB	`ollama run starling-lm:7b-alpha`
7b-alpha-fp16	Typelocal	Inputstext	Digest204bc1113dee	Download14 GB	Parameters7b	QuantizationFP16	Context8K	Est. memory≈ 17 GB	`ollama run starling-lm:7b-alpha-fp16`
7b-alpha-q2_K	Typelocal	Inputstext	Digest595732609943	Download2.7 GB	Parameters7b	QuantizationQ2_K	Context8K	Est. memory≈ 4.5 GB	`ollama run starling-lm:7b-alpha-q2_K`
7b-alpha-q3_K_L	Typelocal	Inputstext	Digeste1bcab03fa99	Download3.8 GB	Parameters7b	QuantizationQ3_K_L	Context8K	Est. memory≈ 5.5 GB	`ollama run starling-lm:7b-alpha-q3_K_L`
7b-alpha-q3_K_M	Typelocal	Inputstext	Digest882cfb6fd115	Download3.5 GB	Parameters7b	QuantizationQ3_K_M	Context8K	Est. memory≈ 5 GB	`ollama run starling-lm:7b-alpha-q3_K_M`
7b-alpha-q3_K_S	Typelocal	Inputstext	Digest5a49a238895b	Download3.2 GB	Parameters7b	QuantizationQ3_K_S	Context8K	Est. memory≈ 5 GB	`ollama run starling-lm:7b-alpha-q3_K_S`
7b-alpha-q4_0	Typelocal	Inputstext	Digest00dac9119e37	Download4.1 GB	Parameters7b	QuantizationQ4_0	Context8K	Est. memory≈ 6 GB	`ollama run starling-lm:7b-alpha-q4_0`
7b-alpha-q4_1	Typelocal	Inputstext	Digeste3dd9bd1826c	Download4.6 GB	Parameters7b	QuantizationQ4_1	Context8K	Est. memory≈ 6.5 GB	`ollama run starling-lm:7b-alpha-q4_1`
7b-alpha-q4_K_M	Typelocal	Inputstext	Digeste01b657ff775	Download4.4 GB	Parameters7b	QuantizationQ4_K_M	Context8K	Est. memory≈ 6 GB	`ollama run starling-lm:7b-alpha-q4_K_M`
7b-alpha-q4_K_S	Typelocal	Inputstext	Digestec9fd5179bf3	Download4.1 GB	Parameters7b	QuantizationQ4_K_S	Context8K	Est. memory≈ 6 GB	`ollama run starling-lm:7b-alpha-q4_K_S`
7b-alpha-q5_0	Typelocal	Inputstext	Digesta9a7563109f7	Download5.0 GB	Parameters7b	QuantizationQ5_0	Context8K	Est. memory≈ 7 GB	`ollama run starling-lm:7b-alpha-q5_0`
7b-alpha-q5_1	Typelocal	Inputstext	Digest0fbfb3a9529f	Download5.4 GB	Parameters7b	QuantizationQ5_1	Context8K	Est. memory≈ 7.5 GB	`ollama run starling-lm:7b-alpha-q5_1`
7b-alpha-q5_K_M	Typelocal	Inputstext	Digestdcfc2f49cbc2	Download5.1 GB	Parameters7b	QuantizationQ5_K_M	Context8K	Est. memory≈ 7 GB	`ollama run starling-lm:7b-alpha-q5_K_M`
7b-alpha-q5_K_S	Typelocal	Inputstext	Digest5d7a06cc4232	Download5.0 GB	Parameters7b	QuantizationQ5_K_S	Context8K	Est. memory≈ 7 GB	`ollama run starling-lm:7b-alpha-q5_K_S`
7b-alpha-q6_K	Typelocal	Inputstext	Digest6b9846745e8e	Download5.9 GB	Parameters7b	QuantizationQ6_K	Context8K	Est. memory≈ 8 GB	`ollama run starling-lm:7b-alpha-q6_K`
7b-alpha-q8_0	Typelocal	Inputstext	Digest8e54dc97552a	Download7.7 GB	Parameters7b	QuantizationQ8_0	Context8K	Est. memory≈ 10 GB	`ollama run starling-lm:7b-alpha-q8_0`
7b-beta	Typelocal	Inputstext	Digest39153f619be6	Download4.1 GB	Parameters7b	QuantizationUnknown	Context8K	Est. memory≈ 6 GB	`ollama run starling-lm:7b-beta`
7b-beta-fp16	Typelocal	Inputstext	Digestb7752a962ae0	Download14 GB	Parameters7b	QuantizationFP16	Context8K	Est. memory≈ 17 GB	`ollama run starling-lm:7b-beta-fp16`
7b-beta-q2_K	Typelocal	Inputstext	Digestb1e1d15c3eaa	Download2.7 GB	Parameters7b	QuantizationQ2_K	Context8K	Est. memory≈ 4.5 GB	`ollama run starling-lm:7b-beta-q2_K`
7b-beta-q3_K_L	Typelocal	Inputstext	Digest1326603dad7b	Download3.8 GB	Parameters7b	QuantizationQ3_K_L	Context8K	Est. memory≈ 5.5 GB	`ollama run starling-lm:7b-beta-q3_K_L`
7b-beta-q3_K_M	Typelocal	Inputstext	Digest50f34a8d0894	Download3.5 GB	Parameters7b	QuantizationQ3_K_M	Context8K	Est. memory≈ 5 GB	`ollama run starling-lm:7b-beta-q3_K_M`
7b-beta-q3_K_S	Typelocal	Inputstext	Digest294f42040461	Download3.2 GB	Parameters7b	QuantizationQ3_K_S	Context8K	Est. memory≈ 5 GB	`ollama run starling-lm:7b-beta-q3_K_S`
7b-beta-q4_0	Typelocal	Inputstext	Digest39153f619be6	Download4.1 GB	Parameters7b	QuantizationQ4_0	Context8K	Est. memory≈ 6 GB	`ollama run starling-lm:7b-beta-q4_0`
7b-beta-q4_1	Typelocal	Inputstext	Digest0cd6a20fa252	Download4.6 GB	Parameters7b	QuantizationQ4_1	Context8K	Est. memory≈ 6.5 GB	`ollama run starling-lm:7b-beta-q4_1`
7b-beta-q4_K_M	Typelocal	Inputstext	Digestf336e3b146fd	Download4.4 GB	Parameters7b	QuantizationQ4_K_M	Context8K	Est. memory≈ 6 GB	`ollama run starling-lm:7b-beta-q4_K_M`
7b-beta-q4_K_S	Typelocal	Inputstext	Digestfb6544e9b47a	Download4.1 GB	Parameters7b	QuantizationQ4_K_S	Context8K	Est. memory≈ 6 GB	`ollama run starling-lm:7b-beta-q4_K_S`
7b-beta-q5_0	Typelocal	Inputstext	Digestb75ae9df76d1	Download5.0 GB	Parameters7b	QuantizationQ5_0	Context8K	Est. memory≈ 7 GB	`ollama run starling-lm:7b-beta-q5_0`
7b-beta-q5_1	Typelocal	Inputstext	Digestb17e67a4be34	Download5.4 GB	Parameters7b	QuantizationQ5_1	Context8K	Est. memory≈ 7.5 GB	`ollama run starling-lm:7b-beta-q5_1`
7b-beta-q5_K_M	Typelocal	Inputstext	Digest7a5028faa785	Download5.1 GB	Parameters7b	QuantizationQ5_K_M	Context8K	Est. memory≈ 7 GB	`ollama run starling-lm:7b-beta-q5_K_M`
7b-beta-q5_K_S	Typelocal	Inputstext	Digesta206026bd73f	Download5.0 GB	Parameters7b	QuantizationQ5_K_S	Context8K	Est. memory≈ 7 GB	`ollama run starling-lm:7b-beta-q5_K_S`
7b-beta-q6_K	Typelocal	Inputstext	Digeste851dfecaaf5	Download5.9 GB	Parameters7b	QuantizationQ6_K	Context8K	Est. memory≈ 8 GB	`ollama run starling-lm:7b-beta-q6_K`
7b-beta-q8_0	Typelocal	Inputstext	Digest30281608b7f2	Download7.7 GB	Parameters7b	QuantizationQ8_0	Context8K	Est. memory≈ 10 GB	`ollama run starling-lm:7b-beta-q8_0`
alpha	Typelocal	Inputstext	Digest00dac9119e37	Download4.1 GB	ParametersUnknown	QuantizationUnknown	Context8K	Est. memory≈ 6 GB	`ollama run starling-lm:alpha`
beta	Typelocal	Inputstext	Digest39153f619be6	Download4.1 GB	ParametersUnknown	QuantizationUnknown	Context8K	Est. memory≈ 6 GB	`ollama run starling-lm:beta`
latestdefault	Typelocal	Inputstext	Digest39153f619be6	Download4.1 GB	ParametersUnknown	QuantizationUnknown	Context8K	Est. memory≈ 6 GB	`ollama run starling-lm:latest`

Related models

mistrallocal

The 7B model released by Mistral AI, updated to version 0.3.

dolphin-mistrallocal

The uncensored Dolphin model based on Mistral that excels at coding tasks. Updated to version 2.8.

wizardlm2local

State of the art large language model from Microsoft AI with improved performance on complex chat, multilingual, reasoning and agent use cases.

mathstrallocal

MathΣtral: a 7B model designed for math reasoning and scientific discovery by Mistral AI.