Quick start

ollama run dolphin-mixtral:latest

Runnable variants

Memory is a rough file-size estimate; context length, runtime and GPU offload change it.

12 of 70 matching variants shown.70 of 70 variants shown.

Tag	Type	Inputs	Digest	Download	Parameters	Quantization	Context	Est. memory	Run
8x22b	Typelocal	Inputstext	Digest0772a1b884bf	Download80 GB	Parameters8x22b	QuantizationUnknown	Context64K	Est. memory≈ 90.5 GB	`ollama run dolphin-mixtral:8x22b`
8x22b-v2.9	Typelocal	Inputstext	Digest0772a1b884bf	Download80 GB	Parameters8x22b	QuantizationUnknown	Context64K	Est. memory≈ 90.5 GB	`ollama run dolphin-mixtral:8x22b-v2.9`
8x22b-v2.9-fp16	Typelocal	Inputstext	Digest39195710503e	Download281 GB	Parameters8x22b	QuantizationFP16	Context64K	Est. memory≈ 315.5 GB	`ollama run dolphin-mixtral:8x22b-v2.9-fp16`
8x22b-v2.9-q2_K	Typelocal	Inputstext	Digest5dd54f8ff492	Download52 GB	Parameters8x22b	QuantizationQ2_K	Context64K	Est. memory≈ 59.5 GB	`ollama run dolphin-mixtral:8x22b-v2.9-q2_K`
8x22b-v2.9-q3_K_L	Typelocal	Inputstext	Digest3c5371c23577	Download73 GB	Parameters8x22b	QuantizationQ3_K_L	Context64K	Est. memory≈ 83 GB	`ollama run dolphin-mixtral:8x22b-v2.9-q3_K_L`
8x22b-v2.9-q3_K_M	Typelocal	Inputstext	Digestef2b7524d28d	Download68 GB	Parameters8x22b	QuantizationQ3_K_M	Context64K	Est. memory≈ 77 GB	`ollama run dolphin-mixtral:8x22b-v2.9-q3_K_M`
8x22b-v2.9-q3_K_S	Typelocal	Inputstext	Digestcad2f9d2e01d	Download61 GB	Parameters8x22b	QuantizationQ3_K_S	Context64K	Est. memory≈ 69.5 GB	`ollama run dolphin-mixtral:8x22b-v2.9-q3_K_S`
8x22b-v2.9-q4_0	Typelocal	Inputstext	Digest0772a1b884bf	Download80 GB	Parameters8x22b	QuantizationQ4_0	Context64K	Est. memory≈ 90.5 GB	`ollama run dolphin-mixtral:8x22b-v2.9-q4_0`
8x22b-v2.9-q4_1	Typelocal	Inputstext	Digest3e58e962deb8	Download88 GB	Parameters8x22b	QuantizationQ4_1	Context64K	Est. memory≈ 99.5 GB	`ollama run dolphin-mixtral:8x22b-v2.9-q4_1`
8x22b-v2.9-q4_K_M	Typelocal	Inputstext	Digest1ba3655b0de7	Download86 GB	Parameters8x22b	QuantizationQ4_K_M	Context64K	Est. memory≈ 97.5 GB	`ollama run dolphin-mixtral:8x22b-v2.9-q4_K_M`
8x22b-v2.9-q4_K_S	Typelocal	Inputstext	Digestf7c583f24605	Download80 GB	Parameters8x22b	QuantizationQ4_K_S	Context64K	Est. memory≈ 90.5 GB	`ollama run dolphin-mixtral:8x22b-v2.9-q4_K_S`
8x22b-v2.9-q5_0	Typelocal	Inputstext	Digestabfd3a87f905	Download97 GB	Parameters8x22b	QuantizationQ5_0	Context64K	Est. memory≈ 109.5 GB	`ollama run dolphin-mixtral:8x22b-v2.9-q5_0`
8x22b-v2.9-q5_1	Typelocal	Inputstext	Digesta3561f68b65d	Download106 GB	Parameters8x22b	QuantizationQ5_1	Context64K	Est. memory≈ 119.5 GB	`ollama run dolphin-mixtral:8x22b-v2.9-q5_1`
8x22b-v2.9-q5_K_M	Typelocal	Inputstext	Digestd4e513dcc2e6	Download100 GB	Parameters8x22b	QuantizationQ5_K_M	Context64K	Est. memory≈ 113 GB	`ollama run dolphin-mixtral:8x22b-v2.9-q5_K_M`
8x22b-v2.9-q5_K_S	Typelocal	Inputstext	Digesta1cd7a6d8a79	Download97 GB	Parameters8x22b	QuantizationQ5_K_S	Context64K	Est. memory≈ 109.5 GB	`ollama run dolphin-mixtral:8x22b-v2.9-q5_K_S`
8x22b-v2.9-q6_K	Typelocal	Inputstext	Digestf5aac890745a	Download116 GB	Parameters8x22b	QuantizationQ6_K	Context64K	Est. memory≈ 131 GB	`ollama run dolphin-mixtral:8x22b-v2.9-q6_K`
8x22b-v2.9-q8_0	Typelocal	Inputstext	Digestb82986a3ed4f	Download149 GB	Parameters8x22b	QuantizationQ8_0	Context64K	Est. memory≈ 168 GB	`ollama run dolphin-mixtral:8x22b-v2.9-q8_0`
8x7b	Typelocal	Inputstext	Digest4f76c28c0414	Download26 GB	Parameters8x7b	QuantizationUnknown	Context32K	Est. memory≈ 30.5 GB	`ollama run dolphin-mixtral:8x7b`
8x7b-v2.5	Typelocal	Inputstext	Digestf924f2f0e484	Download26 GB	Parameters8x7b	QuantizationUnknown	Context32K	Est. memory≈ 30.5 GB	`ollama run dolphin-mixtral:8x7b-v2.5`
8x7b-v2.5-fp16	Typelocal	Inputstext	Digestd1f36c28485e	Download93 GB	Parameters8x7b	QuantizationFP16	Context32K	Est. memory≈ 105 GB	`ollama run dolphin-mixtral:8x7b-v2.5-fp16`
8x7b-v2.5-q2_K	Typelocal	Inputstext	Digest448b185c2a3e	Download17 GB	Parameters8x7b	QuantizationQ2_K	Context32K	Est. memory≈ 20 GB	`ollama run dolphin-mixtral:8x7b-v2.5-q2_K`
8x7b-v2.5-q3_K_L	Typelocal	Inputstext	Digeste6278d65e9dc	Download24 GB	Parameters8x7b	QuantizationQ3_K_L	Context32K	Est. memory≈ 28 GB	`ollama run dolphin-mixtral:8x7b-v2.5-q3_K_L`
8x7b-v2.5-q3_K_M	Typelocal	Inputstext	Digesta04451f03648	Download23 GB	Parameters8x7b	QuantizationQ3_K_M	Context32K	Est. memory≈ 27 GB	`ollama run dolphin-mixtral:8x7b-v2.5-q3_K_M`
8x7b-v2.5-q3_K_S	Typelocal	Inputstext	Digestea9ed37491b3	Download20 GB	Parameters8x7b	QuantizationQ3_K_S	Context32K	Est. memory≈ 23.5 GB	`ollama run dolphin-mixtral:8x7b-v2.5-q3_K_S`
8x7b-v2.5-q4_0	Typelocal	Inputstext	Digestf924f2f0e484	Download26 GB	Parameters8x7b	QuantizationQ4_0	Context32K	Est. memory≈ 30.5 GB	`ollama run dolphin-mixtral:8x7b-v2.5-q4_0`
8x7b-v2.5-q4_1	Typelocal	Inputstext	Digest11dee8e97379	Download29 GB	Parameters8x7b	QuantizationQ4_1	Context32K	Est. memory≈ 33.5 GB	`ollama run dolphin-mixtral:8x7b-v2.5-q4_1`
8x7b-v2.5-q4_K_M	Typelocal	Inputstext	Digest66adba445821	Download28 GB	Parameters8x7b	QuantizationQ4_K_M	Context32K	Est. memory≈ 32.5 GB	`ollama run dolphin-mixtral:8x7b-v2.5-q4_K_M`
8x7b-v2.5-q4_K_S	Typelocal	Inputstext	Digest6534902e1e54	Download27 GB	Parameters8x7b	QuantizationQ4_K_S	Context32K	Est. memory≈ 31.5 GB	`ollama run dolphin-mixtral:8x7b-v2.5-q4_K_S`
8x7b-v2.5-q5_0	Typelocal	Inputstext	Digest8a9fd615b610	Download32 GB	Parameters8x7b	QuantizationQ5_0	Context32K	Est. memory≈ 37 GB	`ollama run dolphin-mixtral:8x7b-v2.5-q5_0`
8x7b-v2.5-q5_1	Typelocal	Inputstext	Digest36450117b011	Download35 GB	Parameters8x7b	QuantizationQ5_1	Context32K	Est. memory≈ 40.5 GB	`ollama run dolphin-mixtral:8x7b-v2.5-q5_1`
8x7b-v2.5-q5_K_M	Typelocal	Inputstext	Digest5389198274fa	Download33 GB	Parameters8x7b	QuantizationQ5_K_M	Context32K	Est. memory≈ 38 GB	`ollama run dolphin-mixtral:8x7b-v2.5-q5_K_M`
8x7b-v2.5-q5_K_S	Typelocal	Inputstext	Digest8e662aef3892	Download32 GB	Parameters8x7b	QuantizationQ5_K_S	Context32K	Est. memory≈ 37 GB	`ollama run dolphin-mixtral:8x7b-v2.5-q5_K_S`
8x7b-v2.5-q6_K	Typelocal	Inputstext	Digest7ef1f6ce2be5	Download38 GB	Parameters8x7b	QuantizationQ6_K	Context32K	Est. memory≈ 43.5 GB	`ollama run dolphin-mixtral:8x7b-v2.5-q6_K`
8x7b-v2.5-q8_0	Typelocal	Inputstext	Digest2dbedb652781	Download50 GB	Parameters8x7b	QuantizationQ8_0	Context32K	Est. memory≈ 57 GB	`ollama run dolphin-mixtral:8x7b-v2.5-q8_0`
8x7b-v2.6	Typelocal	Inputstext	Digestccc9d1f5d17c	Download26 GB	Parameters8x7b	QuantizationUnknown	Context32K	Est. memory≈ 30.5 GB	`ollama run dolphin-mixtral:8x7b-v2.6`
8x7b-v2.6-fp16	Typelocal	Inputstext	Digest0e865bb9631d	Download93 GB	Parameters8x7b	QuantizationFP16	Context32K	Est. memory≈ 105 GB	`ollama run dolphin-mixtral:8x7b-v2.6-fp16`
8x7b-v2.6-q2_K	Typelocal	Inputstext	Digest2f562aa89564	Download17 GB	Parameters8x7b	QuantizationQ2_K	Context32K	Est. memory≈ 20 GB	`ollama run dolphin-mixtral:8x7b-v2.6-q2_K`
8x7b-v2.6-q3_K_L	Typelocal	Inputstext	Digest87f7ec7f238f	Download24 GB	Parameters8x7b	QuantizationQ3_K_L	Context32K	Est. memory≈ 28 GB	`ollama run dolphin-mixtral:8x7b-v2.6-q3_K_L`
8x7b-v2.6-q3_K_M	Typelocal	Inputstext	Digest3a283d1a237d	Download23 GB	Parameters8x7b	QuantizationQ3_K_M	Context32K	Est. memory≈ 27 GB	`ollama run dolphin-mixtral:8x7b-v2.6-q3_K_M`
8x7b-v2.6-q3_K_S	Typelocal	Inputstext	Digestab8763452984	Download20 GB	Parameters8x7b	QuantizationQ3_K_S	Context32K	Est. memory≈ 23.5 GB	`ollama run dolphin-mixtral:8x7b-v2.6-q3_K_S`
8x7b-v2.6-q4_0	Typelocal	Inputstext	Digestccc9d1f5d17c	Download26 GB	Parameters8x7b	QuantizationQ4_0	Context32K	Est. memory≈ 30.5 GB	`ollama run dolphin-mixtral:8x7b-v2.6-q4_0`
8x7b-v2.6-q4_1	Typelocal	Inputstext	Digest9f3b6fc34751	Download29 GB	Parameters8x7b	QuantizationQ4_1	Context32K	Est. memory≈ 33.5 GB	`ollama run dolphin-mixtral:8x7b-v2.6-q4_1`
8x7b-v2.6-q4_K_M	Typelocal	Inputstext	Digest725fbbf8d5e0	Download28 GB	Parameters8x7b	QuantizationQ4_K_M	Context32K	Est. memory≈ 32.5 GB	`ollama run dolphin-mixtral:8x7b-v2.6-q4_K_M`
8x7b-v2.6-q4_K_S	Typelocal	Inputstext	Digestf3dd3e93270a	Download27 GB	Parameters8x7b	QuantizationQ4_K_S	Context32K	Est. memory≈ 31.5 GB	`ollama run dolphin-mixtral:8x7b-v2.6-q4_K_S`
8x7b-v2.6-q5_0	Typelocal	Inputstext	Digestab28fea4d551	Download32 GB	Parameters8x7b	QuantizationQ5_0	Context32K	Est. memory≈ 37 GB	`ollama run dolphin-mixtral:8x7b-v2.6-q5_0`
8x7b-v2.6-q5_1	Typelocal	Inputstext	Digest0d332b78ce70	Download35 GB	Parameters8x7b	QuantizationQ5_1	Context32K	Est. memory≈ 40.5 GB	`ollama run dolphin-mixtral:8x7b-v2.6-q5_1`
8x7b-v2.6-q5_K_M	Typelocal	Inputstext	Digest616dad4c275d	Download33 GB	Parameters8x7b	QuantizationQ5_K_M	Context32K	Est. memory≈ 38 GB	`ollama run dolphin-mixtral:8x7b-v2.6-q5_K_M`
8x7b-v2.6-q5_K_S	Typelocal	Inputstext	Digest15ecf506c50c	Download32 GB	Parameters8x7b	QuantizationQ5_K_S	Context32K	Est. memory≈ 37 GB	`ollama run dolphin-mixtral:8x7b-v2.6-q5_K_S`
8x7b-v2.6-q6_K	Typelocal	Inputstext	Digesta14b88f77235	Download38 GB	Parameters8x7b	QuantizationQ6_K	Context32K	Est. memory≈ 43.5 GB	`ollama run dolphin-mixtral:8x7b-v2.6-q6_K`
8x7b-v2.6-q8_0	Typelocal	Inputstext	Digest2812998a47df	Download50 GB	Parameters8x7b	QuantizationQ8_0	Context32K	Est. memory≈ 57 GB	`ollama run dolphin-mixtral:8x7b-v2.6-q8_0`
8x7b-v2.7	Typelocal	Inputstext	Digest4f76c28c0414	Download26 GB	Parameters8x7b	QuantizationUnknown	Context32K	Est. memory≈ 30.5 GB	`ollama run dolphin-mixtral:8x7b-v2.7`
8x7b-v2.7-fp16	Typelocal	Inputstext	Digest4ac207dbc68b	Download93 GB	Parameters8x7b	QuantizationFP16	Context32K	Est. memory≈ 105 GB	`ollama run dolphin-mixtral:8x7b-v2.7-fp16`
8x7b-v2.7-q2_K	Typelocal	Inputstext	Digest67959cb58058	Download17 GB	Parameters8x7b	QuantizationQ2_K	Context32K	Est. memory≈ 20 GB	`ollama run dolphin-mixtral:8x7b-v2.7-q2_K`
8x7b-v2.7-q3_K_L	Typelocal	Inputstext	Digest8b94203d838d	Download24 GB	Parameters8x7b	QuantizationQ3_K_L	Context32K	Est. memory≈ 28 GB	`ollama run dolphin-mixtral:8x7b-v2.7-q3_K_L`
8x7b-v2.7-q3_K_M	Typelocal	Inputstext	Digestc7bb43548a49	Download23 GB	Parameters8x7b	QuantizationQ3_K_M	Context32K	Est. memory≈ 27 GB	`ollama run dolphin-mixtral:8x7b-v2.7-q3_K_M`
8x7b-v2.7-q3_K_S	Typelocal	Inputstext	Digest102b0d4f9403	Download20 GB	Parameters8x7b	QuantizationQ3_K_S	Context32K	Est. memory≈ 23.5 GB	`ollama run dolphin-mixtral:8x7b-v2.7-q3_K_S`
8x7b-v2.7-q4_0	Typelocal	Inputstext	Digest4f76c28c0414	Download26 GB	Parameters8x7b	QuantizationQ4_0	Context32K	Est. memory≈ 30.5 GB	`ollama run dolphin-mixtral:8x7b-v2.7-q4_0`
8x7b-v2.7-q4_1	Typelocal	Inputstext	Digestd0c44def2b5e	Download29 GB	Parameters8x7b	QuantizationQ4_1	Context32K	Est. memory≈ 33.5 GB	`ollama run dolphin-mixtral:8x7b-v2.7-q4_1`
8x7b-v2.7-q4_K_M	Typelocal	Inputstext	Digest9edda92db764	Download28 GB	Parameters8x7b	QuantizationQ4_K_M	Context32K	Est. memory≈ 32.5 GB	`ollama run dolphin-mixtral:8x7b-v2.7-q4_K_M`
8x7b-v2.7-q4_K_S	Typelocal	Inputstext	Digest61d2d0129a1b	Download27 GB	Parameters8x7b	QuantizationQ4_K_S	Context32K	Est. memory≈ 31.5 GB	`ollama run dolphin-mixtral:8x7b-v2.7-q4_K_S`
8x7b-v2.7-q5_0	Typelocal	Inputstext	Digestc9b1ccc63176	Download32 GB	Parameters8x7b	QuantizationQ5_0	Context32K	Est. memory≈ 37 GB	`ollama run dolphin-mixtral:8x7b-v2.7-q5_0`
8x7b-v2.7-q5_1	Typelocal	Inputstext	Digest0e06aa33814f	Download35 GB	Parameters8x7b	QuantizationQ5_1	Context32K	Est. memory≈ 40.5 GB	`ollama run dolphin-mixtral:8x7b-v2.7-q5_1`
8x7b-v2.7-q5_K_M	Typelocal	Inputstext	Digest48c8a1692c8d	Download33 GB	Parameters8x7b	QuantizationQ5_K_M	Context32K	Est. memory≈ 38 GB	`ollama run dolphin-mixtral:8x7b-v2.7-q5_K_M`
8x7b-v2.7-q5_K_S	Typelocal	Inputstext	Digest6b10b15cfd86	Download32 GB	Parameters8x7b	QuantizationQ5_K_S	Context32K	Est. memory≈ 37 GB	`ollama run dolphin-mixtral:8x7b-v2.7-q5_K_S`
8x7b-v2.7-q6_K	Typelocal	Inputstext	Digest1673eadc5474	Download38 GB	Parameters8x7b	QuantizationQ6_K	Context32K	Est. memory≈ 43.5 GB	`ollama run dolphin-mixtral:8x7b-v2.7-q6_K`
8x7b-v2.7-q8_0	Typelocal	Inputstext	Digest1e3dbaccc823	Download50 GB	Parameters8x7b	QuantizationQ8_0	Context32K	Est. memory≈ 57 GB	`ollama run dolphin-mixtral:8x7b-v2.7-q8_0`
latestdefault	Typelocal	Inputstext	Digest4f76c28c0414	Download26 GB	ParametersUnknown	QuantizationUnknown	Context32K	Est. memory≈ 30.5 GB	`ollama run dolphin-mixtral:latest`
v2.5	Typelocal	Inputstext	Digestf924f2f0e484	Download26 GB	ParametersUnknown	QuantizationUnknown	Context32K	Est. memory≈ 30.5 GB	`ollama run dolphin-mixtral:v2.5`
v2.6	Typelocal	Inputstext	Digestccc9d1f5d17c	Download26 GB	ParametersUnknown	QuantizationUnknown	Context32K	Est. memory≈ 30.5 GB	`ollama run dolphin-mixtral:v2.6`
v2.7	Typelocal	Inputstext	Digest4f76c28c0414	Download26 GB	ParametersUnknown	QuantizationUnknown	Context32K	Est. memory≈ 30.5 GB	`ollama run dolphin-mixtral:v2.7`

Related models

qwen3.6local

Qwen3.6 delivers substantial upgrades in agentic coding and thinking preservation than previous Qwen models.

mixtrallocal

A set of Mixture of Experts (MoE) model with open weights by Mistral AI in 8x7b and 8x22b parameter sizes.

nous-hermes2-mixtrallocal

The Nous Hermes 2 model from Nous Research, now trained over Mixtral.

muse-glimmerlocal

Meta's latest open model built for always-on local agents. 30B parameters, licensed under Apache 2.0 and runs on a single GPU — tuned for tool use, long tasks, and failure recovery.