Skip to main content
Ollama ExplorerBeta
localtools

mixtral

A set of Mixture of Experts (MoE) model with open weights by Mistral AI in 8x7b and 8x22b parameter sizes.

2.9M pulls70 tagsSource updated Dec 20, 202464K max context

Quick start

ollama run mixtral:latest

Runnable variants

Memory is a rough file-size estimate; context length, runtime and GPU offload change it.

12 of 70 matching variants shown.

8x22bTypelocalInputstextDigeste8479ee1cb51Download80 GBParameters8x22bQuantizationUnknownContext64KEst. memory≈ 90.5 GB
ollama run mixtral:8x22b
8x22b-instructTypelocalInputstextDigeste8479ee1cb51Download80 GBParameters8x22bQuantizationUnknownContext64KEst. memory≈ 90.5 GB
ollama run mixtral:8x22b-instruct
8x22b-instruct-v0.1-fp16TypelocalInputstextDigestbe69186cc79bDownload281 GBParameters8x22bQuantizationFP16Context64KEst. memory≈ 315.5 GB
ollama run mixtral:8x22b-instruct-v0.1-fp16
8x22b-instruct-v0.1-q2_KTypelocalInputstextDigestcf96f64cdf60Download52 GBParameters8x22bQuantizationQ2_KContext64KEst. memory≈ 59.5 GB
ollama run mixtral:8x22b-instruct-v0.1-q2_K
8x22b-instruct-v0.1-q3_K_LTypelocalInputstextDigest85c9d74f72e2Download73 GBParameters8x22bQuantizationQ3_K_LContext64KEst. memory≈ 83 GB
ollama run mixtral:8x22b-instruct-v0.1-q3_K_L
8x22b-instruct-v0.1-q3_K_MTypelocalInputstextDigestd552821493b8Download68 GBParameters8x22bQuantizationQ3_K_MContext64KEst. memory≈ 77 GB
ollama run mixtral:8x22b-instruct-v0.1-q3_K_M
8x22b-instruct-v0.1-q3_K_STypelocalInputstextDigest50ec4fbf79f2Download62 GBParameters8x22bQuantizationQ3_K_SContext64KEst. memory≈ 70.5 GB
ollama run mixtral:8x22b-instruct-v0.1-q3_K_S
8x22b-instruct-v0.1-q4_0TypelocalInputstextDigeste8479ee1cb51Download80 GBParameters8x22bQuantizationQ4_0Context64KEst. memory≈ 90.5 GB
ollama run mixtral:8x22b-instruct-v0.1-q4_0
8x22b-instruct-v0.1-q4_1TypelocalInputstextDigest0ea2df035a44Download88 GBParameters8x22bQuantizationQ4_1Context64KEst. memory≈ 99.5 GB
ollama run mixtral:8x22b-instruct-v0.1-q4_1
8x22b-instruct-v0.1-q4_K_MTypelocalInputstextDigestde58127cf267Download86 GBParameters8x22bQuantizationQ4_K_MContext64KEst. memory≈ 97.5 GB
ollama run mixtral:8x22b-instruct-v0.1-q4_K_M
8x22b-instruct-v0.1-q4_K_STypelocalInputstextDigesta9be4647cd05Download80 GBParameters8x22bQuantizationQ4_K_SContext64KEst. memory≈ 90.5 GB
ollama run mixtral:8x22b-instruct-v0.1-q4_K_S
8x22b-instruct-v0.1-q5_0TypelocalInputstextDigestc4d73325754cDownload97 GBParameters8x22bQuantizationQ5_0Context64KEst. memory≈ 109.5 GB
ollama run mixtral:8x22b-instruct-v0.1-q5_0

Source-listed applications

Claude CodeHermes AgentOpenClawOpenCode

Related models