Quick start

ollama run codestral:latest

Runnable variants

Memory is a rough file-size estimate; context length, runtime and GPU offload change it.

12 of 17 matching variants shown.17 of 17 variants shown.

Tag	Type	Inputs	Digest	Download	Parameters	Quantization	Context	Est. memory	Run
22b	Typelocal	Inputstext	Digest0898a8b286d5	Download13 GB	Parameters22b	QuantizationUnknown	Context32K	Est. memory≈ 16 GB	`ollama run codestral:22b`
22b-v0.1-q2_K	Typelocal	Inputstext	Digest0e1127d332ef	Download8.3 GB	Parameters22b	QuantizationQ2_K	Context32K	Est. memory≈ 10.5 GB	`ollama run codestral:22b-v0.1-q2_K`
22b-v0.1-q3_K_L	Typelocal	Inputstext	Digest40e96062aff7	Download12 GB	Parameters22b	QuantizationQ3_K_L	Context32K	Est. memory≈ 14.5 GB	`ollama run codestral:22b-v0.1-q3_K_L`
22b-v0.1-q3_K_M	Typelocal	Inputstext	Digest71655d0feff7	Download11 GB	Parameters22b	QuantizationQ3_K_M	Context32K	Est. memory≈ 13.5 GB	`ollama run codestral:22b-v0.1-q3_K_M`
22b-v0.1-q3_K_S	Typelocal	Inputstext	Digest435a805994fa	Download9.6 GB	Parameters22b	QuantizationQ3_K_S	Context32K	Est. memory≈ 12 GB	`ollama run codestral:22b-v0.1-q3_K_S`
22b-v0.1-q4_0	Typelocal	Inputstext	Digest0898a8b286d5	Download13 GB	Parameters22b	QuantizationQ4_0	Context32K	Est. memory≈ 16 GB	`ollama run codestral:22b-v0.1-q4_0`
22b-v0.1-q4_1	Typelocal	Inputstext	Digest112589019335	Download14 GB	Parameters22b	QuantizationQ4_1	Context32K	Est. memory≈ 17 GB	`ollama run codestral:22b-v0.1-q4_1`
22b-v0.1-q4_K_M	Typelocal	Inputstext	Digest9a43e868fd2c	Download13 GB	Parameters22b	QuantizationQ4_K_M	Context32K	Est. memory≈ 16 GB	`ollama run codestral:22b-v0.1-q4_K_M`
22b-v0.1-q4_K_S	Typelocal	Inputstext	Digest98d819ea95ec	Download13 GB	Parameters22b	QuantizationQ4_K_S	Context32K	Est. memory≈ 16 GB	`ollama run codestral:22b-v0.1-q4_K_S`
22b-v0.1-q5_0	Typelocal	Inputstext	Digest05c0a78fd842	Download15 GB	Parameters22b	QuantizationQ5_0	Context32K	Est. memory≈ 18 GB	`ollama run codestral:22b-v0.1-q5_0`
22b-v0.1-q5_1	Typelocal	Inputstext	Digestc71bfe359bcc	Download17 GB	Parameters22b	QuantizationQ5_1	Context32K	Est. memory≈ 20 GB	`ollama run codestral:22b-v0.1-q5_1`
22b-v0.1-q5_K_M	Typelocal	Inputstext	Digest2df1ccc62c6a	Download16 GB	Parameters22b	QuantizationQ5_K_M	Context32K	Est. memory≈ 19 GB	`ollama run codestral:22b-v0.1-q5_K_M`
22b-v0.1-q5_K_S	Typelocal	Inputstext	Digest937f5c4a1a20	Download15 GB	Parameters22b	QuantizationQ5_K_S	Context32K	Est. memory≈ 18 GB	`ollama run codestral:22b-v0.1-q5_K_S`
22b-v0.1-q6_K	Typelocal	Inputstext	Digeste77ab7ec51f6	Download18 GB	Parameters22b	QuantizationQ6_K	Context32K	Est. memory≈ 21.5 GB	`ollama run codestral:22b-v0.1-q6_K`
22b-v0.1-q8_0	Typelocal	Inputstext	Digest8dde0029a91f	Download24 GB	Parameters22b	QuantizationQ8_0	Context32K	Est. memory≈ 28 GB	`ollama run codestral:22b-v0.1-q8_0`
latestdefault	Typelocal	Inputstext	Digest0898a8b286d5	Download13 GB	ParametersUnknown	QuantizationUnknown	Context32K	Est. memory≈ 16 GB	`ollama run codestral:latest`
v0.1	Typelocal	Inputstext	Digest0898a8b286d5	Download13 GB	ParametersUnknown	QuantizationUnknown	Context32K	Est. memory≈ 16 GB	`ollama run codestral:v0.1`

Related models

mistral-smalllocal

Mistral Small 3 sets a new benchmark in the “small” Large Language Models category below 70B.

solar-prolocal

Solar Pro Preview: an advanced large language model (LLM) with 22 billion parameters designed to fit into a single GPU

llama3.2-visionlocal

Llama 3.2 Vision is a collection of instruction-tuned image reasoning generative models in 11B and 90B sizes.

phi4local

Phi-4 is a 14B parameter, state-of-the-art open model from Microsoft.