Quick start

ollama run mistral-nemo:latest

Runnable variants

Memory is a rough file-size estimate; context length, runtime and GPU offload change it.

12 of 17 matching variants shown.17 of 17 variants shown.

Tag	Type	Inputs	Digest	Download	Parameters	Quantization	Context	Est. memory	Run
12b	Typelocal	Inputstext	Digeste7e06d107c6c	Download7.1 GB	Parameters12b	QuantizationUnknown	Context1M	Est. memory≈ 9 GB	`ollama run mistral-nemo:12b`
12b-instruct-2407-fp16	Typelocal	Inputstext	Digest412dcb6ec5f9	Download25 GB	Parameters12b	QuantizationFP16	Context1M	Est. memory≈ 29 GB	`ollama run mistral-nemo:12b-instruct-2407-fp16`
12b-instruct-2407-q2_K	Typelocal	Inputstext	Digest868f6ba4dbda	Download4.8 GB	Parameters12b	QuantizationQ2_K	Context1M	Est. memory≈ 6.5 GB	`ollama run mistral-nemo:12b-instruct-2407-q2_K`
12b-instruct-2407-q3_K_L	Typelocal	Inputstext	Digest8dc575f2f1d9	Download6.6 GB	Parameters12b	QuantizationQ3_K_L	Context1M	Est. memory≈ 8.5 GB	`ollama run mistral-nemo:12b-instruct-2407-q3_K_L`
12b-instruct-2407-q3_K_M	Typelocal	Inputstext	Digest0549a17f596f	Download6.1 GB	Parameters12b	QuantizationQ3_K_M	Context1M	Est. memory≈ 8 GB	`ollama run mistral-nemo:12b-instruct-2407-q3_K_M`
12b-instruct-2407-q3_K_S	Typelocal	Inputstext	Digest5bba7a13afef	Download5.5 GB	Parameters12b	QuantizationQ3_K_S	Context1M	Est. memory≈ 7.5 GB	`ollama run mistral-nemo:12b-instruct-2407-q3_K_S`
12b-instruct-2407-q4_0	Typelocal	Inputstext	Digeste7e06d107c6c	Download7.1 GB	Parameters12b	QuantizationQ4_0	Context1M	Est. memory≈ 9 GB	`ollama run mistral-nemo:12b-instruct-2407-q4_0`
12b-instruct-2407-q4_1	Typelocal	Inputstext	Digest243f0861c69b	Download7.8 GB	Parameters12b	QuantizationQ4_1	Context1M	Est. memory≈ 10 GB	`ollama run mistral-nemo:12b-instruct-2407-q4_1`
12b-instruct-2407-q4_K_M	Typelocal	Inputstext	Digestdaf673741712	Download7.5 GB	Parameters12b	QuantizationQ4_K_M	Context1M	Est. memory≈ 9.5 GB	`ollama run mistral-nemo:12b-instruct-2407-q4_K_M`
12b-instruct-2407-q4_K_S	Typelocal	Inputstext	Digestfe6fcaf0d26f	Download7.1 GB	Parameters12b	QuantizationQ4_K_S	Context1M	Est. memory≈ 9 GB	`ollama run mistral-nemo:12b-instruct-2407-q4_K_S`
12b-instruct-2407-q5_0	Typelocal	Inputstext	Digestdab3cfa34f38	Download8.5 GB	Parameters12b	QuantizationQ5_0	Context1M	Est. memory≈ 10.5 GB	`ollama run mistral-nemo:12b-instruct-2407-q5_0`
12b-instruct-2407-q5_1	Typelocal	Inputstext	Digest8898d5e38428	Download9.2 GB	Parameters12b	QuantizationQ5_1	Context1M	Est. memory≈ 11.5 GB	`ollama run mistral-nemo:12b-instruct-2407-q5_1`
12b-instruct-2407-q5_K_M	Typelocal	Inputstext	Digestcf4d8cc50281	Download8.7 GB	Parameters12b	QuantizationQ5_K_M	Context1M	Est. memory≈ 11 GB	`ollama run mistral-nemo:12b-instruct-2407-q5_K_M`
12b-instruct-2407-q5_K_S	Typelocal	Inputstext	Digest40374746451f	Download8.5 GB	Parameters12b	QuantizationQ5_K_S	Context1M	Est. memory≈ 10.5 GB	`ollama run mistral-nemo:12b-instruct-2407-q5_K_S`
12b-instruct-2407-q6_K	Typelocal	Inputstext	Digestb6435edbd791	Download10 GB	Parameters12b	QuantizationQ6_K	Context1M	Est. memory≈ 12.5 GB	`ollama run mistral-nemo:12b-instruct-2407-q6_K`
12b-instruct-2407-q8_0	Typelocal	Inputstext	Digeste9b8ba00d2a1	Download13 GB	Parameters12b	QuantizationQ8_0	Context1M	Est. memory≈ 16 GB	`ollama run mistral-nemo:12b-instruct-2407-q8_0`
latestdefault	Typelocal	Inputstext	Digeste7e06d107c6c	Download7.1 GB	ParametersUnknown	QuantizationUnknown	Context1M	Est. memory≈ 9 GB	`ollama run mistral-nemo:latest`

Source-listed applications

Claude CodeHermes AgentOpenClawOpenCode

Related models

rnj-1local

Rnj-1 is a family of 8B parameter open-weight, dense models trained from scratch by Essential AI, optimized for code and STEM with capabilities on par with SOTA open-weight models.

command-r7blocal

The smallest model in Cohere's R series delivers top-tier speed, efficiency, and quality to build powerful AI applications on commodity GPUs and edge devices.

command-r7b-arabiclocal

A new state-of-the-art version of the lightweight Command R7B model that excels in advanced Arabic language capabilities for enterprises in the Middle East and Northern Africa.

olmo-3local

Olmo is a series of Open language models designed to enable the science of language models. These models are pre-trained on the Dolma 3 dataset and post-trained on the Dolci datasets.