Quick start

ollama run nemotron-mini:latest

Runnable variants

Memory is a rough file-size estimate; context length, runtime and GPU offload change it.

12 of 17 matching variants shown.17 of 17 variants shown.

Tag	Type	Inputs	Digest	Download	Parameters	Quantization	Context	Est. memory	Run
4b	Typelocal	Inputstext	Digested76ab18784f	Download2.7 GB	Parameters4b	QuantizationUnknown	Context4K	Est. memory≈ 4.5 GB	`ollama run nemotron-mini:4b`
4b-instruct-fp16	Typelocal	Inputstext	Digestd0d806e9853c	Download8.4 GB	Parameters4b	QuantizationFP16	Context4K	Est. memory≈ 10.5 GB	`ollama run nemotron-mini:4b-instruct-fp16`
4b-instruct-q2_K	Typelocal	Inputstext	Digest71c1aed58cc4	Download1.9 GB	Parameters4b	QuantizationQ2_K	Context4K	Est. memory≈ 3.5 GB	`ollama run nemotron-mini:4b-instruct-q2_K`
4b-instruct-q3_K_L	Typelocal	Inputstext	Digest899020cd5b1e	Download2.5 GB	Parameters4b	QuantizationQ3_K_L	Context4K	Est. memory≈ 4 GB	`ollama run nemotron-mini:4b-instruct-q3_K_L`
4b-instruct-q3_K_M	Typelocal	Inputstext	Digest91b07164ba46	Download2.3 GB	Parameters4b	QuantizationQ3_K_M	Context4K	Est. memory≈ 4 GB	`ollama run nemotron-mini:4b-instruct-q3_K_M`
4b-instruct-q3_K_S	Typelocal	Inputstext	Digest28cabdeeb76e	Download2.1 GB	Parameters4b	QuantizationQ3_K_S	Context4K	Est. memory≈ 3.5 GB	`ollama run nemotron-mini:4b-instruct-q3_K_S`
4b-instruct-q4_0	Typelocal	Inputstext	Digest041bd339f71f	Download2.6 GB	Parameters4b	QuantizationQ4_0	Context4K	Est. memory≈ 4 GB	`ollama run nemotron-mini:4b-instruct-q4_0`
4b-instruct-q4_1	Typelocal	Inputstext	Digest715f0114b145	Download2.8 GB	Parameters4b	QuantizationQ4_1	Context4K	Est. memory≈ 4.5 GB	`ollama run nemotron-mini:4b-instruct-q4_1`
4b-instruct-q4_K_M	Typelocal	Inputstext	Digested76ab18784f	Download2.7 GB	Parameters4b	QuantizationQ4_K_M	Context4K	Est. memory≈ 4.5 GB	`ollama run nemotron-mini:4b-instruct-q4_K_M`
4b-instruct-q4_K_S	Typelocal	Inputstext	Digest59f3d2ea76f8	Download2.6 GB	Parameters4b	QuantizationQ4_K_S	Context4K	Est. memory≈ 4 GB	`ollama run nemotron-mini:4b-instruct-q4_K_S`
4b-instruct-q5_0	Typelocal	Inputstext	Digeste5f64c7116d1	Download3.0 GB	Parameters4b	QuantizationQ5_0	Context4K	Est. memory≈ 4.5 GB	`ollama run nemotron-mini:4b-instruct-q5_0`
4b-instruct-q5_1	Typelocal	Inputstext	Digest8c244be13dfe	Download3.2 GB	Parameters4b	QuantizationQ5_1	Context4K	Est. memory≈ 5 GB	`ollama run nemotron-mini:4b-instruct-q5_1`
4b-instruct-q5_K_M	Typelocal	Inputstext	Digest9e36e563dbdd	Download3.1 GB	Parameters4b	QuantizationQ5_K_M	Context4K	Est. memory≈ 4.5 GB	`ollama run nemotron-mini:4b-instruct-q5_K_M`
4b-instruct-q5_K_S	Typelocal	Inputstext	Digest072f4b7daa17	Download3.0 GB	Parameters4b	QuantizationQ5_K_S	Context4K	Est. memory≈ 4.5 GB	`ollama run nemotron-mini:4b-instruct-q5_K_S`
4b-instruct-q6_K	Typelocal	Inputstext	Digest4cf36901911e	Download3.4 GB	Parameters4b	QuantizationQ6_K	Context4K	Est. memory≈ 5 GB	`ollama run nemotron-mini:4b-instruct-q6_K`
4b-instruct-q8_0	Typelocal	Inputstext	Digestfe86a4d04f9f	Download4.5 GB	Parameters4b	QuantizationQ8_0	Context4K	Est. memory≈ 6.5 GB	`ollama run nemotron-mini:4b-instruct-q8_0`
latestdefault	Typelocal	Inputstext	Digested76ab18784f	Download2.7 GB	ParametersUnknown	QuantizationUnknown	Context4K	Est. memory≈ 4.5 GB	`ollama run nemotron-mini:latest`

Source-listed applications

Claude CodeHermes AgentOpenClawOpenCode

Related models

qwen3-vllocal

The most powerful vision-language model in the Qwen model family to date.

glm-ocrlocal

GLM-OCR is a multimodal OCR model for complex document understanding, built on the GLM-V encoder–decoder architecture.

cogitolocal

Cogito v1 Preview is a family of hybrid reasoning models by Deep Cogito that outperform the best available open models of the same size, including counterparts from LLaMA, DeepSeek, and Qwen across most standard benchmarks.

granite3.2-visionlocal

A compact and efficient vision-language model, specifically designed for visual document understanding, enabling automated content extraction from tables, charts, infographics, plots, diagrams, and more.