Quick start
ollama run nemotron:latestRunnable variants
Memory is a rough file-size estimate; context length, runtime and GPU offload change it.
12 of 17 matching variants shown.17 of 17 variants shown.
| Tag | Type | Inputs | Digest | Download | Parameters | Quantization | Context | Est. memory | Run |
|---|---|---|---|---|---|---|---|---|---|
| 70b | Typelocal | Inputstext | Digest2262f047a28a | Download43 GB | Parameters70b | QuantizationUnknown | Context128K | Est. memory≈ 49.5 GB | ollama run nemotron:70b |
| 70b-instruct-fp16 | Typelocal | Inputstext | Digeste02a46ff1109 | Download141 GB | Parameters70b | QuantizationFP16 | Context128K | Est. memory≈ 159 GB | ollama run nemotron:70b-instruct-fp16 |
| 70b-instruct-q2_K | Typelocal | Inputstext | Digestf4743c4c6e52 | Download26 GB | Parameters70b | QuantizationQ2_K | Context128K | Est. memory≈ 30.5 GB | ollama run nemotron:70b-instruct-q2_K |
| 70b-instruct-q3_K_L | Typelocal | Inputstext | Digesta6c94d07d7c9 | Download37 GB | Parameters70b | QuantizationQ3_K_L | Context128K | Est. memory≈ 42.5 GB | ollama run nemotron:70b-instruct-q3_K_L |
| 70b-instruct-q3_K_M | Typelocal | Inputstext | Digesta0a786c3dc39 | Download34 GB | Parameters70b | QuantizationQ3_K_M | Context128K | Est. memory≈ 39 GB | ollama run nemotron:70b-instruct-q3_K_M |
| 70b-instruct-q3_K_S | Typelocal | Inputstext | Digest49258a4a766a | Download31 GB | Parameters70b | QuantizationQ3_K_S | Context128K | Est. memory≈ 36 GB | ollama run nemotron:70b-instruct-q3_K_S |
| 70b-instruct-q4_0 | Typelocal | Inputstext | Digestaade1b26eba3 | Download40 GB | Parameters70b | QuantizationQ4_0 | Context128K | Est. memory≈ 46 GB | ollama run nemotron:70b-instruct-q4_0 |
| 70b-instruct-q4_1 | Typelocal | Inputstext | Digestc463f99d4c5e | Download44 GB | Parameters70b | QuantizationQ4_1 | Context128K | Est. memory≈ 50.5 GB | ollama run nemotron:70b-instruct-q4_1 |
| 70b-instruct-q4_K_M | Typelocal | Inputstext | Digest2262f047a28a | Download43 GB | Parameters70b | QuantizationQ4_K_M | Context128K | Est. memory≈ 49.5 GB | ollama run nemotron:70b-instruct-q4_K_M |
| 70b-instruct-q4_K_S | Typelocal | Inputstext | Digest0e32f30ad742 | Download40 GB | Parameters70b | QuantizationQ4_K_S | Context128K | Est. memory≈ 46 GB | ollama run nemotron:70b-instruct-q4_K_S |
| 70b-instruct-q5_0 | Typelocal | Inputstext | Digest4c83a56211a0 | Download49 GB | Parameters70b | QuantizationQ5_0 | Context128K | Est. memory≈ 56 GB | ollama run nemotron:70b-instruct-q5_0 |
| 70b-instruct-q5_1 | Typelocal | Inputstext | Digest32ce9fe7477b | Download53 GB | Parameters70b | QuantizationQ5_1 | Context128K | Est. memory≈ 60.5 GB | ollama run nemotron:70b-instruct-q5_1 |
| 70b-instruct-q5_K_M | Typelocal | Inputstext | Digestdef2cefbe818 | Download50 GB | Parameters70b | QuantizationQ5_K_M | Context128K | Est. memory≈ 57 GB | ollama run nemotron:70b-instruct-q5_K_M |
| 70b-instruct-q5_K_S | Typelocal | Inputstext | Digestc5dfebb28f5f | Download49 GB | Parameters70b | QuantizationQ5_K_S | Context128K | Est. memory≈ 56 GB | ollama run nemotron:70b-instruct-q5_K_S |
| 70b-instruct-q6_K | Typelocal | Inputstext | Digest8d12c48f836a | Download58 GB | Parameters70b | QuantizationQ6_K | Context128K | Est. memory≈ 66 GB | ollama run nemotron:70b-instruct-q6_K |
| 70b-instruct-q8_0 | Typelocal | Inputstext | Digest8865b9ab3285 | Download75 GB | Parameters70b | QuantizationQ8_0 | Context128K | Est. memory≈ 85 GB | ollama run nemotron:70b-instruct-q8_0 |
| latestdefault | Typelocal | Inputstext | Digest2262f047a28a | Download43 GB | ParametersUnknown | QuantizationUnknown | Context128K | Est. memory≈ 49.5 GB | ollama run nemotron:latest |
Source-listed applications
Claude CodeHermes AgentOpenClawOpenCode
Related models
llama3.3local
New state of the art 70B model. Llama 3.3 70B offers similar performance compared to the Llama 3.1 405B model.
firefunction-v2local
An open weights function calling model based on Llama 3, competitive with GPT-4o function calling capabilities.
nemotron-3.5-boltlocal
Nemotron 3.5 Bolt is NVIDIA’s compact vision-language model for local coding, reasoning, and tool use.
nemotron3local
NVIDIA Nemotron 3 Nano Omni is a multimodal large language model that unifies video, audio, image, and text understanding to support enterprise-grade Q&A, summarization, transcription, and document intelligence workflows.