Quick start
ollama run llama3.3:latestRunnable variants
Memory is a rough file-size estimate; context length, runtime and GPU offload change it.
12 of 14 matching variants shown.14 of 14 variants shown.
| Tag | Type | Inputs | Digest | Download | Parameters | Quantization | Context | Est. memory | Run |
|---|---|---|---|---|---|---|---|---|---|
| 70b | Typelocal | Inputstext | Digesta6eb4748fd29 | Download43 GB | Parameters70b | QuantizationUnknown | Context128K | Est. memory≈ 49.5 GB | ollama run llama3.3:70b |
| 70b-instruct-fp16 | Typelocal | Inputstext | Digest8fbd361705a0 | Download141 GB | Parameters70b | QuantizationFP16 | Context128K | Est. memory≈ 159 GB | ollama run llama3.3:70b-instruct-fp16 |
| 70b-instruct-q2_K | Typelocal | Inputstext | Digesta6f03da15cbc | Download26 GB | Parameters70b | QuantizationQ2_K | Context128K | Est. memory≈ 30.5 GB | ollama run llama3.3:70b-instruct-q2_K |
| 70b-instruct-q3_K_M | Typelocal | Inputstext | Digest151348be3103 | Download34 GB | Parameters70b | QuantizationQ3_K_M | Context128K | Est. memory≈ 39 GB | ollama run llama3.3:70b-instruct-q3_K_M |
| 70b-instruct-q3_K_S | Typelocal | Inputstext | Digest84d6ecd40b42 | Download31 GB | Parameters70b | QuantizationQ3_K_S | Context128K | Est. memory≈ 36 GB | ollama run llama3.3:70b-instruct-q3_K_S |
| 70b-instruct-q4_0 | Typelocal | Inputstext | Digeste5afe30ba419 | Download40 GB | Parameters70b | QuantizationQ4_0 | Context128K | Est. memory≈ 46 GB | ollama run llama3.3:70b-instruct-q4_0 |
| 70b-instruct-q4_K_M | Typelocal | Inputstext | Digesta6eb4748fd29 | Download43 GB | Parameters70b | QuantizationQ4_K_M | Context128K | Est. memory≈ 49.5 GB | ollama run llama3.3:70b-instruct-q4_K_M |
| 70b-instruct-q4_K_S | Typelocal | Inputstext | Digest3d546a04bbd5 | Download40 GB | Parameters70b | QuantizationQ4_K_S | Context128K | Est. memory≈ 46 GB | ollama run llama3.3:70b-instruct-q4_K_S |
| 70b-instruct-q5_0 | Typelocal | Inputstext | Digest522f1b464c62 | Download49 GB | Parameters70b | QuantizationQ5_0 | Context128K | Est. memory≈ 56 GB | ollama run llama3.3:70b-instruct-q5_0 |
| 70b-instruct-q5_1 | Typelocal | Inputstext | Digest118a0cbe95b2 | Download53 GB | Parameters70b | QuantizationQ5_1 | Context128K | Est. memory≈ 60.5 GB | ollama run llama3.3:70b-instruct-q5_1 |
| 70b-instruct-q5_K_M | Typelocal | Inputstext | Digesta495e09a0513 | Download50 GB | Parameters70b | QuantizationQ5_K_M | Context128K | Est. memory≈ 57 GB | ollama run llama3.3:70b-instruct-q5_K_M |
| 70b-instruct-q6_K | Typelocal | Inputstext | Digest992c05c90cd8 | Download58 GB | Parameters70b | QuantizationQ6_K | Context128K | Est. memory≈ 66 GB | ollama run llama3.3:70b-instruct-q6_K |
| 70b-instruct-q8_0 | Typelocal | Inputstext | Digestd5b5e1b84868 | Download75 GB | Parameters70b | QuantizationQ8_0 | Context128K | Est. memory≈ 85 GB | ollama run llama3.3:70b-instruct-q8_0 |
| latestdefault | Typelocal | Inputstext | Digesta6eb4748fd29 | Download43 GB | ParametersUnknown | QuantizationUnknown | Context128K | Est. memory≈ 49.5 GB | ollama run llama3.3:latest |
Source-listed applications
Claude CodeHermes AgentOpenClawOpenCode
Related models
nemotronlocal
Llama-3.1-Nemotron-70B-Instruct is a large language model customized by NVIDIA to improve the helpfulness of LLM generated responses to user queries.
firefunction-v2local
An open weights function calling model based on Llama 3, competitive with GPT-4o function calling capabilities.
nemotron-3.5-boltlocal
Nemotron 3.5 Bolt is NVIDIA’s compact vision-language model for local coding, reasoning, and tool use.
nemotron3local
NVIDIA Nemotron 3 Nano Omni is a multimodal large language model that unifies video, audio, image, and text understanding to support enterprise-grade Q&A, summarization, transcription, and document intelligence workflows.