Quick start
ollama run athene-v2:latestRunnable variants
Memory is a rough file-size estimate; context length, runtime and GPU offload change it.
12 of 17 matching variants shown.17 of 17 variants shown.
| Tag | Type | Inputs | Digest | Download | Parameters | Quantization | Context | Est. memory | Run |
|---|---|---|---|---|---|---|---|---|---|
| 72b | Typelocal | Inputstext | Digestd14346ed7d55 | Download47 GB | Parameters72b | QuantizationUnknown | Context32K | Est. memory≈ 54 GB | ollama run athene-v2:72b |
| 72b-fp16 | Typelocal | Inputstext | Digest1efa8264c375 | Download145 GB | Parameters72b | QuantizationFP16 | Context32K | Est. memory≈ 163.5 GB | ollama run athene-v2:72b-fp16 |
| 72b-q2_K | Typelocal | Inputstext | Digeste566d713f2ce | Download30 GB | Parameters72b | QuantizationQ2_K | Context32K | Est. memory≈ 35 GB | ollama run athene-v2:72b-q2_K |
| 72b-q3_K_L | Typelocal | Inputstext | Digestb05ead18ed8a | Download40 GB | Parameters72b | QuantizationQ3_K_L | Context32K | Est. memory≈ 46 GB | ollama run athene-v2:72b-q3_K_L |
| 72b-q3_K_M | Typelocal | Inputstext | Digestf74199e5b2ed | Download38 GB | Parameters72b | QuantizationQ3_K_M | Context32K | Est. memory≈ 43.5 GB | ollama run athene-v2:72b-q3_K_M |
| 72b-q3_K_S | Typelocal | Inputstext | Digestc213bdad39e6 | Download34 GB | Parameters72b | QuantizationQ3_K_S | Context32K | Est. memory≈ 39 GB | ollama run athene-v2:72b-q3_K_S |
| 72b-q4_0 | Typelocal | Inputstext | Digest5ce9f00e1aaa | Download41 GB | Parameters72b | QuantizationQ4_0 | Context32K | Est. memory≈ 47 GB | ollama run athene-v2:72b-q4_0 |
| 72b-q4_1 | Typelocal | Inputstext | Digest3e10d6a1cc6c | Download46 GB | Parameters72b | QuantizationQ4_1 | Context32K | Est. memory≈ 52.5 GB | ollama run athene-v2:72b-q4_1 |
| 72b-q4_K_M | Typelocal | Inputstext | Digestd14346ed7d55 | Download47 GB | Parameters72b | QuantizationQ4_K_M | Context32K | Est. memory≈ 54 GB | ollama run athene-v2:72b-q4_K_M |
| 72b-q4_K_S | Typelocal | Inputstext | Digest1bb9b315e5a1 | Download44 GB | Parameters72b | QuantizationQ4_K_S | Context32K | Est. memory≈ 50.5 GB | ollama run athene-v2:72b-q4_K_S |
| 72b-q5_0 | Typelocal | Inputstext | Digest2d45e35efb78 | Download50 GB | Parameters72b | QuantizationQ5_0 | Context32K | Est. memory≈ 57 GB | ollama run athene-v2:72b-q5_0 |
| 72b-q5_1 | Typelocal | Inputstext | Digest17eadb34276c | Download55 GB | Parameters72b | QuantizationQ5_1 | Context32K | Est. memory≈ 62.5 GB | ollama run athene-v2:72b-q5_1 |
| 72b-q5_K_M | Typelocal | Inputstext | Digestd82d1d08a629 | Download54 GB | Parameters72b | QuantizationQ5_K_M | Context32K | Est. memory≈ 61.5 GB | ollama run athene-v2:72b-q5_K_M |
| 72b-q5_K_S | Typelocal | Inputstext | Digestf3b97798cb4b | Download51 GB | Parameters72b | QuantizationQ5_K_S | Context32K | Est. memory≈ 58 GB | ollama run athene-v2:72b-q5_K_S |
| 72b-q6_K | Typelocal | Inputstext | Digest70b90bce364f | Download64 GB | Parameters72b | QuantizationQ6_K | Context32K | Est. memory≈ 73 GB | ollama run athene-v2:72b-q6_K |
| 72b-q8_0 | Typelocal | Inputstext | Digest4ce011a86fef | Download77 GB | Parameters72b | QuantizationQ8_0 | Context32K | Est. memory≈ 87.5 GB | ollama run athene-v2:72b-q8_0 |
| latestdefault | Typelocal | Inputstext | Digestd14346ed7d55 | Download47 GB | ParametersUnknown | QuantizationUnknown | Context32K | Est. memory≈ 54 GB | ollama run athene-v2:latest |
Source-listed applications
Related models
NVIDIA Nemotron 3 Nano Omni is a multimodal large language model that unifies video, audio, image, and text understanding to support enterprise-grade Q&A, summarization, transcription, and document intelligence workflows.
New state of the art 70B model. Llama 3.3 70B offers similar performance compared to the Llama 3.1 405B model.
Llama-3.1-Nemotron-70B-Instruct is a large language model customized by NVIDIA to improve the helpfulness of LLM generated responses to user queries.
An open weights function calling model based on Llama 3, competitive with GPT-4o function calling capabilities.