Quick start
ollama run reflection:latestRunnable variants
Memory is a rough file-size estimate; context length, runtime and GPU offload change it.
12 of 17 matching variants shown.17 of 17 variants shown.
| Tag | Type | Inputs | Digest | Download | Parameters | Quantization | Context | Est. memory | Run |
|---|---|---|---|---|---|---|---|---|---|
| 70b | Typelocal | Inputstext | Digest5084e77c1e10 | Download40 GB | Parameters70b | QuantizationUnknown | Context128K | Est. memory≈ 46 GB | ollama run reflection:70b |
| 70b-fp16 | Typelocal | Inputstext | Digeste04ae4d96458 | Download141 GB | Parameters70b | QuantizationFP16 | Context128K | Est. memory≈ 159 GB | ollama run reflection:70b-fp16 |
| 70b-q2_K | Typelocal | Inputstext | Digest8fe3c853372c | Download26 GB | Parameters70b | QuantizationQ2_K | Context128K | Est. memory≈ 30.5 GB | ollama run reflection:70b-q2_K |
| 70b-q3_K_L | Typelocal | Inputstext | Digest9c6705916e06 | Download37 GB | Parameters70b | QuantizationQ3_K_L | Context128K | Est. memory≈ 42.5 GB | ollama run reflection:70b-q3_K_L |
| 70b-q3_K_M | Typelocal | Inputstext | Digesta6b22bd90923 | Download34 GB | Parameters70b | QuantizationQ3_K_M | Context128K | Est. memory≈ 39 GB | ollama run reflection:70b-q3_K_M |
| 70b-q3_K_S | Typelocal | Inputstext | Digest21f651100031 | Download31 GB | Parameters70b | QuantizationQ3_K_S | Context128K | Est. memory≈ 36 GB | ollama run reflection:70b-q3_K_S |
| 70b-q4_0 | Typelocal | Inputstext | Digest5084e77c1e10 | Download40 GB | Parameters70b | QuantizationQ4_0 | Context128K | Est. memory≈ 46 GB | ollama run reflection:70b-q4_0 |
| 70b-q4_1 | Typelocal | Inputstext | Digestb72afde19a06 | Download44 GB | Parameters70b | QuantizationQ4_1 | Context128K | Est. memory≈ 50.5 GB | ollama run reflection:70b-q4_1 |
| 70b-q4_K_M | Typelocal | Inputstext | Digestbe39ad6154f4 | Download43 GB | Parameters70b | QuantizationQ4_K_M | Context128K | Est. memory≈ 49.5 GB | ollama run reflection:70b-q4_K_M |
| 70b-q4_K_S | Typelocal | Inputstext | Digest420791ca0c2a | Download40 GB | Parameters70b | QuantizationQ4_K_S | Context128K | Est. memory≈ 46 GB | ollama run reflection:70b-q4_K_S |
| 70b-q5_0 | Typelocal | Inputstext | Digest99e430b53c8b | Download49 GB | Parameters70b | QuantizationQ5_0 | Context128K | Est. memory≈ 56 GB | ollama run reflection:70b-q5_0 |
| 70b-q5_1 | Typelocal | Inputstext | Digest41bd1db0b708 | Download53 GB | Parameters70b | QuantizationQ5_1 | Context128K | Est. memory≈ 60.5 GB | ollama run reflection:70b-q5_1 |
| 70b-q5_K_M | Typelocal | Inputstext | Digestf537d644476a | Download50 GB | Parameters70b | QuantizationQ5_K_M | Context128K | Est. memory≈ 57 GB | ollama run reflection:70b-q5_K_M |
| 70b-q5_K_S | Typelocal | Inputstext | Digest84a4d89b332c | Download49 GB | Parameters70b | QuantizationQ5_K_S | Context128K | Est. memory≈ 56 GB | ollama run reflection:70b-q5_K_S |
| 70b-q6_K | Typelocal | Inputstext | Digest77fecce26024 | Download58 GB | Parameters70b | QuantizationQ6_K | Context128K | Est. memory≈ 66 GB | ollama run reflection:70b-q6_K |
| 70b-q8_0 | Typelocal | Inputstext | Digest159e9e593c44 | Download75 GB | Parameters70b | QuantizationQ8_0 | Context128K | Est. memory≈ 85 GB | ollama run reflection:70b-q8_0 |
| latestdefault | Typelocal | Inputstext | Digest5084e77c1e10 | Download40 GB | ParametersUnknown | QuantizationUnknown | Context128K | Est. memory≈ 46 GB | ollama run reflection:latest |
Related models
New state of the art 70B model. Llama 3.3 70B offers similar performance compared to the Llama 3.1 405B model.
Llama-3.1-Nemotron-70B-Instruct is a large language model customized by NVIDIA to improve the helpfulness of LLM generated responses to user queries.
An open weights function calling model based on Llama 3, competitive with GPT-4o function calling capabilities.
Nemotron 3.5 Bolt is NVIDIA’s compact vision-language model for local coding, reasoning, and tool use.