Quick start
ollama run llama3-groq-tool-use:latestRunnable variants
Memory is a rough file-size estimate; context length, runtime and GPU offload change it.
12 of 33 matching variants shown.33 of 33 variants shown.
| Tag | Type | Inputs | Digest | Download | Parameters | Quantization | Context | Est. memory | Run |
|---|---|---|---|---|---|---|---|---|---|
| 70b | Typelocal | Inputstext | Digest696d50e6fc55 | Download40 GB | Parameters70b | QuantizationUnknown | Context8K | Est. memory≈ 46 GB | ollama run llama3-groq-tool-use:70b |
| 70b-fp16 | Typelocal | Inputstext | Digest8ef2a1906612 | Download141 GB | Parameters70b | QuantizationFP16 | Context8K | Est. memory≈ 159 GB | ollama run llama3-groq-tool-use:70b-fp16 |
| 70b-q2_K | Typelocal | Inputstext | Digestdab8a158f092 | Download26 GB | Parameters70b | QuantizationQ2_K | Context8K | Est. memory≈ 30.5 GB | ollama run llama3-groq-tool-use:70b-q2_K |
| 70b-q3_K_L | Typelocal | Inputstext | Digest94b979ce931c | Download37 GB | Parameters70b | QuantizationQ3_K_L | Context8K | Est. memory≈ 42.5 GB | ollama run llama3-groq-tool-use:70b-q3_K_L |
| 70b-q3_K_M | Typelocal | Inputstext | Digest5e0c9286cabe | Download34 GB | Parameters70b | QuantizationQ3_K_M | Context8K | Est. memory≈ 39 GB | ollama run llama3-groq-tool-use:70b-q3_K_M |
| 70b-q3_K_S | Typelocal | Inputstext | Digest4f446f9b1b86 | Download31 GB | Parameters70b | QuantizationQ3_K_S | Context8K | Est. memory≈ 36 GB | ollama run llama3-groq-tool-use:70b-q3_K_S |
| 70b-q4_0 | Typelocal | Inputstext | Digest696d50e6fc55 | Download40 GB | Parameters70b | QuantizationQ4_0 | Context8K | Est. memory≈ 46 GB | ollama run llama3-groq-tool-use:70b-q4_0 |
| 70b-q4_1 | Typelocal | Inputstext | Digest35972e96c25d | Download44 GB | Parameters70b | QuantizationQ4_1 | Context8K | Est. memory≈ 50.5 GB | ollama run llama3-groq-tool-use:70b-q4_1 |
| 70b-q4_K_M | Typelocal | Inputstext | Digest45eafa1bfbd8 | Download43 GB | Parameters70b | QuantizationQ4_K_M | Context8K | Est. memory≈ 49.5 GB | ollama run llama3-groq-tool-use:70b-q4_K_M |
| 70b-q4_K_S | Typelocal | Inputstext | Digest464bc22f0c7f | Download40 GB | Parameters70b | QuantizationQ4_K_S | Context8K | Est. memory≈ 46 GB | ollama run llama3-groq-tool-use:70b-q4_K_S |
| 70b-q5_0 | Typelocal | Inputstext | Digest5c52fd8e4ba7 | Download49 GB | Parameters70b | QuantizationQ5_0 | Context8K | Est. memory≈ 56 GB | ollama run llama3-groq-tool-use:70b-q5_0 |
| 70b-q5_1 | Typelocal | Inputstext | Digest337622a2615e | Download53 GB | Parameters70b | QuantizationQ5_1 | Context8K | Est. memory≈ 60.5 GB | ollama run llama3-groq-tool-use:70b-q5_1 |
| 70b-q5_K_M | Typelocal | Inputstext | Digest7e1f34171905 | Download50 GB | Parameters70b | QuantizationQ5_K_M | Context8K | Est. memory≈ 57 GB | ollama run llama3-groq-tool-use:70b-q5_K_M |
| 70b-q5_K_S | Typelocal | Inputstext | Digest88450a6c4bc7 | Download49 GB | Parameters70b | QuantizationQ5_K_S | Context8K | Est. memory≈ 56 GB | ollama run llama3-groq-tool-use:70b-q5_K_S |
| 70b-q6_K | Typelocal | Inputstext | Digestfe241542dd2b | Download58 GB | Parameters70b | QuantizationQ6_K | Context8K | Est. memory≈ 66 GB | ollama run llama3-groq-tool-use:70b-q6_K |
| 70b-q8_0 | Typelocal | Inputstext | Digeste998a1023200 | Download75 GB | Parameters70b | QuantizationQ8_0 | Context8K | Est. memory≈ 85 GB | ollama run llama3-groq-tool-use:70b-q8_0 |
| 8b | Typelocal | Inputstext | Digest36211dad2b15 | Download4.7 GB | Parameters8b | QuantizationUnknown | Context8K | Est. memory≈ 6.5 GB | ollama run llama3-groq-tool-use:8b |
| 8b-fp16 | Typelocal | Inputstext | Digestbe9b2c0775a5 | Download16 GB | Parameters8b | QuantizationFP16 | Context8K | Est. memory≈ 19 GB | ollama run llama3-groq-tool-use:8b-fp16 |
| 8b-q2_K | Typelocal | Inputstext | Digest37fac70005b1 | Download3.2 GB | Parameters8b | QuantizationQ2_K | Context8K | Est. memory≈ 5 GB | ollama run llama3-groq-tool-use:8b-q2_K |
| 8b-q3_K_L | Typelocal | Inputstext | Digest57fbbf9656ef | Download4.3 GB | Parameters8b | QuantizationQ3_K_L | Context8K | Est. memory≈ 6 GB | ollama run llama3-groq-tool-use:8b-q3_K_L |
| 8b-q3_K_M | Typelocal | Inputstext | Digestdef359e8ef42 | Download4.0 GB | Parameters8b | QuantizationQ3_K_M | Context8K | Est. memory≈ 5.5 GB | ollama run llama3-groq-tool-use:8b-q3_K_M |
| 8b-q3_K_S | Typelocal | Inputstext | Digest3f7165ed6ac3 | Download3.7 GB | Parameters8b | QuantizationQ3_K_S | Context8K | Est. memory≈ 5.5 GB | ollama run llama3-groq-tool-use:8b-q3_K_S |
| 8b-q4_0 | Typelocal | Inputstext | Digest36211dad2b15 | Download4.7 GB | Parameters8b | QuantizationQ4_0 | Context8K | Est. memory≈ 6.5 GB | ollama run llama3-groq-tool-use:8b-q4_0 |
| 8b-q4_1 | Typelocal | Inputstext | Digestb927899ecb62 | Download5.1 GB | Parameters8b | QuantizationQ4_1 | Context8K | Est. memory≈ 7 GB | ollama run llama3-groq-tool-use:8b-q4_1 |
| 8b-q4_K_M | Typelocal | Inputstext | Digest5fa325bad307 | Download4.9 GB | Parameters8b | QuantizationQ4_K_M | Context8K | Est. memory≈ 6.5 GB | ollama run llama3-groq-tool-use:8b-q4_K_M |
| 8b-q4_K_S | Typelocal | Inputstext | Digest9dc66563ded8 | Download4.7 GB | Parameters8b | QuantizationQ4_K_S | Context8K | Est. memory≈ 6.5 GB | ollama run llama3-groq-tool-use:8b-q4_K_S |
| 8b-q5_0 | Typelocal | Inputstext | Digest0482e45a0517 | Download5.6 GB | Parameters8b | QuantizationQ5_0 | Context8K | Est. memory≈ 7.5 GB | ollama run llama3-groq-tool-use:8b-q5_0 |
| 8b-q5_1 | Typelocal | Inputstext | Digest45984ff6d001 | Download6.1 GB | Parameters8b | QuantizationQ5_1 | Context8K | Est. memory≈ 8 GB | ollama run llama3-groq-tool-use:8b-q5_1 |
| 8b-q5_K_M | Typelocal | Inputstext | Digest50c9c554ddd4 | Download5.7 GB | Parameters8b | QuantizationQ5_K_M | Context8K | Est. memory≈ 7.5 GB | ollama run llama3-groq-tool-use:8b-q5_K_M |
| 8b-q5_K_S | Typelocal | Inputstext | Digest6a1775abde02 | Download5.6 GB | Parameters8b | QuantizationQ5_K_S | Context8K | Est. memory≈ 7.5 GB | ollama run llama3-groq-tool-use:8b-q5_K_S |
| 8b-q6_K | Typelocal | Inputstext | Digest7ec6fd768fe0 | Download6.6 GB | Parameters8b | QuantizationQ6_K | Context8K | Est. memory≈ 8.5 GB | ollama run llama3-groq-tool-use:8b-q6_K |
| 8b-q8_0 | Typelocal | Inputstext | Digest58ab12b11127 | Download8.5 GB | Parameters8b | QuantizationQ8_0 | Context8K | Est. memory≈ 10.5 GB | ollama run llama3-groq-tool-use:8b-q8_0 |
| latestdefault | Typelocal | Inputstext | Digest36211dad2b15 | Download4.7 GB | ParametersUnknown | QuantizationUnknown | Context8K | Est. memory≈ 6.5 GB | ollama run llama3-groq-tool-use:latest |
Source-listed applications
Claude CodeHermes AgentOpenClawOpenCode
Related models
llama3.1local
Llama 3.1 is a new state-of-the-art model from Meta available in 8B, 70B and 405B parameter sizes.
granite4.1-guardianlocal
Granite Guardian 4.1 is a specialized safety and judging model from IBM Research that evaluates whether LLM prompts and responses meet specified harm criteria.
aya-expanselocal
Cohere For AI's language models trained to perform well across 23 different languages.
ministral-3local
The Ministral 3 family is designed for edge deployment, capable of running on a wide range of hardware.