Quick start
ollama run llama3.1:latestRunnable variants
Memory is a rough file-size estimate; context length, runtime and GPU offload change it.
12 of 93 matching variants shown.93 of 93 variants shown.
| Tag | Type | Inputs | Digest | Download | Parameters | Quantization | Context | Est. memory | Run |
|---|---|---|---|---|---|---|---|---|---|
| 405b | Typelocal | Inputstext | Digestdbd6b9ea93de | Download243 GB | Parameters405b | QuantizationUnknown | Context128K | Est. memory≈ 273 GB | ollama run llama3.1:405b |
| 405b-instruct-fp16 | Typelocal | Inputstext | Digest8ca13bcda28b | Download812 GB | Parameters405b | QuantizationFP16 | Context128K | Est. memory≈ 908.5 GB | ollama run llama3.1:405b-instruct-fp16 |
| 405b-instruct-q2_K | Typelocal | Inputstext | Digest57c259aa0162 | Download149 GB | Parameters405b | QuantizationQ2_K | Context128K | Est. memory≈ 168 GB | ollama run llama3.1:405b-instruct-q2_K |
| 405b-instruct-q3_K_L | Typelocal | Inputstext | Digestfcd77ab1d261 | Download213 GB | Parameters405b | QuantizationQ3_K_L | Context128K | Est. memory≈ 239.5 GB | ollama run llama3.1:405b-instruct-q3_K_L |
| 405b-instruct-q3_K_M | Typelocal | Inputstext | Digest9ab0ea61e9d6 | Download195 GB | Parameters405b | QuantizationQ3_K_M | Context128K | Est. memory≈ 219 GB | ollama run llama3.1:405b-instruct-q3_K_M |
| 405b-instruct-q3_K_S | Typelocal | Inputstext | Digest5629943379da | Download175 GB | Parameters405b | QuantizationQ3_K_S | Context128K | Est. memory≈ 197 GB | ollama run llama3.1:405b-instruct-q3_K_S |
| 405b-instruct-q4_0 | Typelocal | Inputstext | Digest65fa6b82bfda | Download229 GB | Parameters405b | QuantizationQ4_0 | Context128K | Est. memory≈ 257 GB | ollama run llama3.1:405b-instruct-q4_0 |
| 405b-instruct-q4_1 | Typelocal | Inputstext | Digest283fcc3a816a | Download254 GB | Parameters405b | QuantizationQ4_1 | Context128K | Est. memory≈ 285 GB | ollama run llama3.1:405b-instruct-q4_1 |
| 405b-instruct-q4_K_M | Typelocal | Inputstext | Digestdbd6b9ea93de | Download243 GB | Parameters405b | QuantizationQ4_K_M | Context128K | Est. memory≈ 273 GB | ollama run llama3.1:405b-instruct-q4_K_M |
| 405b-instruct-q4_K_S | Typelocal | Inputstext | Digest4a745087e617 | Download231 GB | Parameters405b | QuantizationQ4_K_S | Context128K | Est. memory≈ 259.5 GB | ollama run llama3.1:405b-instruct-q4_K_S |
| 405b-instruct-q5_0 | Typelocal | Inputstext | Digest441bbd85e453 | Download279 GB | Parameters405b | QuantizationQ5_0 | Context128K | Est. memory≈ 313 GB | ollama run llama3.1:405b-instruct-q5_0 |
| 405b-instruct-q5_1 | Typelocal | Inputstext | Digestb80f0c0aea72 | Download305 GB | Parameters405b | QuantizationQ5_1 | Context128K | Est. memory≈ 342 GB | ollama run llama3.1:405b-instruct-q5_1 |
| 405b-instruct-q5_K_M | Typelocal | Inputstext | Digestfed1ac5214db | Download287 GB | Parameters405b | QuantizationQ5_K_M | Context128K | Est. memory≈ 322 GB | ollama run llama3.1:405b-instruct-q5_K_M |
| 405b-instruct-q5_K_S | Typelocal | Inputstext | Digest5e5285368f59 | Download279 GB | Parameters405b | QuantizationQ5_K_S | Context128K | Est. memory≈ 313 GB | ollama run llama3.1:405b-instruct-q5_K_S |
| 405b-instruct-q6_K | Typelocal | Inputstext | Digest5478eb23c5fb | Download333 GB | Parameters405b | QuantizationQ6_K | Context128K | Est. memory≈ 373.5 GB | ollama run llama3.1:405b-instruct-q6_K |
| 405b-instruct-q8_0 | Typelocal | Inputstext | Digestb674ab2e9d34 | Download431 GB | Parameters405b | QuantizationQ8_0 | Context128K | Est. memory≈ 483 GB | ollama run llama3.1:405b-instruct-q8_0 |
| 405b-text-fp16 | Typelocal | Inputstext | Digestbc01fb5255d5 | Download812 GB | Parameters405b | QuantizationFP16 | Context128K | Est. memory≈ 908.5 GB | ollama run llama3.1:405b-text-fp16 |
| 405b-text-q2_K | Typelocal | Inputstext | Digestf7b0ab60bfbe | Download149 GB | Parameters405b | QuantizationQ2_K | Context128K | Est. memory≈ 168 GB | ollama run llama3.1:405b-text-q2_K |
| 405b-text-q3_K_L | Typelocal | Inputstext | Digest94bf2a77e235 | Download213 GB | Parameters405b | QuantizationQ3_K_L | Context128K | Est. memory≈ 239.5 GB | ollama run llama3.1:405b-text-q3_K_L |
| 405b-text-q3_K_M | Typelocal | Inputstext | Digestb9fb97304e8e | Download195 GB | Parameters405b | QuantizationQ3_K_M | Context128K | Est. memory≈ 219 GB | ollama run llama3.1:405b-text-q3_K_M |
| 405b-text-q3_K_S | Typelocal | Inputstext | Digest6c66c6eac804 | Download175 GB | Parameters405b | QuantizationQ3_K_S | Context128K | Est. memory≈ 197 GB | ollama run llama3.1:405b-text-q3_K_S |
| 405b-text-q4_0 | Typelocal | Inputstext | Digest320335002c0c | Download229 GB | Parameters405b | QuantizationQ4_0 | Context128K | Est. memory≈ 257 GB | ollama run llama3.1:405b-text-q4_0 |
| 405b-text-q4_1 | Typelocal | Inputstext | Digestfea44733a09c | Download254 GB | Parameters405b | QuantizationQ4_1 | Context128K | Est. memory≈ 285 GB | ollama run llama3.1:405b-text-q4_1 |
| 405b-text-q4_K_M | Typelocal | Inputstext | Digestd8a18ddb2815 | Download243 GB | Parameters405b | QuantizationQ4_K_M | Context128K | Est. memory≈ 273 GB | ollama run llama3.1:405b-text-q4_K_M |
| 405b-text-q4_K_S | Typelocal | Inputstext | Digest06c63988889d | Download231 GB | Parameters405b | QuantizationQ4_K_S | Context128K | Est. memory≈ 259.5 GB | ollama run llama3.1:405b-text-q4_K_S |
| 405b-text-q5_0 | Typelocal | Inputstext | Digest8d3fd1384383 | Download279 GB | Parameters405b | QuantizationQ5_0 | Context128K | Est. memory≈ 313 GB | ollama run llama3.1:405b-text-q5_0 |
| 405b-text-q5_1 | Typelocal | Inputstext | Digest105c1a731c53 | Download305 GB | Parameters405b | QuantizationQ5_1 | Context128K | Est. memory≈ 342 GB | ollama run llama3.1:405b-text-q5_1 |
| 405b-text-q5_K_M | Typelocal | Inputstext | Digest0d410297a920 | Download287 GB | Parameters405b | QuantizationQ5_K_M | Context128K | Est. memory≈ 322 GB | ollama run llama3.1:405b-text-q5_K_M |
| 405b-text-q5_K_S | Typelocal | Inputstext | Digest8be1c5b6185d | Download279 GB | Parameters405b | QuantizationQ5_K_S | Context128K | Est. memory≈ 313 GB | ollama run llama3.1:405b-text-q5_K_S |
| 405b-text-q6_K | Typelocal | Inputstext | Digest0217d822dee9 | Download333 GB | Parameters405b | QuantizationQ6_K | Context128K | Est. memory≈ 373.5 GB | ollama run llama3.1:405b-text-q6_K |
| 405b-text-q8_0 | Typelocal | Inputstext | Digest394d4ab99b16 | Download431 GB | Parameters405b | QuantizationQ8_0 | Context128K | Est. memory≈ 483 GB | ollama run llama3.1:405b-text-q8_0 |
| 70b | Typelocal | Inputstext | Digest711a9e8463af | Download43 GB | Parameters70b | QuantizationUnknown | Context128K | Est. memory≈ 49.5 GB | ollama run llama3.1:70b |
| 70b-instruct-fp16 | Typelocal | Inputstext | Digest80d34437631f | Download141 GB | Parameters70b | QuantizationFP16 | Context128K | Est. memory≈ 159 GB | ollama run llama3.1:70b-instruct-fp16 |
| 70b-instruct-q2_K | Typelocal | Inputstext | Digest3cbf499d6905 | Download26 GB | Parameters70b | QuantizationQ2_K | Context128K | Est. memory≈ 30.5 GB | ollama run llama3.1:70b-instruct-q2_K |
| 70b-instruct-q3_K_L | Typelocal | Inputstext | Digestdfa642c7de3f | Download37 GB | Parameters70b | QuantizationQ3_K_L | Context128K | Est. memory≈ 42.5 GB | ollama run llama3.1:70b-instruct-q3_K_L |
| 70b-instruct-q3_K_M | Typelocal | Inputstext | Digest0e97a7709799 | Download34 GB | Parameters70b | QuantizationQ3_K_M | Context128K | Est. memory≈ 39 GB | ollama run llama3.1:70b-instruct-q3_K_M |
| 70b-instruct-q3_K_S | Typelocal | Inputstext | Digestaae9a850239c | Download31 GB | Parameters70b | QuantizationQ3_K_S | Context128K | Est. memory≈ 36 GB | ollama run llama3.1:70b-instruct-q3_K_S |
| 70b-instruct-q4_0 | Typelocal | Inputstext | Digestc0df3564cfe8 | Download40 GB | Parameters70b | QuantizationQ4_0 | Context128K | Est. memory≈ 46 GB | ollama run llama3.1:70b-instruct-q4_0 |
| 70b-instruct-q4_K_M | Typelocal | Inputstext | Digest711a9e8463af | Download43 GB | Parameters70b | QuantizationQ4_K_M | Context128K | Est. memory≈ 49.5 GB | ollama run llama3.1:70b-instruct-q4_K_M |
| 70b-instruct-q4_K_S | Typelocal | Inputstext | Digest826ee833d0c5 | Download40 GB | Parameters70b | QuantizationQ4_K_S | Context128K | Est. memory≈ 46 GB | ollama run llama3.1:70b-instruct-q4_K_S |
| 70b-instruct-q5_0 | Typelocal | Inputstext | Digest97b688346a84 | Download49 GB | Parameters70b | QuantizationQ5_0 | Context128K | Est. memory≈ 56 GB | ollama run llama3.1:70b-instruct-q5_0 |
| 70b-instruct-q5_1 | Typelocal | Inputstext | Digest84421db620ee | Download53 GB | Parameters70b | QuantizationQ5_1 | Context128K | Est. memory≈ 60.5 GB | ollama run llama3.1:70b-instruct-q5_1 |
| 70b-instruct-q5_K_M | Typelocal | Inputstext | Digest1201b5de8650 | Download50 GB | Parameters70b | QuantizationQ5_K_M | Context128K | Est. memory≈ 57 GB | ollama run llama3.1:70b-instruct-q5_K_M |
| 70b-instruct-q5_K_S | Typelocal | Inputstext | Digest9acd76c5572e | Download49 GB | Parameters70b | QuantizationQ5_K_S | Context128K | Est. memory≈ 56 GB | ollama run llama3.1:70b-instruct-q5_K_S |
| 70b-instruct-q6_K | Typelocal | Inputstext | Digesteb2f022cab3c | Download58 GB | Parameters70b | QuantizationQ6_K | Context128K | Est. memory≈ 66 GB | ollama run llama3.1:70b-instruct-q6_K |
| 70b-instruct-q8_0 | Typelocal | Inputstext | Digest5dd991fa92a4 | Download75 GB | Parameters70b | QuantizationQ8_0 | Context128K | Est. memory≈ 85 GB | ollama run llama3.1:70b-instruct-q8_0 |
| 70b-text-fp16 | Typelocal | Inputstext | Digest391fbe608631 | Download141 GB | Parameters70b | QuantizationFP16 | Context128K | Est. memory≈ 159 GB | ollama run llama3.1:70b-text-fp16 |
| 70b-text-q2_K | Typelocal | Inputstext | Digest4dff43d37532 | Download26 GB | Parameters70b | QuantizationQ2_K | Context128K | Est. memory≈ 30.5 GB | ollama run llama3.1:70b-text-q2_K |
| 70b-text-q3_K_L | Typelocal | Inputstext | Digest92b790ee5c4e | Download37 GB | Parameters70b | QuantizationQ3_K_L | Context128K | Est. memory≈ 42.5 GB | ollama run llama3.1:70b-text-q3_K_L |
| 70b-text-q3_K_M | Typelocal | Inputstext | Digest521811adfd14 | Download34 GB | Parameters70b | QuantizationQ3_K_M | Context128K | Est. memory≈ 39 GB | ollama run llama3.1:70b-text-q3_K_M |
| 70b-text-q3_K_S | Typelocal | Inputstext | Digest5d0e57a281be | Download31 GB | Parameters70b | QuantizationQ3_K_S | Context128K | Est. memory≈ 36 GB | ollama run llama3.1:70b-text-q3_K_S |
| 70b-text-q4_0 | Typelocal | Inputstext | Digest89e7cf894d3c | Download40 GB | Parameters70b | QuantizationQ4_0 | Context128K | Est. memory≈ 46 GB | ollama run llama3.1:70b-text-q4_0 |
| 70b-text-q4_1 | Typelocal | Inputstext | Digestdc22a40d439c | Download44 GB | Parameters70b | QuantizationQ4_1 | Context128K | Est. memory≈ 50.5 GB | ollama run llama3.1:70b-text-q4_1 |
| 70b-text-q4_K_M | Typelocal | Inputstext | Digestf2348d28d33b | Download43 GB | Parameters70b | QuantizationQ4_K_M | Context128K | Est. memory≈ 49.5 GB | ollama run llama3.1:70b-text-q4_K_M |
| 70b-text-q4_K_S | Typelocal | Inputstext | Digest6da906aeecc4 | Download40 GB | Parameters70b | QuantizationQ4_K_S | Context128K | Est. memory≈ 46 GB | ollama run llama3.1:70b-text-q4_K_S |
| 70b-text-q5_0 | Typelocal | Inputstext | Digest853b4f3150a5 | Download49 GB | Parameters70b | QuantizationQ5_0 | Context128K | Est. memory≈ 56 GB | ollama run llama3.1:70b-text-q5_0 |
| 70b-text-q5_1 | Typelocal | Inputstext | Digestfb7068813a93 | Download53 GB | Parameters70b | QuantizationQ5_1 | Context128K | Est. memory≈ 60.5 GB | ollama run llama3.1:70b-text-q5_1 |
| 70b-text-q5_K_M | Typelocal | Inputstext | Digestd06cbd1da457 | Download50 GB | Parameters70b | QuantizationQ5_K_M | Context128K | Est. memory≈ 57 GB | ollama run llama3.1:70b-text-q5_K_M |
| 70b-text-q5_K_S | Typelocal | Inputstext | Digest540ebde70524 | Download49 GB | Parameters70b | QuantizationQ5_K_S | Context128K | Est. memory≈ 56 GB | ollama run llama3.1:70b-text-q5_K_S |
| 70b-text-q6_K | Typelocal | Inputstext | Digestff11f01d22b1 | Download58 GB | Parameters70b | QuantizationQ6_K | Context128K | Est. memory≈ 66 GB | ollama run llama3.1:70b-text-q6_K |
| 70b-text-q8_0 | Typelocal | Inputstext | Digest2da4cc56a344 | Download75 GB | Parameters70b | QuantizationQ8_0 | Context128K | Est. memory≈ 85 GB | ollama run llama3.1:70b-text-q8_0 |
| 8b | Typelocal | Inputstext | Digest46e0c10c039e | Download4.9 GB | Parameters8b | QuantizationUnknown | Context128K | Est. memory≈ 6.5 GB | ollama run llama3.1:8b |
| 8b-instruct-fp16 | Typelocal | Inputstext | Digest4aacac419454 | Download16 GB | Parameters8b | QuantizationFP16 | Context128K | Est. memory≈ 19 GB | ollama run llama3.1:8b-instruct-fp16 |
| 8b-instruct-q2_K | Typelocal | Inputstext | Digest44a139eeb344 | Download3.2 GB | Parameters8b | QuantizationQ2_K | Context128K | Est. memory≈ 5 GB | ollama run llama3.1:8b-instruct-q2_K |
| 8b-instruct-q3_K_L | Typelocal | Inputstext | Digest04a2f1e44de7 | Download4.3 GB | Parameters8b | QuantizationQ3_K_L | Context128K | Est. memory≈ 6 GB | ollama run llama3.1:8b-instruct-q3_K_L |
| 8b-instruct-q3_K_M | Typelocal | Inputstext | Digest4faa21fca5a2 | Download4.0 GB | Parameters8b | QuantizationQ3_K_M | Context128K | Est. memory≈ 5.5 GB | ollama run llama3.1:8b-instruct-q3_K_M |
| 8b-instruct-q3_K_S | Typelocal | Inputstext | Digest16268e519444 | Download3.7 GB | Parameters8b | QuantizationQ3_K_S | Context128K | Est. memory≈ 5.5 GB | ollama run llama3.1:8b-instruct-q3_K_S |
| 8b-instruct-q4_0 | Typelocal | Inputstext | Digest42182419e950 | Download4.7 GB | Parameters8b | QuantizationQ4_0 | Context128K | Est. memory≈ 6.5 GB | ollama run llama3.1:8b-instruct-q4_0 |
| 8b-instruct-q4_1 | Typelocal | Inputstext | Digeste129e608a752 | Download5.1 GB | Parameters8b | QuantizationQ4_1 | Context128K | Est. memory≈ 7 GB | ollama run llama3.1:8b-instruct-q4_1 |
| 8b-instruct-q4_K_M | Typelocal | Inputstext | Digest46e0c10c039e | Download4.9 GB | Parameters8b | QuantizationQ4_K_M | Context128K | Est. memory≈ 6.5 GB | ollama run llama3.1:8b-instruct-q4_K_M |
| 8b-instruct-q4_K_S | Typelocal | Inputstext | Digest778e1e675704 | Download4.7 GB | Parameters8b | QuantizationQ4_K_S | Context128K | Est. memory≈ 6.5 GB | ollama run llama3.1:8b-instruct-q4_K_S |
| 8b-instruct-q5_0 | Typelocal | Inputstext | Digest26bc223a1709 | Download5.6 GB | Parameters8b | QuantizationQ5_0 | Context128K | Est. memory≈ 7.5 GB | ollama run llama3.1:8b-instruct-q5_0 |
| 8b-instruct-q5_1 | Typelocal | Inputstext | Digest8faaa53f9cda | Download6.1 GB | Parameters8b | QuantizationQ5_1 | Context128K | Est. memory≈ 8 GB | ollama run llama3.1:8b-instruct-q5_1 |
| 8b-instruct-q5_K_M | Typelocal | Inputstext | Digest27fe1b0ab52c | Download5.7 GB | Parameters8b | QuantizationQ5_K_M | Context128K | Est. memory≈ 7.5 GB | ollama run llama3.1:8b-instruct-q5_K_M |
| 8b-instruct-q5_K_S | Typelocal | Inputstext | Digest2d79e69bc236 | Download5.6 GB | Parameters8b | QuantizationQ5_K_S | Context128K | Est. memory≈ 7.5 GB | ollama run llama3.1:8b-instruct-q5_K_S |
| 8b-instruct-q6_K | Typelocal | Inputstext | Digest81e7664fda9c | Download6.6 GB | Parameters8b | QuantizationQ6_K | Context128K | Est. memory≈ 8.5 GB | ollama run llama3.1:8b-instruct-q6_K |
| 8b-instruct-q8_0 | Typelocal | Inputstext | Digestb158ded76fa0 | Download8.5 GB | Parameters8b | QuantizationQ8_0 | Context128K | Est. memory≈ 10.5 GB | ollama run llama3.1:8b-instruct-q8_0 |
| 8b-text-fp16 | Typelocal | Inputstext | Digest722fd1ff1fda | Download16 GB | Parameters8b | QuantizationFP16 | Context128K | Est. memory≈ 19 GB | ollama run llama3.1:8b-text-fp16 |
| 8b-text-q2_K | Typelocal | Inputstext | Digest82bedef0ef47 | Download3.2 GB | Parameters8b | QuantizationQ2_K | Context128K | Est. memory≈ 5 GB | ollama run llama3.1:8b-text-q2_K |
| 8b-text-q3_K_L | Typelocal | Inputstext | Digest4d9a56f79245 | Download4.3 GB | Parameters8b | QuantizationQ3_K_L | Context128K | Est. memory≈ 6 GB | ollama run llama3.1:8b-text-q3_K_L |
| 8b-text-q3_K_M | Typelocal | Inputstext | Digestabcf9215e3df | Download4.0 GB | Parameters8b | QuantizationQ3_K_M | Context128K | Est. memory≈ 5.5 GB | ollama run llama3.1:8b-text-q3_K_M |
| 8b-text-q3_K_S | Typelocal | Inputstext | Digest92c2cffe1a17 | Download3.7 GB | Parameters8b | QuantizationQ3_K_S | Context128K | Est. memory≈ 5.5 GB | ollama run llama3.1:8b-text-q3_K_S |
| 8b-text-q4_0 | Typelocal | Inputstext | Digest025059e83055 | Download4.7 GB | Parameters8b | QuantizationQ4_0 | Context128K | Est. memory≈ 6.5 GB | ollama run llama3.1:8b-text-q4_0 |
| 8b-text-q4_1 | Typelocal | Inputstext | Digest4b32d52187b4 | Download5.1 GB | Parameters8b | QuantizationQ4_1 | Context128K | Est. memory≈ 7 GB | ollama run llama3.1:8b-text-q4_1 |
| 8b-text-q4_K_M | Typelocal | Inputstext | Digest6f98b5a6e4b7 | Download4.9 GB | Parameters8b | QuantizationQ4_K_M | Context128K | Est. memory≈ 6.5 GB | ollama run llama3.1:8b-text-q4_K_M |
| 8b-text-q4_K_S | Typelocal | Inputstext | Digestd1a421604a57 | Download4.7 GB | Parameters8b | QuantizationQ4_K_S | Context128K | Est. memory≈ 6.5 GB | ollama run llama3.1:8b-text-q4_K_S |
| 8b-text-q5_0 | Typelocal | Inputstext | Digestee0f9a2ffa00 | Download5.6 GB | Parameters8b | QuantizationQ5_0 | Context128K | Est. memory≈ 7.5 GB | ollama run llama3.1:8b-text-q5_0 |
| 8b-text-q5_1 | Typelocal | Inputstext | Digestad68371dbd08 | Download6.1 GB | Parameters8b | QuantizationQ5_1 | Context128K | Est. memory≈ 8 GB | ollama run llama3.1:8b-text-q5_1 |
| 8b-text-q5_K_M | Typelocal | Inputstext | Digeste0b14a625560 | Download5.7 GB | Parameters8b | QuantizationQ5_K_M | Context128K | Est. memory≈ 7.5 GB | ollama run llama3.1:8b-text-q5_K_M |
| 8b-text-q5_K_S | Typelocal | Inputstext | Digesta7562b693302 | Download5.6 GB | Parameters8b | QuantizationQ5_K_S | Context128K | Est. memory≈ 7.5 GB | ollama run llama3.1:8b-text-q5_K_S |
| 8b-text-q6_K | Typelocal | Inputstext | Digest40e61b3c96cc | Download6.6 GB | Parameters8b | QuantizationQ6_K | Context128K | Est. memory≈ 8.5 GB | ollama run llama3.1:8b-text-q6_K |
| 8b-text-q8_0 | Typelocal | Inputstext | Digest56fd90f1aa19 | Download8.5 GB | Parameters8b | QuantizationQ8_0 | Context128K | Est. memory≈ 10.5 GB | ollama run llama3.1:8b-text-q8_0 |
| latestdefault | Typelocal | Inputstext | Digest46e0c10c039e | Download4.9 GB | ParametersUnknown | QuantizationUnknown | Context128K | Est. memory≈ 6.5 GB | ollama run llama3.1:latest |
Source-listed applications
Claude CodeHermes AgentOpenClawOpenCode
Related models
llama3-groq-tool-uselocal
A series of models from Groq that represent a significant advancement in open-source AI capabilities for tool use/function calling.
granite4.1-guardianlocal
Granite Guardian 4.1 is a specialized safety and judging model from IBM Research that evaluates whether LLM prompts and responses meet specified harm criteria.
aya-expanselocal
Cohere For AI's language models trained to perform well across 23 different languages.
ministral-3local
The Ministral 3 family is designed for edge deployment, capable of running on a wide range of hardware.