Quick start
ollama run qwen2.5:latestRunnable variants
Memory is a rough file-size estimate; context length, runtime and GPU offload change it.
12 of 133 matching variants shown.133 of 133 variants shown.
| Tag | Type | Inputs | Digest | Download | Parameters | Quantization | Context | Est. memory | Run |
|---|---|---|---|---|---|---|---|---|---|
| 0.5b | Typelocal | Inputstext | Digesta8b0c5157701 | Download398 MB | Parameters0.5b | QuantizationUnknown | Context32K | Est. memory≈ 1.5 GB | ollama run qwen2.5:0.5b |
| 0.5b-base | Typelocal | Inputstext | Digest24c564a74dea | Download398 MB | Parameters0.5b | QuantizationUnknown | Context32K | Est. memory≈ 1.5 GB | ollama run qwen2.5:0.5b-base |
| 0.5b-base-q2_K | Typelocal | Inputstext | Digestb439066a7c50 | Download339 MB | Parameters0.5b | QuantizationQ2_K | Context32K | Est. memory≈ 1.5 GB | ollama run qwen2.5:0.5b-base-q2_K |
| 0.5b-base-q3_K_L | Typelocal | Inputstext | Digest59bf60d67517 | Download369 MB | Parameters0.5b | QuantizationQ3_K_L | Context32K | Est. memory≈ 1.5 GB | ollama run qwen2.5:0.5b-base-q3_K_L |
| 0.5b-base-q3_K_M | Typelocal | Inputstext | Digest2b0f4078dcc1 | Download355 MB | Parameters0.5b | QuantizationQ3_K_M | Context32K | Est. memory≈ 1.5 GB | ollama run qwen2.5:0.5b-base-q3_K_M |
| 0.5b-base-q3_K_S | Typelocal | Inputstext | Digestcf1fe7a28bac | Download338 MB | Parameters0.5b | QuantizationQ3_K_S | Context32K | Est. memory≈ 1.5 GB | ollama run qwen2.5:0.5b-base-q3_K_S |
| 0.5b-base-q4_0 | Typelocal | Inputstext | Digesta990247b9c63 | Download352 MB | Parameters0.5b | QuantizationQ4_0 | Context32K | Est. memory≈ 1.5 GB | ollama run qwen2.5:0.5b-base-q4_0 |
| 0.5b-base-q4_1 | Typelocal | Inputstext | Digest50cc344abeb2 | Download375 MB | Parameters0.5b | QuantizationQ4_1 | Context32K | Est. memory≈ 1.5 GB | ollama run qwen2.5:0.5b-base-q4_1 |
| 0.5b-base-q4_K_M | Typelocal | Inputstext | Digest24c564a74dea | Download398 MB | Parameters0.5b | QuantizationQ4_K_M | Context32K | Est. memory≈ 1.5 GB | ollama run qwen2.5:0.5b-base-q4_K_M |
| 0.5b-base-q4_K_S | Typelocal | Inputstext | Digest75db83387279 | Download385 MB | Parameters0.5b | QuantizationQ4_K_S | Context32K | Est. memory≈ 1.5 GB | ollama run qwen2.5:0.5b-base-q4_K_S |
| 0.5b-base-q5_0 | Typelocal | Inputstext | Digesta30fbb649ad5 | Download397 MB | Parameters0.5b | QuantizationQ5_0 | Context32K | Est. memory≈ 1.5 GB | ollama run qwen2.5:0.5b-base-q5_0 |
| 0.5b-base-q5_1 | Typelocal | Inputstext | Digestc3e31c5b32da | Download419 MB | Parameters0.5b | QuantizationQ5_1 | Context32K | Est. memory≈ 1.5 GB | ollama run qwen2.5:0.5b-base-q5_1 |
| 0.5b-base-q5_K_S | Typelocal | Inputstext | Digest2484afe4f04e | Download413 MB | Parameters0.5b | QuantizationQ5_K_S | Context32K | Est. memory≈ 1.5 GB | ollama run qwen2.5:0.5b-base-q5_K_S |
| 0.5b-base-q8_0 | Typelocal | Inputstext | Digestdb0459695543 | Download531 MB | Parameters0.5b | QuantizationQ8_0 | Context32K | Est. memory≈ 2 GB | ollama run qwen2.5:0.5b-base-q8_0 |
| 0.5b-instruct | Typelocal | Inputstext | Digesta8b0c5157701 | Download398 MB | Parameters0.5b | QuantizationUnknown | Context32K | Est. memory≈ 1.5 GB | ollama run qwen2.5:0.5b-instruct |
| 0.5b-instruct-fp16 | Typelocal | Inputstext | Digestc82efd44bfdc | Download994 MB | Parameters0.5b | QuantizationFP16 | Context32K | Est. memory≈ 2.5 GB | ollama run qwen2.5:0.5b-instruct-fp16 |
| 0.5b-instruct-q2_K | Typelocal | Inputstext | Digestfa66a85e7fe2 | Download339 MB | Parameters0.5b | QuantizationQ2_K | Context32K | Est. memory≈ 1.5 GB | ollama run qwen2.5:0.5b-instruct-q2_K |
| 0.5b-instruct-q3_K_L | Typelocal | Inputstext | Digest2ea07e2fd539 | Download369 MB | Parameters0.5b | QuantizationQ3_K_L | Context32K | Est. memory≈ 1.5 GB | ollama run qwen2.5:0.5b-instruct-q3_K_L |
| 0.5b-instruct-q3_K_M | Typelocal | Inputstext | Digesta1b962ae1ffb | Download355 MB | Parameters0.5b | QuantizationQ3_K_M | Context32K | Est. memory≈ 1.5 GB | ollama run qwen2.5:0.5b-instruct-q3_K_M |
| 0.5b-instruct-q3_K_S | Typelocal | Inputstext | Digest2b61ae1bb74f | Download338 MB | Parameters0.5b | QuantizationQ3_K_S | Context32K | Est. memory≈ 1.5 GB | ollama run qwen2.5:0.5b-instruct-q3_K_S |
| 0.5b-instruct-q4_0 | Typelocal | Inputstext | Digest44deb286b008 | Download352 MB | Parameters0.5b | QuantizationQ4_0 | Context32K | Est. memory≈ 1.5 GB | ollama run qwen2.5:0.5b-instruct-q4_0 |
| 0.5b-instruct-q4_1 | Typelocal | Inputstext | Digest61378941e31f | Download375 MB | Parameters0.5b | QuantizationQ4_1 | Context32K | Est. memory≈ 1.5 GB | ollama run qwen2.5:0.5b-instruct-q4_1 |
| 0.5b-instruct-q4_K_M | Typelocal | Inputstext | Digesta8b0c5157701 | Download398 MB | Parameters0.5b | QuantizationQ4_K_M | Context32K | Est. memory≈ 1.5 GB | ollama run qwen2.5:0.5b-instruct-q4_K_M |
| 0.5b-instruct-q4_K_S | Typelocal | Inputstext | Digest6f4611e3bd35 | Download385 MB | Parameters0.5b | QuantizationQ4_K_S | Context32K | Est. memory≈ 1.5 GB | ollama run qwen2.5:0.5b-instruct-q4_K_S |
| 0.5b-instruct-q5_0 | Typelocal | Inputstext | Digest4a8f6fc82b6e | Download397 MB | Parameters0.5b | QuantizationQ5_0 | Context32K | Est. memory≈ 1.5 GB | ollama run qwen2.5:0.5b-instruct-q5_0 |
| 0.5b-instruct-q5_1 | Typelocal | Inputstext | Digest95b03700b65c | Download419 MB | Parameters0.5b | QuantizationQ5_1 | Context32K | Est. memory≈ 1.5 GB | ollama run qwen2.5:0.5b-instruct-q5_1 |
| 0.5b-instruct-q5_K_M | Typelocal | Inputstext | Digest0762ec590a8c | Download420 MB | Parameters0.5b | QuantizationQ5_K_M | Context32K | Est. memory≈ 1.5 GB | ollama run qwen2.5:0.5b-instruct-q5_K_M |
| 0.5b-instruct-q5_K_S | Typelocal | Inputstext | Digest5830fc2c0193 | Download413 MB | Parameters0.5b | QuantizationQ5_K_S | Context32K | Est. memory≈ 1.5 GB | ollama run qwen2.5:0.5b-instruct-q5_K_S |
| 0.5b-instruct-q6_K | Typelocal | Inputstext | Digestac75f8387539 | Download506 MB | Parameters0.5b | QuantizationQ6_K | Context32K | Est. memory≈ 2 GB | ollama run qwen2.5:0.5b-instruct-q6_K |
| 0.5b-instruct-q8_0 | Typelocal | Inputstext | Digest84d044692a2c | Download531 MB | Parameters0.5b | QuantizationQ8_0 | Context32K | Est. memory≈ 2 GB | ollama run qwen2.5:0.5b-instruct-q8_0 |
| 1.5b | Typelocal | Inputstext | Digest65ec06548149 | Download986 MB | Parameters1.5b | QuantizationUnknown | Context32K | Est. memory≈ 2.5 GB | ollama run qwen2.5:1.5b |
| 1.5b-instruct | Typelocal | Inputstext | Digest65ec06548149 | Download986 MB | Parameters1.5b | QuantizationUnknown | Context32K | Est. memory≈ 2.5 GB | ollama run qwen2.5:1.5b-instruct |
| 1.5b-instruct-fp16 | Typelocal | Inputstext | Digestd8035f049126 | Download3.1 GB | Parameters1.5b | QuantizationFP16 | Context32K | Est. memory≈ 4.5 GB | ollama run qwen2.5:1.5b-instruct-fp16 |
| 1.5b-instruct-q2_K | Typelocal | Inputstext | Digestc239521b8b51 | Download676 MB | Parameters1.5b | QuantizationQ2_K | Context32K | Est. memory≈ 2 GB | ollama run qwen2.5:1.5b-instruct-q2_K |
| 1.5b-instruct-q3_K_L | Typelocal | Inputstext | Digestb16c18a133fa | Download880 MB | Parameters1.5b | QuantizationQ3_K_L | Context32K | Est. memory≈ 2 GB | ollama run qwen2.5:1.5b-instruct-q3_K_L |
| 1.5b-instruct-q3_K_M | Typelocal | Inputstext | Digest5a4d48f91dab | Download824 MB | Parameters1.5b | QuantizationQ3_K_M | Context32K | Est. memory≈ 2 GB | ollama run qwen2.5:1.5b-instruct-q3_K_M |
| 1.5b-instruct-q3_K_S | Typelocal | Inputstext | Digest2ead4934f6e9 | Download761 MB | Parameters1.5b | QuantizationQ3_K_S | Context32K | Est. memory≈ 2 GB | ollama run qwen2.5:1.5b-instruct-q3_K_S |
| 1.5b-instruct-q4_0 | Typelocal | Inputstext | Digest635e70c8687b | Download935 MB | Parameters1.5b | QuantizationQ4_0 | Context32K | Est. memory≈ 2.5 GB | ollama run qwen2.5:1.5b-instruct-q4_0 |
| 1.5b-instruct-q4_1 | Typelocal | Inputstext | Digest4543b48a5085 | Download1.0 GB | Parameters1.5b | QuantizationQ4_1 | Context32K | Est. memory≈ 2.5 GB | ollama run qwen2.5:1.5b-instruct-q4_1 |
| 1.5b-instruct-q4_K_M | Typelocal | Inputstext | Digest65ec06548149 | Download986 MB | Parameters1.5b | QuantizationQ4_K_M | Context32K | Est. memory≈ 2.5 GB | ollama run qwen2.5:1.5b-instruct-q4_K_M |
| 1.5b-instruct-q4_K_S | Typelocal | Inputstext | Digest17dd5468f0a7 | Download940 MB | Parameters1.5b | QuantizationQ4_K_S | Context32K | Est. memory≈ 2.5 GB | ollama run qwen2.5:1.5b-instruct-q4_K_S |
| 1.5b-instruct-q5_0 | Typelocal | Inputstext | Digest267c3094f0b0 | Download1.1 GB | Parameters1.5b | QuantizationQ5_0 | Context32K | Est. memory≈ 2.5 GB | ollama run qwen2.5:1.5b-instruct-q5_0 |
| 1.5b-instruct-q5_1 | Typelocal | Inputstext | Digest828d5d698355 | Download1.2 GB | Parameters1.5b | QuantizationQ5_1 | Context32K | Est. memory≈ 2.5 GB | ollama run qwen2.5:1.5b-instruct-q5_1 |
| 1.5b-instruct-q5_K_M | Typelocal | Inputstext | Digest7a0e895425bc | Download1.1 GB | Parameters1.5b | QuantizationQ5_K_M | Context32K | Est. memory≈ 2.5 GB | ollama run qwen2.5:1.5b-instruct-q5_K_M |
| 1.5b-instruct-q5_K_S | Typelocal | Inputstext | Digest4dce61337043 | Download1.1 GB | Parameters1.5b | QuantizationQ5_K_S | Context32K | Est. memory≈ 2.5 GB | ollama run qwen2.5:1.5b-instruct-q5_K_S |
| 1.5b-instruct-q6_K | Typelocal | Inputstext | Digest03ec957c269f | Download1.3 GB | Parameters1.5b | QuantizationQ6_K | Context32K | Est. memory≈ 2.5 GB | ollama run qwen2.5:1.5b-instruct-q6_K |
| 1.5b-instruct-q8_0 | Typelocal | Inputstext | Digestb19683a34698 | Download1.6 GB | Parameters1.5b | QuantizationQ8_0 | Context32K | Est. memory≈ 3 GB | ollama run qwen2.5:1.5b-instruct-q8_0 |
| 14b | Typelocal | Inputstext | Digest7cdf5a0187d5 | Download9.0 GB | Parameters14b | QuantizationUnknown | Context32K | Est. memory≈ 11.5 GB | ollama run qwen2.5:14b |
| 14b-instruct | Typelocal | Inputstext | Digest7cdf5a0187d5 | Download9.0 GB | Parameters14b | QuantizationUnknown | Context32K | Est. memory≈ 11.5 GB | ollama run qwen2.5:14b-instruct |
| 14b-instruct-fp16 | Typelocal | Inputstext | Digest06c8c6f15cf9 | Download30 GB | Parameters14b | QuantizationFP16 | Context32K | Est. memory≈ 35 GB | ollama run qwen2.5:14b-instruct-fp16 |
| 14b-instruct-q2_K | Typelocal | Inputstext | Digest9caf6424b5f9 | Download5.8 GB | Parameters14b | QuantizationQ2_K | Context32K | Est. memory≈ 7.5 GB | ollama run qwen2.5:14b-instruct-q2_K |
| 14b-instruct-q3_K_L | Typelocal | Inputstext | Digest0ab75160d333 | Download7.9 GB | Parameters14b | QuantizationQ3_K_L | Context32K | Est. memory≈ 10 GB | ollama run qwen2.5:14b-instruct-q3_K_L |
| 14b-instruct-q3_K_M | Typelocal | Inputstext | Digest4d8dbee0507f | Download7.3 GB | Parameters14b | QuantizationQ3_K_M | Context32K | Est. memory≈ 9.5 GB | ollama run qwen2.5:14b-instruct-q3_K_M |
| 14b-instruct-q3_K_S | Typelocal | Inputstext | Digestc8f457c1f8f5 | Download6.7 GB | Parameters14b | QuantizationQ3_K_S | Context32K | Est. memory≈ 8.5 GB | ollama run qwen2.5:14b-instruct-q3_K_S |
| 14b-instruct-q4_0 | Typelocal | Inputstext | Digest5449194ff803 | Download8.5 GB | Parameters14b | QuantizationQ4_0 | Context32K | Est. memory≈ 10.5 GB | ollama run qwen2.5:14b-instruct-q4_0 |
| 14b-instruct-q4_1 | Typelocal | Inputstext | Digest4d404313d9cd | Download9.4 GB | Parameters14b | QuantizationQ4_1 | Context32K | Est. memory≈ 12 GB | ollama run qwen2.5:14b-instruct-q4_1 |
| 14b-instruct-q4_K_M | Typelocal | Inputstext | Digest7cdf5a0187d5 | Download9.0 GB | Parameters14b | QuantizationQ4_K_M | Context32K | Est. memory≈ 11.5 GB | ollama run qwen2.5:14b-instruct-q4_K_M |
| 14b-instruct-q4_K_S | Typelocal | Inputstext | Digest927254c04779 | Download8.6 GB | Parameters14b | QuantizationQ4_K_S | Context32K | Est. memory≈ 11 GB | ollama run qwen2.5:14b-instruct-q4_K_S |
| 14b-instruct-q5_0 | Typelocal | Inputstext | Digeste242bafd33eb | Download10 GB | Parameters14b | QuantizationQ5_0 | Context32K | Est. memory≈ 12.5 GB | ollama run qwen2.5:14b-instruct-q5_0 |
| 14b-instruct-q5_1 | Typelocal | Inputstext | Digest43a5486ba383 | Download11 GB | Parameters14b | QuantizationQ5_1 | Context32K | Est. memory≈ 13.5 GB | ollama run qwen2.5:14b-instruct-q5_1 |
| 14b-instruct-q5_K_M | Typelocal | Inputstext | Digest7bb3f324cafc | Download11 GB | Parameters14b | QuantizationQ5_K_M | Context32K | Est. memory≈ 13.5 GB | ollama run qwen2.5:14b-instruct-q5_K_M |
| 14b-instruct-q5_K_S | Typelocal | Inputstext | Digestf766877d708a | Download10 GB | Parameters14b | QuantizationQ5_K_S | Context32K | Est. memory≈ 12.5 GB | ollama run qwen2.5:14b-instruct-q5_K_S |
| 14b-instruct-q6_K | Typelocal | Inputstext | Digest4f6861a20c29 | Download12 GB | Parameters14b | QuantizationQ6_K | Context32K | Est. memory≈ 14.5 GB | ollama run qwen2.5:14b-instruct-q6_K |
| 14b-instruct-q8_0 | Typelocal | Inputstext | Digest985c5f25dfe9 | Download16 GB | Parameters14b | QuantizationQ8_0 | Context32K | Est. memory≈ 19 GB | ollama run qwen2.5:14b-instruct-q8_0 |
| 32b | Typelocal | Inputstext | Digest9f13ba1299af | Download20 GB | Parameters32b | QuantizationUnknown | Context32K | Est. memory≈ 23.5 GB | ollama run qwen2.5:32b |
| 32b-instruct | Typelocal | Inputstext | Digest9f13ba1299af | Download20 GB | Parameters32b | QuantizationUnknown | Context32K | Est. memory≈ 23.5 GB | ollama run qwen2.5:32b-instruct |
| 32b-instruct-fp16 | Typelocal | Inputstext | Digestd988bddd9a2e | Download66 GB | Parameters32b | QuantizationFP16 | Context32K | Est. memory≈ 75 GB | ollama run qwen2.5:32b-instruct-fp16 |
| 32b-instruct-q2_K | Typelocal | Inputstext | Digestecc53cfdce75 | Download12 GB | Parameters32b | QuantizationQ2_K | Context32K | Est. memory≈ 14.5 GB | ollama run qwen2.5:32b-instruct-q2_K |
| 32b-instruct-q3_K_L | Typelocal | Inputstext | Digest83db34c608fc | Download17 GB | Parameters32b | QuantizationQ3_K_L | Context32K | Est. memory≈ 20 GB | ollama run qwen2.5:32b-instruct-q3_K_L |
| 32b-instruct-q3_K_M | Typelocal | Inputstext | Digest44bd723cfd42 | Download16 GB | Parameters32b | QuantizationQ3_K_M | Context32K | Est. memory≈ 19 GB | ollama run qwen2.5:32b-instruct-q3_K_M |
| 32b-instruct-q3_K_S | Typelocal | Inputstext | Digestaefb7287ac72 | Download14 GB | Parameters32b | QuantizationQ3_K_S | Context32K | Est. memory≈ 17 GB | ollama run qwen2.5:32b-instruct-q3_K_S |
| 32b-instruct-q4_0 | Typelocal | Inputstext | Digest0508d3b6da02 | Download19 GB | Parameters32b | QuantizationQ4_0 | Context32K | Est. memory≈ 22.5 GB | ollama run qwen2.5:32b-instruct-q4_0 |
| 32b-instruct-q4_1 | Typelocal | Inputstext | Digestc35507089a57 | Download21 GB | Parameters32b | QuantizationQ4_1 | Context32K | Est. memory≈ 24.5 GB | ollama run qwen2.5:32b-instruct-q4_1 |
| 32b-instruct-q4_K_M | Typelocal | Inputstext | Digest9f13ba1299af | Download20 GB | Parameters32b | QuantizationQ4_K_M | Context32K | Est. memory≈ 23.5 GB | ollama run qwen2.5:32b-instruct-q4_K_M |
| 32b-instruct-q4_K_S | Typelocal | Inputstext | Digest0ef28b3b6dba | Download19 GB | Parameters32b | QuantizationQ4_K_S | Context32K | Est. memory≈ 22.5 GB | ollama run qwen2.5:32b-instruct-q4_K_S |
| 32b-instruct-q5_0 | Typelocal | Inputstext | Digestaf981f1d421b | Download23 GB | Parameters32b | QuantizationQ5_0 | Context32K | Est. memory≈ 27 GB | ollama run qwen2.5:32b-instruct-q5_0 |
| 32b-instruct-q5_1 | Typelocal | Inputstext | Digestfc1b4cb1aabb | Download25 GB | Parameters32b | QuantizationQ5_1 | Context32K | Est. memory≈ 29 GB | ollama run qwen2.5:32b-instruct-q5_1 |
| 32b-instruct-q5_K_M | Typelocal | Inputstext | Digestb0936ea364bf | Download23 GB | Parameters32b | QuantizationQ5_K_M | Context32K | Est. memory≈ 27 GB | ollama run qwen2.5:32b-instruct-q5_K_M |
| 32b-instruct-q5_K_S | Typelocal | Inputstext | Digest3cb439a8d19b | Download23 GB | Parameters32b | QuantizationQ5_K_S | Context32K | Est. memory≈ 27 GB | ollama run qwen2.5:32b-instruct-q5_K_S |
| 32b-instruct-q6_K | Typelocal | Inputstext | Digest09f123ce518b | Download27 GB | Parameters32b | QuantizationQ6_K | Context32K | Est. memory≈ 31.5 GB | ollama run qwen2.5:32b-instruct-q6_K |
| 32b-instruct-q8_0 | Typelocal | Inputstext | Digest378290543760 | Download35 GB | Parameters32b | QuantizationQ8_0 | Context32K | Est. memory≈ 40.5 GB | ollama run qwen2.5:32b-instruct-q8_0 |
| 3b | Typelocal | Inputstext | Digest357c53fb659c | Download1.9 GB | Parameters3b | QuantizationUnknown | Context32K | Est. memory≈ 3.5 GB | ollama run qwen2.5:3b |
| 3b-instruct | Typelocal | Inputstext | Digest357c53fb659c | Download1.9 GB | Parameters3b | QuantizationUnknown | Context32K | Est. memory≈ 3.5 GB | ollama run qwen2.5:3b-instruct |
| 3b-instruct-fp16 | Typelocal | Inputstext | Digestde47f806df14 | Download6.2 GB | Parameters3b | QuantizationFP16 | Context32K | Est. memory≈ 8 GB | ollama run qwen2.5:3b-instruct-fp16 |
| 3b-instruct-q2_K | Typelocal | Inputstext | Digest1fe27cd0c26a | Download1.3 GB | Parameters3b | QuantizationQ2_K | Context32K | Est. memory≈ 2.5 GB | ollama run qwen2.5:3b-instruct-q2_K |
| 3b-instruct-q3_K_L | Typelocal | Inputstext | Digestf8d588c5572a | Download1.7 GB | Parameters3b | QuantizationQ3_K_L | Context32K | Est. memory≈ 3 GB | ollama run qwen2.5:3b-instruct-q3_K_L |
| 3b-instruct-q3_K_M | Typelocal | Inputstext | Digestc3240229f22f | Download1.6 GB | Parameters3b | QuantizationQ3_K_M | Context32K | Est. memory≈ 3 GB | ollama run qwen2.5:3b-instruct-q3_K_M |
| 3b-instruct-q3_K_S | Typelocal | Inputstext | Digest5ed381ff5c13 | Download1.5 GB | Parameters3b | QuantizationQ3_K_S | Context32K | Est. memory≈ 3 GB | ollama run qwen2.5:3b-instruct-q3_K_S |
| 3b-instruct-q4_0 | Typelocal | Inputstext | Digest09f7fe4d29e6 | Download1.8 GB | Parameters3b | QuantizationQ4_0 | Context32K | Est. memory≈ 3.5 GB | ollama run qwen2.5:3b-instruct-q4_0 |
| 3b-instruct-q4_1 | Typelocal | Inputstext | Digestc8aefde2cd4f | Download2.0 GB | Parameters3b | QuantizationQ4_1 | Context32K | Est. memory≈ 3.5 GB | ollama run qwen2.5:3b-instruct-q4_1 |
| 3b-instruct-q4_K_M | Typelocal | Inputstext | Digest357c53fb659c | Download1.9 GB | Parameters3b | QuantizationQ4_K_M | Context32K | Est. memory≈ 3.5 GB | ollama run qwen2.5:3b-instruct-q4_K_M |
| 3b-instruct-q4_K_S | Typelocal | Inputstext | Digest3033a0ab2cfd | Download1.8 GB | Parameters3b | QuantizationQ4_K_S | Context32K | Est. memory≈ 3.5 GB | ollama run qwen2.5:3b-instruct-q4_K_S |
| 3b-instruct-q5_0 | Typelocal | Inputstext | Digestf2c8c51a4c62 | Download2.2 GB | Parameters3b | QuantizationQ5_0 | Context32K | Est. memory≈ 3.5 GB | ollama run qwen2.5:3b-instruct-q5_0 |
| 3b-instruct-q5_1 | Typelocal | Inputstext | Digestc7e5301cb49e | Download2.3 GB | Parameters3b | QuantizationQ5_1 | Context32K | Est. memory≈ 4 GB | ollama run qwen2.5:3b-instruct-q5_1 |
| 3b-instruct-q5_K_M | Typelocal | Inputstext | Digest19cf317bd479 | Download2.2 GB | Parameters3b | QuantizationQ5_K_M | Context32K | Est. memory≈ 3.5 GB | ollama run qwen2.5:3b-instruct-q5_K_M |
| 3b-instruct-q5_K_S | Typelocal | Inputstext | Digest8ce4b148557a | Download2.2 GB | Parameters3b | QuantizationQ5_K_S | Context32K | Est. memory≈ 3.5 GB | ollama run qwen2.5:3b-instruct-q5_K_S |
| 3b-instruct-q6_K | Typelocal | Inputstext | Digest9f78f7728716 | Download2.5 GB | Parameters3b | QuantizationQ6_K | Context32K | Est. memory≈ 4 GB | ollama run qwen2.5:3b-instruct-q6_K |
| 3b-instruct-q8_0 | Typelocal | Inputstext | Digestcd6aa8b25d7a | Download3.3 GB | Parameters3b | QuantizationQ8_0 | Context32K | Est. memory≈ 5 GB | ollama run qwen2.5:3b-instruct-q8_0 |
| 72b | Typelocal | Inputstext | Digest424bad2cc13f | Download47 GB | Parameters72b | QuantizationUnknown | Context32K | Est. memory≈ 54 GB | ollama run qwen2.5:72b |
| 72b-instruct | Typelocal | Inputstext | Digest424bad2cc13f | Download47 GB | Parameters72b | QuantizationUnknown | Context32K | Est. memory≈ 54 GB | ollama run qwen2.5:72b-instruct |
| 72b-instruct-fp16 | Typelocal | Inputstext | Digest754bbe314ad4 | Download145 GB | Parameters72b | QuantizationFP16 | Context32K | Est. memory≈ 163.5 GB | ollama run qwen2.5:72b-instruct-fp16 |
| 72b-instruct-q2_K | Typelocal | Inputstext | Digestd072709cc1a8 | Download30 GB | Parameters72b | QuantizationQ2_K | Context32K | Est. memory≈ 35 GB | ollama run qwen2.5:72b-instruct-q2_K |
| 72b-instruct-q3_K_L | Typelocal | Inputstext | Digestc3f33d2ad20a | Download40 GB | Parameters72b | QuantizationQ3_K_L | Context32K | Est. memory≈ 46 GB | ollama run qwen2.5:72b-instruct-q3_K_L |
| 72b-instruct-q3_K_M | Typelocal | Inputstext | Digest15abb3b7022f | Download38 GB | Parameters72b | QuantizationQ3_K_M | Context32K | Est. memory≈ 43.5 GB | ollama run qwen2.5:72b-instruct-q3_K_M |
| 72b-instruct-q3_K_S | Typelocal | Inputstext | Digest6fcfede9cc1c | Download34 GB | Parameters72b | QuantizationQ3_K_S | Context32K | Est. memory≈ 39 GB | ollama run qwen2.5:72b-instruct-q3_K_S |
| 72b-instruct-q4_0 | Typelocal | Inputstext | Digest2dd03ae27777 | Download41 GB | Parameters72b | QuantizationQ4_0 | Context32K | Est. memory≈ 47 GB | ollama run qwen2.5:72b-instruct-q4_0 |
| 72b-instruct-q4_1 | Typelocal | Inputstext | Digestbcf8fafd0731 | Download46 GB | Parameters72b | QuantizationQ4_1 | Context32K | Est. memory≈ 52.5 GB | ollama run qwen2.5:72b-instruct-q4_1 |
| 72b-instruct-q4_K_M | Typelocal | Inputstext | Digest424bad2cc13f | Download47 GB | Parameters72b | QuantizationQ4_K_M | Context32K | Est. memory≈ 54 GB | ollama run qwen2.5:72b-instruct-q4_K_M |
| 72b-instruct-q4_K_S | Typelocal | Inputstext | Digesta4520526d819 | Download44 GB | Parameters72b | QuantizationQ4_K_S | Context32K | Est. memory≈ 50.5 GB | ollama run qwen2.5:72b-instruct-q4_K_S |
| 72b-instruct-q5_0 | Typelocal | Inputstext | Digest7a43bbfe6536 | Download50 GB | Parameters72b | QuantizationQ5_0 | Context32K | Est. memory≈ 57 GB | ollama run qwen2.5:72b-instruct-q5_0 |
| 72b-instruct-q5_1 | Typelocal | Inputstext | Digest40630a45532c | Download55 GB | Parameters72b | QuantizationQ5_1 | Context32K | Est. memory≈ 62.5 GB | ollama run qwen2.5:72b-instruct-q5_1 |
| 72b-instruct-q5_K_M | Typelocal | Inputstext | Digest210a146b67de | Download54 GB | Parameters72b | QuantizationQ5_K_M | Context32K | Est. memory≈ 61.5 GB | ollama run qwen2.5:72b-instruct-q5_K_M |
| 72b-instruct-q5_K_S | Typelocal | Inputstext | Digestee3ecbad0795 | Download51 GB | Parameters72b | QuantizationQ5_K_S | Context32K | Est. memory≈ 58 GB | ollama run qwen2.5:72b-instruct-q5_K_S |
| 72b-instruct-q6_K | Typelocal | Inputstext | Digest5f611a49224d | Download64 GB | Parameters72b | QuantizationQ6_K | Context32K | Est. memory≈ 73 GB | ollama run qwen2.5:72b-instruct-q6_K |
| 72b-instruct-q8_0 | Typelocal | Inputstext | Digest23f2cb48bb9a | Download77 GB | Parameters72b | QuantizationQ8_0 | Context32K | Est. memory≈ 87.5 GB | ollama run qwen2.5:72b-instruct-q8_0 |
| 7b | Typelocal | Inputstext | Digest845dbda0ea48 | Download4.7 GB | Parameters7b | QuantizationUnknown | Context32K | Est. memory≈ 6.5 GB | ollama run qwen2.5:7b |
| 7b-instruct | Typelocal | Inputstext | Digest845dbda0ea48 | Download4.7 GB | Parameters7b | QuantizationUnknown | Context32K | Est. memory≈ 6.5 GB | ollama run qwen2.5:7b-instruct |
| 7b-instruct-fp16 | Typelocal | Inputstext | Digest59805ce4a404 | Download15 GB | Parameters7b | QuantizationFP16 | Context32K | Est. memory≈ 18 GB | ollama run qwen2.5:7b-instruct-fp16 |
| 7b-instruct-q2_K | Typelocal | Inputstext | Digest94ac6d14b93f | Download3.0 GB | Parameters7b | QuantizationQ2_K | Context32K | Est. memory≈ 4.5 GB | ollama run qwen2.5:7b-instruct-q2_K |
| 7b-instruct-q3_K_L | Typelocal | Inputstext | Digest6ed3506191d1 | Download4.1 GB | Parameters7b | QuantizationQ3_K_L | Context32K | Est. memory≈ 6 GB | ollama run qwen2.5:7b-instruct-q3_K_L |
| 7b-instruct-q3_K_M | Typelocal | Inputstext | Digest29492a928341 | Download3.8 GB | Parameters7b | QuantizationQ3_K_M | Context32K | Est. memory≈ 5.5 GB | ollama run qwen2.5:7b-instruct-q3_K_M |
| 7b-instruct-q3_K_S | Typelocal | Inputstext | Digest05d9cc3116db | Download3.5 GB | Parameters7b | QuantizationQ3_K_S | Context32K | Est. memory≈ 5 GB | ollama run qwen2.5:7b-instruct-q3_K_S |
| 7b-instruct-q4_0 | Typelocal | Inputstext | Digest2e92ac0dd3a8 | Download4.4 GB | Parameters7b | QuantizationQ4_0 | Context32K | Est. memory≈ 6 GB | ollama run qwen2.5:7b-instruct-q4_0 |
| 7b-instruct-q4_1 | Typelocal | Inputstext | Digest840e00017aa6 | Download4.9 GB | Parameters7b | QuantizationQ4_1 | Context32K | Est. memory≈ 6.5 GB | ollama run qwen2.5:7b-instruct-q4_1 |
| 7b-instruct-q4_K_M | Typelocal | Inputstext | Digest845dbda0ea48 | Download4.7 GB | Parameters7b | QuantizationQ4_K_M | Context32K | Est. memory≈ 6.5 GB | ollama run qwen2.5:7b-instruct-q4_K_M |
| 7b-instruct-q4_K_S | Typelocal | Inputstext | Digestd572758f0ffe | Download4.5 GB | Parameters7b | QuantizationQ4_K_S | Context32K | Est. memory≈ 6.5 GB | ollama run qwen2.5:7b-instruct-q4_K_S |
| 7b-instruct-q5_0 | Typelocal | Inputstext | Digest16c4cf552635 | Download5.3 GB | Parameters7b | QuantizationQ5_0 | Context32K | Est. memory≈ 7 GB | ollama run qwen2.5:7b-instruct-q5_0 |
| 7b-instruct-q5_1 | Typelocal | Inputstext | Digest0f1627cf5764 | Download5.8 GB | Parameters7b | QuantizationQ5_1 | Context32K | Est. memory≈ 7.5 GB | ollama run qwen2.5:7b-instruct-q5_1 |
| 7b-instruct-q5_K_M | Typelocal | Inputstext | Digesta1040ddd2b49 | Download5.4 GB | Parameters7b | QuantizationQ5_K_M | Context32K | Est. memory≈ 7.5 GB | ollama run qwen2.5:7b-instruct-q5_K_M |
| 7b-instruct-q5_K_S | Typelocal | Inputstext | Digest1a3492b0a1dc | Download5.3 GB | Parameters7b | QuantizationQ5_K_S | Context32K | Est. memory≈ 7 GB | ollama run qwen2.5:7b-instruct-q5_K_S |
| 7b-instruct-q6_K | Typelocal | Inputstext | Digesta7e494737d58 | Download6.3 GB | Parameters7b | QuantizationQ6_K | Context32K | Est. memory≈ 8.5 GB | ollama run qwen2.5:7b-instruct-q6_K |
| 7b-instruct-q8_0 | Typelocal | Inputstext | Digest2d9500c94841 | Download8.1 GB | Parameters7b | QuantizationQ8_0 | Context32K | Est. memory≈ 10.5 GB | ollama run qwen2.5:7b-instruct-q8_0 |
| latestdefault | Typelocal | Inputstext | Digest845dbda0ea48 | Download4.7 GB | ParametersUnknown | QuantizationUnknown | Context32K | Est. memory≈ 6.5 GB | ollama run qwen2.5:latest |
Source-listed applications
Related models
The latest series of Code-Specific Qwen models, with significant improvements in code generation, code reasoning, and code fixing.
Qwen2 is a new series of large language models from Alibaba group
Granite 4 features improved instruction following (IF) and tool-calling capabilities, making them more effective in enterprise applications.
The IBM Granite 1B and 3B models are the first mixture of experts (MoE) Granite models from IBM designed for low latency usage.