Quick start
ollama run phi3.5:latestRunnable variants
Memory is a rough file-size estimate; context length, runtime and GPU offload change it.
12 of 17 matching variants shown.17 of 17 variants shown.
| Tag | Type | Inputs | Digest | Download | Parameters | Quantization | Context | Est. memory | Run |
|---|---|---|---|---|---|---|---|---|---|
| 3.8b | Typelocal | Inputstext | Digest61819fb370a3 | Download2.2 GB | Parameters3.8b | QuantizationUnknown | Context128K | Est. memory≈ 3.5 GB | ollama run phi3.5:3.8b |
| 3.8b-mini-instruct-fp16 | Typelocal | Inputstext | Digest4611ed13d496 | Download7.6 GB | Parameters3.8b | QuantizationFP16 | Context4K | Est. memory≈ 9.5 GB | ollama run phi3.5:3.8b-mini-instruct-fp16 |
| 3.8b-mini-instruct-q2_K | Typelocal | Inputstext | Digest45b8dc82a846 | Download1.4 GB | Parameters3.8b | QuantizationQ2_K | Context4K | Est. memory≈ 3 GB | ollama run phi3.5:3.8b-mini-instruct-q2_K |
| 3.8b-mini-instruct-q3_K_L | Typelocal | Inputstext | Digest1a0c69ceca7c | Download2.1 GB | Parameters3.8b | QuantizationQ3_K_L | Context4K | Est. memory≈ 3.5 GB | ollama run phi3.5:3.8b-mini-instruct-q3_K_L |
| 3.8b-mini-instruct-q3_K_M | Typelocal | Inputstext | Digest0d7837063f04 | Download2.0 GB | Parameters3.8b | QuantizationQ3_K_M | Context4K | Est. memory≈ 3.5 GB | ollama run phi3.5:3.8b-mini-instruct-q3_K_M |
| 3.8b-mini-instruct-q3_K_S | Typelocal | Inputstext | Digesta96deac0d01a | Download1.7 GB | Parameters3.8b | QuantizationQ3_K_S | Context4K | Est. memory≈ 3 GB | ollama run phi3.5:3.8b-mini-instruct-q3_K_S |
| 3.8b-mini-instruct-q4_0 | Typelocal | Inputstext | Digest61819fb370a3 | Download2.2 GB | Parameters3.8b | QuantizationQ4_0 | Context128K | Est. memory≈ 3.5 GB | ollama run phi3.5:3.8b-mini-instruct-q4_0 |
| 3.8b-mini-instruct-q4_1 | Typelocal | Inputstext | Digest4cbfba8563ff | Download2.4 GB | Parameters3.8b | QuantizationQ4_1 | Context4K | Est. memory≈ 4 GB | ollama run phi3.5:3.8b-mini-instruct-q4_1 |
| 3.8b-mini-instruct-q4_K_M | Typelocal | Inputstext | Digest570961596984 | Download2.4 GB | Parameters3.8b | QuantizationQ4_K_M | Context4K | Est. memory≈ 4 GB | ollama run phi3.5:3.8b-mini-instruct-q4_K_M |
| 3.8b-mini-instruct-q4_K_S | Typelocal | Inputstext | Digest593801e5a118 | Download2.2 GB | Parameters3.8b | QuantizationQ4_K_S | Context4K | Est. memory≈ 3.5 GB | ollama run phi3.5:3.8b-mini-instruct-q4_K_S |
| 3.8b-mini-instruct-q5_0 | Typelocal | Inputstext | Digest08d2a846d344 | Download2.6 GB | Parameters3.8b | QuantizationQ5_0 | Context4K | Est. memory≈ 4 GB | ollama run phi3.5:3.8b-mini-instruct-q5_0 |
| 3.8b-mini-instruct-q5_1 | Typelocal | Inputstext | Digest56d7624b988b | Download2.9 GB | Parameters3.8b | QuantizationQ5_1 | Context4K | Est. memory≈ 4.5 GB | ollama run phi3.5:3.8b-mini-instruct-q5_1 |
| 3.8b-mini-instruct-q5_K_M | Typelocal | Inputstext | Digestd8410edb4013 | Download2.8 GB | Parameters3.8b | QuantizationQ5_K_M | Context4K | Est. memory≈ 4.5 GB | ollama run phi3.5:3.8b-mini-instruct-q5_K_M |
| 3.8b-mini-instruct-q5_K_S | Typelocal | Inputstext | Digest359cb1eb71b5 | Download2.6 GB | Parameters3.8b | QuantizationQ5_K_S | Context4K | Est. memory≈ 4 GB | ollama run phi3.5:3.8b-mini-instruct-q5_K_S |
| 3.8b-mini-instruct-q6_K | Typelocal | Inputstext | Digest64777e5c6803 | Download3.1 GB | Parameters3.8b | QuantizationQ6_K | Context4K | Est. memory≈ 4.5 GB | ollama run phi3.5:3.8b-mini-instruct-q6_K |
| 3.8b-mini-instruct-q8_0 | Typelocal | Inputstext | Digest8b50e8e1e216 | Download4.1 GB | Parameters3.8b | QuantizationQ8_0 | Context4K | Est. memory≈ 6 GB | ollama run phi3.5:3.8b-mini-instruct-q8_0 |
| latestdefault | Typelocal | Inputstext | Digest61819fb370a3 | Download2.2 GB | ParametersUnknown | QuantizationUnknown | Context128K | Est. memory≈ 3.5 GB | ollama run phi3.5:latest |
Related models
phi3local
Phi-3 is a family of lightweight 3B (Mini) and 14B (Medium) state-of-the-art open models by Microsoft.
hermes3local
Hermes 3 is the latest version of the flagship Hermes series of LLMs by Nous Research
opencoderlocal
OpenCoder is an open and reproducible code LLM family which includes 1.5B and 8B models, supporting chat in English and Chinese languages.
nuextractlocal
A 3.8B model fine-tuned on a private high-quality synthetic dataset for information extraction, based on Phi-3.