Quick start

ollama run phi3:latest

Runnable variants

Memory is a rough file-size estimate; context length, runtime and GPU offload change it.

12 of 72 matching variants shown.72 of 72 variants shown.

Tag	Type	Inputs	Digest	Download	Parameters	Quantization	Context	Est. memory	Run
14b	Typelocal	Inputstext	Digestcf611a26b048	Download7.9 GB	Parameters14b	QuantizationUnknown	Context128K	Est. memory≈ 10 GB	`ollama run phi3:14b`
14b-instruct	Typelocal	Inputstext	Digestcf611a26b048	Download7.9 GB	Parameters14b	QuantizationUnknown	Context128K	Est. memory≈ 10 GB	`ollama run phi3:14b-instruct`
14b-medium-128k-instruct-fp16	Typelocal	Inputstext	Digestab0d71a0814b	Download28 GB	Parameters14b	QuantizationFP16	Context4K	Est. memory≈ 32.5 GB	`ollama run phi3:14b-medium-128k-instruct-fp16`
14b-medium-128k-instruct-q2_K	Typelocal	Inputstext	Digest94ce47285859	Download5.1 GB	Parameters14b	QuantizationQ2_K	Context4K	Est. memory≈ 7 GB	`ollama run phi3:14b-medium-128k-instruct-q2_K`
14b-medium-128k-instruct-q3_K_L	Typelocal	Inputstext	Digest214c9ceb5140	Download7.5 GB	Parameters14b	QuantizationQ3_K_L	Context4K	Est. memory≈ 9.5 GB	`ollama run phi3:14b-medium-128k-instruct-q3_K_L`
14b-medium-128k-instruct-q3_K_M	Typelocal	Inputstext	Digestb0a6824d6ba9	Download6.9 GB	Parameters14b	QuantizationQ3_K_M	Context4K	Est. memory≈ 9 GB	`ollama run phi3:14b-medium-128k-instruct-q3_K_M`
14b-medium-128k-instruct-q3_K_S	Typelocal	Inputstext	Digest2538a4dd560c	Download6.1 GB	Parameters14b	QuantizationQ3_K_S	Context4K	Est. memory≈ 8 GB	`ollama run phi3:14b-medium-128k-instruct-q3_K_S`
14b-medium-128k-instruct-q4_0	Typelocal	Inputstext	Digestcf611a26b048	Download7.9 GB	Parameters14b	QuantizationQ4_0	Context128K	Est. memory≈ 10 GB	`ollama run phi3:14b-medium-128k-instruct-q4_0`
14b-medium-128k-instruct-q4_1	Typelocal	Inputstext	Digest92a08305e23f	Download8.8 GB	Parameters14b	QuantizationQ4_1	Context4K	Est. memory≈ 11 GB	`ollama run phi3:14b-medium-128k-instruct-q4_1`
14b-medium-128k-instruct-q4_K_M	Typelocal	Inputstext	Digest1372226c9b0b	Download8.6 GB	Parameters14b	QuantizationQ4_K_M	Context4K	Est. memory≈ 11 GB	`ollama run phi3:14b-medium-128k-instruct-q4_K_M`
14b-medium-128k-instruct-q4_K_S	Typelocal	Inputstext	Digest7a0ee8ddd91b	Download8.0 GB	Parameters14b	QuantizationQ4_K_S	Context4K	Est. memory≈ 10 GB	`ollama run phi3:14b-medium-128k-instruct-q4_K_S`
14b-medium-128k-instruct-q5_0	Typelocal	Inputstext	Digest87d42cf3a64b	Download9.6 GB	Parameters14b	QuantizationQ5_0	Context4K	Est. memory≈ 12 GB	`ollama run phi3:14b-medium-128k-instruct-q5_0`
14b-medium-128k-instruct-q5_1	Typelocal	Inputstext	Digest06195d5c378a	Download10 GB	Parameters14b	QuantizationQ5_1	Context4K	Est. memory≈ 12.5 GB	`ollama run phi3:14b-medium-128k-instruct-q5_1`
14b-medium-128k-instruct-q5_K_M	Typelocal	Inputstext	Digest0d45fefe05bb	Download10 GB	Parameters14b	QuantizationQ5_K_M	Context4K	Est. memory≈ 12.5 GB	`ollama run phi3:14b-medium-128k-instruct-q5_K_M`
14b-medium-128k-instruct-q5_K_S	Typelocal	Inputstext	Digest85a94efb79c6	Download9.6 GB	Parameters14b	QuantizationQ5_K_S	Context4K	Est. memory≈ 12 GB	`ollama run phi3:14b-medium-128k-instruct-q5_K_S`
14b-medium-128k-instruct-q6_K	Typelocal	Inputstext	Digest3aa42cb65da9	Download11 GB	Parameters14b	QuantizationQ6_K	Context4K	Est. memory≈ 13.5 GB	`ollama run phi3:14b-medium-128k-instruct-q6_K`
14b-medium-128k-instruct-q8_0	Typelocal	Inputstext	Digestf1d91573aa38	Download15 GB	Parameters14b	QuantizationQ8_0	Context4K	Est. memory≈ 18 GB	`ollama run phi3:14b-medium-128k-instruct-q8_0`
14b-medium-4k-instruct-fp16	Typelocal	Inputstext	Digestb8af0a87fe3b	Download28 GB	Parameters14b	QuantizationFP16	Context4K	Est. memory≈ 32.5 GB	`ollama run phi3:14b-medium-4k-instruct-fp16`
14b-medium-4k-instruct-q2_K	Typelocal	Inputstext	Digest1d0b237ac0c0	Download5.1 GB	Parameters14b	QuantizationQ2_K	Context4K	Est. memory≈ 7 GB	`ollama run phi3:14b-medium-4k-instruct-q2_K`
14b-medium-4k-instruct-q3_K_L	Typelocal	Inputstext	Digest8c89f02e74e7	Download7.5 GB	Parameters14b	QuantizationQ3_K_L	Context4K	Est. memory≈ 9.5 GB	`ollama run phi3:14b-medium-4k-instruct-q3_K_L`
14b-medium-4k-instruct-q3_K_M	Typelocal	Inputstext	Digestb44869982901	Download6.9 GB	Parameters14b	QuantizationQ3_K_M	Context4K	Est. memory≈ 9 GB	`ollama run phi3:14b-medium-4k-instruct-q3_K_M`
14b-medium-4k-instruct-q3_K_S	Typelocal	Inputstext	Digest1d8e8b16704d	Download6.1 GB	Parameters14b	QuantizationQ3_K_S	Context4K	Est. memory≈ 8 GB	`ollama run phi3:14b-medium-4k-instruct-q3_K_S`
14b-medium-4k-instruct-q4_0	Typelocal	Inputstext	Digest325e47441f3f	Download7.9 GB	Parameters14b	QuantizationQ4_0	Context4K	Est. memory≈ 10 GB	`ollama run phi3:14b-medium-4k-instruct-q4_0`
14b-medium-4k-instruct-q4_1	Typelocal	Inputstext	Digest7e56b73c5446	Download8.8 GB	Parameters14b	QuantizationQ4_1	Context4K	Est. memory≈ 11 GB	`ollama run phi3:14b-medium-4k-instruct-q4_1`
14b-medium-4k-instruct-q4_K_M	Typelocal	Inputstext	Digest4de15128ef23	Download8.6 GB	Parameters14b	QuantizationQ4_K_M	Context4K	Est. memory≈ 11 GB	`ollama run phi3:14b-medium-4k-instruct-q4_K_M`
14b-medium-4k-instruct-q4_K_S	Typelocal	Inputstext	Digest98b4f4a2f662	Download8.0 GB	Parameters14b	QuantizationQ4_K_S	Context4K	Est. memory≈ 10 GB	`ollama run phi3:14b-medium-4k-instruct-q4_K_S`
14b-medium-4k-instruct-q5_0	Typelocal	Inputstext	Digest621f05f2d49e	Download9.6 GB	Parameters14b	QuantizationQ5_0	Context4K	Est. memory≈ 12 GB	`ollama run phi3:14b-medium-4k-instruct-q5_0`
14b-medium-4k-instruct-q5_1	Typelocal	Inputstext	Digestd7fd9927e592	Download10 GB	Parameters14b	QuantizationQ5_1	Context4K	Est. memory≈ 12.5 GB	`ollama run phi3:14b-medium-4k-instruct-q5_1`
14b-medium-4k-instruct-q5_K_M	Typelocal	Inputstext	Digest44aec5aa964d	Download10 GB	Parameters14b	QuantizationQ5_K_M	Context4K	Est. memory≈ 12.5 GB	`ollama run phi3:14b-medium-4k-instruct-q5_K_M`
14b-medium-4k-instruct-q5_K_S	Typelocal	Inputstext	Digest0efda84af8ae	Download9.6 GB	Parameters14b	QuantizationQ5_K_S	Context4K	Est. memory≈ 12 GB	`ollama run phi3:14b-medium-4k-instruct-q5_K_S`
14b-medium-4k-instruct-q6_K	Typelocal	Inputstext	Digest8d6899ff682b	Download11 GB	Parameters14b	QuantizationQ6_K	Context4K	Est. memory≈ 13.5 GB	`ollama run phi3:14b-medium-4k-instruct-q6_K`
14b-medium-4k-instruct-q8_0	Typelocal	Inputstext	Digest87e27f01007b	Download15 GB	Parameters14b	QuantizationQ8_0	Context4K	Est. memory≈ 18 GB	`ollama run phi3:14b-medium-4k-instruct-q8_0`
3.8b	Typelocal	Inputstext	Digest4f2222927938	Download2.2 GB	Parameters3.8b	QuantizationUnknown	Context128K	Est. memory≈ 3.5 GB	`ollama run phi3:3.8b`
3.8b-instruct	Typelocal	Inputstext	Digest4f2222927938	Download2.2 GB	Parameters3.8b	QuantizationUnknown	Context128K	Est. memory≈ 3.5 GB	`ollama run phi3:3.8b-instruct`
3.8b-mini-128k-instruct-fp16	Typelocal	Inputstext	Digest40010fd60dc7	Download7.6 GB	Parameters3.8b	QuantizationFP16	Context4K	Est. memory≈ 9.5 GB	`ollama run phi3:3.8b-mini-128k-instruct-fp16`
3.8b-mini-128k-instruct-q2_K	Typelocal	Inputstext	Digest0dc429b5761b	Download1.4 GB	Parameters3.8b	QuantizationQ2_K	Context4K	Est. memory≈ 3 GB	`ollama run phi3:3.8b-mini-128k-instruct-q2_K`
3.8b-mini-128k-instruct-q3_K_L	Typelocal	Inputstext	Digest58dabb8dab6e	Download2.1 GB	Parameters3.8b	QuantizationQ3_K_L	Context4K	Est. memory≈ 3.5 GB	`ollama run phi3:3.8b-mini-128k-instruct-q3_K_L`
3.8b-mini-128k-instruct-q3_K_M	Typelocal	Inputstext	Digestbf51ffbfc6fd	Download2.0 GB	Parameters3.8b	QuantizationQ3_K_M	Context4K	Est. memory≈ 3.5 GB	`ollama run phi3:3.8b-mini-128k-instruct-q3_K_M`
3.8b-mini-128k-instruct-q3_K_S	Typelocal	Inputstext	Digestb867d0390a90	Download1.7 GB	Parameters3.8b	QuantizationQ3_K_S	Context4K	Est. memory≈ 3 GB	`ollama run phi3:3.8b-mini-128k-instruct-q3_K_S`
3.8b-mini-128k-instruct-q4_0	Typelocal	Inputstext	Digest4f2222927938	Download2.2 GB	Parameters3.8b	QuantizationQ4_0	Context128K	Est. memory≈ 3.5 GB	`ollama run phi3:3.8b-mini-128k-instruct-q4_0`
3.8b-mini-128k-instruct-q4_1	Typelocal	Inputstext	Digest7ed2c3a2024e	Download2.4 GB	Parameters3.8b	QuantizationQ4_1	Context4K	Est. memory≈ 4 GB	`ollama run phi3:3.8b-mini-128k-instruct-q4_1`
3.8b-mini-128k-instruct-q4_K_M	Typelocal	Inputstext	Digest5a157c52afff	Download2.4 GB	Parameters3.8b	QuantizationQ4_K_M	Context4K	Est. memory≈ 4 GB	`ollama run phi3:3.8b-mini-128k-instruct-q4_K_M`
3.8b-mini-128k-instruct-q4_K_S	Typelocal	Inputstext	Digest786fb198d976	Download2.2 GB	Parameters3.8b	QuantizationQ4_K_S	Context4K	Est. memory≈ 3.5 GB	`ollama run phi3:3.8b-mini-128k-instruct-q4_K_S`
3.8b-mini-128k-instruct-q5_0	Typelocal	Inputstext	Digest68e0cbe0eb8a	Download2.6 GB	Parameters3.8b	QuantizationQ5_0	Context128K	Est. memory≈ 4 GB	`ollama run phi3:3.8b-mini-128k-instruct-q5_0`
3.8b-mini-128k-instruct-q5_1	Typelocal	Inputstext	Digest7ccd40684bd5	Download2.9 GB	Parameters3.8b	QuantizationQ5_1	Context4K	Est. memory≈ 4.5 GB	`ollama run phi3:3.8b-mini-128k-instruct-q5_1`
3.8b-mini-128k-instruct-q5_K_M	Typelocal	Inputstext	Digestffbd0ae55416	Download2.8 GB	Parameters3.8b	QuantizationQ5_K_M	Context4K	Est. memory≈ 4.5 GB	`ollama run phi3:3.8b-mini-128k-instruct-q5_K_M`
3.8b-mini-128k-instruct-q5_K_S	Typelocal	Inputstext	Digest86b1e7aa6fd8	Download2.6 GB	Parameters3.8b	QuantizationQ5_K_S	Context4K	Est. memory≈ 4 GB	`ollama run phi3:3.8b-mini-128k-instruct-q5_K_S`
3.8b-mini-128k-instruct-q6_K	Typelocal	Inputstext	Digest90771235c599	Download3.1 GB	Parameters3.8b	QuantizationQ6_K	Context4K	Est. memory≈ 4.5 GB	`ollama run phi3:3.8b-mini-128k-instruct-q6_K`
3.8b-mini-128k-instruct-q8_0	Typelocal	Inputstext	Digestadc0589ce82e	Download4.1 GB	Parameters3.8b	QuantizationQ8_0	Context4K	Est. memory≈ 6 GB	`ollama run phi3:3.8b-mini-128k-instruct-q8_0`
3.8b-mini-4k-instruct-fp16	Typelocal	Inputstext	Digestd2a1bcb6ea9d	Download7.6 GB	Parameters3.8b	QuantizationFP16	Context4K	Est. memory≈ 9.5 GB	`ollama run phi3:3.8b-mini-4k-instruct-fp16`
3.8b-mini-4k-instruct-q2_K	Typelocal	Inputstext	Digestf71db22ea23b	Download1.4 GB	Parameters3.8b	QuantizationQ2_K	Context4K	Est. memory≈ 3 GB	`ollama run phi3:3.8b-mini-4k-instruct-q2_K`
3.8b-mini-4k-instruct-q3_K_L	Typelocal	Inputstext	Digest7b07bdbff049	Download2.1 GB	Parameters3.8b	QuantizationQ3_K_L	Context4K	Est. memory≈ 3.5 GB	`ollama run phi3:3.8b-mini-4k-instruct-q3_K_L`
3.8b-mini-4k-instruct-q3_K_M	Typelocal	Inputstext	Digest9971a6367aaa	Download2.0 GB	Parameters3.8b	QuantizationQ3_K_M	Context4K	Est. memory≈ 3.5 GB	`ollama run phi3:3.8b-mini-4k-instruct-q3_K_M`
3.8b-mini-4k-instruct-q3_K_S	Typelocal	Inputstext	Digest71d5c0da0a45	Download1.7 GB	Parameters3.8b	QuantizationQ3_K_S	Context4K	Est. memory≈ 3 GB	`ollama run phi3:3.8b-mini-4k-instruct-q3_K_S`
3.8b-mini-4k-instruct-q4_0	Typelocal	Inputstext	Digest9e6804ea5320	Download2.2 GB	Parameters3.8b	QuantizationQ4_0	Context4K	Est. memory≈ 3.5 GB	`ollama run phi3:3.8b-mini-4k-instruct-q4_0`
3.8b-mini-4k-instruct-q4_1	Typelocal	Inputstext	Digestce621d0c2d06	Download2.4 GB	Parameters3.8b	QuantizationQ4_1	Context4K	Est. memory≈ 4 GB	`ollama run phi3:3.8b-mini-4k-instruct-q4_1`
3.8b-mini-4k-instruct-q4_K_M	Typelocal	Inputstext	Digestd5ea514251bf	Download2.4 GB	Parameters3.8b	QuantizationQ4_K_M	Context4K	Est. memory≈ 4 GB	`ollama run phi3:3.8b-mini-4k-instruct-q4_K_M`
3.8b-mini-4k-instruct-q4_K_S	Typelocal	Inputstext	Digest3a368186663f	Download2.2 GB	Parameters3.8b	QuantizationQ4_K_S	Context4K	Est. memory≈ 3.5 GB	`ollama run phi3:3.8b-mini-4k-instruct-q4_K_S`
3.8b-mini-4k-instruct-q5_0	Typelocal	Inputstext	Digestdf35ca8fb243	Download2.6 GB	Parameters3.8b	QuantizationQ5_0	Context4K	Est. memory≈ 4 GB	`ollama run phi3:3.8b-mini-4k-instruct-q5_0`
3.8b-mini-4k-instruct-q5_1	Typelocal	Inputstext	Digest416e85af3eae	Download2.9 GB	Parameters3.8b	QuantizationQ5_1	Context4K	Est. memory≈ 4.5 GB	`ollama run phi3:3.8b-mini-4k-instruct-q5_1`
3.8b-mini-4k-instruct-q5_K_M	Typelocal	Inputstext	Digesta902ed3435bb	Download2.8 GB	Parameters3.8b	QuantizationQ5_K_M	Context4K	Est. memory≈ 4.5 GB	`ollama run phi3:3.8b-mini-4k-instruct-q5_K_M`
3.8b-mini-4k-instruct-q5_K_S	Typelocal	Inputstext	Digest2f614430e421	Download2.6 GB	Parameters3.8b	QuantizationQ5_K_S	Context4K	Est. memory≈ 4 GB	`ollama run phi3:3.8b-mini-4k-instruct-q5_K_S`
3.8b-mini-4k-instruct-q6_K	Typelocal	Inputstext	Digestbbae7edc39d4	Download3.1 GB	Parameters3.8b	QuantizationQ6_K	Context4K	Est. memory≈ 4.5 GB	`ollama run phi3:3.8b-mini-4k-instruct-q6_K`
3.8b-mini-4k-instruct-q8_0	Typelocal	Inputstext	Digest6b7f8cbb8b25	Download4.1 GB	Parameters3.8b	QuantizationQ8_0	Context4K	Est. memory≈ 6 GB	`ollama run phi3:3.8b-mini-4k-instruct-q8_0`
instruct	Typelocal	Inputstext	Digest4f2222927938	Download2.2 GB	ParametersUnknown	QuantizationUnknown	Context128K	Est. memory≈ 3.5 GB	`ollama run phi3:instruct`
latestdefault	Typelocal	Inputstext	Digest4f2222927938	Download2.2 GB	ParametersUnknown	QuantizationUnknown	Context128K	Est. memory≈ 3.5 GB	`ollama run phi3:latest`
medium	Typelocal	Inputstext	Digestcf611a26b048	Download7.9 GB	ParametersUnknown	QuantizationUnknown	Context128K	Est. memory≈ 10 GB	`ollama run phi3:medium`
medium-128k	Typelocal	Inputstext	Digestcf611a26b048	Download7.9 GB	ParametersUnknown	QuantizationUnknown	Context128K	Est. memory≈ 10 GB	`ollama run phi3:medium-128k`
medium-4k	Typelocal	Inputstext	Digest325e47441f3f	Download7.9 GB	ParametersUnknown	QuantizationUnknown	Context4K	Est. memory≈ 10 GB	`ollama run phi3:medium-4k`
mini	Typelocal	Inputstext	Digest4f2222927938	Download2.2 GB	ParametersUnknown	QuantizationUnknown	Context128K	Est. memory≈ 3.5 GB	`ollama run phi3:mini`
mini-128k	Typelocal	Inputstext	Digest4f2222927938	Download2.2 GB	ParametersUnknown	QuantizationUnknown	Context128K	Est. memory≈ 3.5 GB	`ollama run phi3:mini-128k`
mini-4k	Typelocal	Inputstext	Digestd5ea514251bf	Download2.4 GB	ParametersUnknown	QuantizationUnknown	Context4K	Est. memory≈ 4 GB	`ollama run phi3:mini-4k`

Related models

hermes3local

Hermes 3 is the latest version of the flagship Hermes series of LLMs by Nous Research

phi3.5local

A lightweight AI model with 3.8 billion parameters with performance overtaking similarly and larger sized models.

opencoderlocal

OpenCoder is an open and reproducible code LLM family which includes 1.5B and 8B models, supporting chat in English and Chinese languages.

nuextractlocal

A 3.8B model fine-tuned on a private high-quality synthetic dataset for information extraction, based on Phi-3.