Quick start

ollama run phi:latest

Runnable variants

Memory is a rough file-size estimate; context length, runtime and GPU offload change it.

12 of 18 matching variants shown.18 of 18 variants shown.

Tag	Type	Inputs	Digest	Download	Parameters	Quantization	Context	Est. memory	Run
2.7b	Typelocal	Inputstext	Digeste2fd6321a5fe	Download1.6 GB	Parameters2.7b	QuantizationUnknown	Context2K	Est. memory≈ 3 GB	`ollama run phi:2.7b`
2.7b-chat-v2-fp16	Typelocal	Inputstext	Digest6b283248a801	Download5.6 GB	Parameters2.7b	QuantizationFP16	Context2K	Est. memory≈ 7.5 GB	`ollama run phi:2.7b-chat-v2-fp16`
2.7b-chat-v2-q2_K	Typelocal	Inputstext	Digestc5f597fa19b3	Download1.2 GB	Parameters2.7b	QuantizationQ2_K	Context2K	Est. memory≈ 2.5 GB	`ollama run phi:2.7b-chat-v2-q2_K`
2.7b-chat-v2-q3_K_L	Typelocal	Inputstext	Digestf260bda13b81	Download1.6 GB	Parameters2.7b	QuantizationQ3_K_L	Context2K	Est. memory≈ 3 GB	`ollama run phi:2.7b-chat-v2-q3_K_L`
2.7b-chat-v2-q3_K_M	Typelocal	Inputstext	Digest76bbe442aabe	Download1.5 GB	Parameters2.7b	QuantizationQ3_K_M	Context2K	Est. memory≈ 3 GB	`ollama run phi:2.7b-chat-v2-q3_K_M`
2.7b-chat-v2-q3_K_S	Typelocal	Inputstext	Digest4ceb511ce989	Download1.3 GB	Parameters2.7b	QuantizationQ3_K_S	Context2K	Est. memory≈ 2.5 GB	`ollama run phi:2.7b-chat-v2-q3_K_S`
2.7b-chat-v2-q4_0	Typelocal	Inputstext	Digeste2fd6321a5fe	Download1.6 GB	Parameters2.7b	QuantizationQ4_0	Context2K	Est. memory≈ 3 GB	`ollama run phi:2.7b-chat-v2-q4_0`
2.7b-chat-v2-q4_1	Typelocal	Inputstext	Digest012265cbf343	Download1.8 GB	Parameters2.7b	QuantizationQ4_1	Context2K	Est. memory≈ 3.5 GB	`ollama run phi:2.7b-chat-v2-q4_1`
2.7b-chat-v2-q4_K_M	Typelocal	Inputstext	Digest79d7065d8c0f	Download1.8 GB	Parameters2.7b	QuantizationQ4_K_M	Context2K	Est. memory≈ 3.5 GB	`ollama run phi:2.7b-chat-v2-q4_K_M`
2.7b-chat-v2-q4_K_S	Typelocal	Inputstext	Digestf018d657187c	Download1.6 GB	Parameters2.7b	QuantizationQ4_K_S	Context2K	Est. memory≈ 3 GB	`ollama run phi:2.7b-chat-v2-q4_K_S`
2.7b-chat-v2-q5_0	Typelocal	Inputstext	Digestccb07c724975	Download1.9 GB	Parameters2.7b	QuantizationQ5_0	Context2K	Est. memory≈ 3.5 GB	`ollama run phi:2.7b-chat-v2-q5_0`
2.7b-chat-v2-q5_1	Typelocal	Inputstext	Digestf322ed62bd81	Download2.1 GB	Parameters2.7b	QuantizationQ5_1	Context2K	Est. memory≈ 3.5 GB	`ollama run phi:2.7b-chat-v2-q5_1`
2.7b-chat-v2-q5_K_M	Typelocal	Inputstext	Digest4dbc1775ae76	Download2.1 GB	Parameters2.7b	QuantizationQ5_K_M	Context2K	Est. memory≈ 3.5 GB	`ollama run phi:2.7b-chat-v2-q5_K_M`
2.7b-chat-v2-q5_K_S	Typelocal	Inputstext	Digest4f3f9f884a09	Download1.9 GB	Parameters2.7b	QuantizationQ5_K_S	Context2K	Est. memory≈ 3.5 GB	`ollama run phi:2.7b-chat-v2-q5_K_S`
2.7b-chat-v2-q6_K	Typelocal	Inputstext	Digest170d96fc8084	Download2.3 GB	Parameters2.7b	QuantizationQ6_K	Context2K	Est. memory≈ 4 GB	`ollama run phi:2.7b-chat-v2-q6_K`
2.7b-chat-v2-q8_0	Typelocal	Inputstext	Digest55ec39f0bcf9	Download3.0 GB	Parameters2.7b	QuantizationQ8_0	Context2K	Est. memory≈ 4.5 GB	`ollama run phi:2.7b-chat-v2-q8_0`
chat	Typelocal	Inputstext	Digeste2fd6321a5fe	Download1.6 GB	ParametersUnknown	QuantizationUnknown	Context2K	Est. memory≈ 3 GB	`ollama run phi:chat`
latestdefault	Typelocal	Inputstext	Digeste2fd6321a5fe	Download1.6 GB	ParametersUnknown	QuantizationUnknown	Context2K	Est. memory≈ 3 GB	`ollama run phi:latest`

Related models

gemma2local

Google Gemma 2 is a high-performing and efficient model available in three sizes: 2B, 9B, and 27B.

gemmalocal

Gemma is a family of lightweight, state-of-the-art open models built by Google DeepMind. Updated to version 1.1

bge-m3local

BGE-M3 is a new model from BAAI distinguished for its versatility in Multi-Functionality, Multi-Linguality, and Multi-Granularity.

codegemmalocal

CodeGemma is a collection of powerful, lightweight models that can perform a variety of coding tasks like fill-in-the-middle code completion, code generation, natural language understanding, mathematical reasoning, and instruction following.