Quick start

ollama run dolphin-llama3:latest

Runnable variants

Memory is a rough file-size estimate; context length, runtime and GPU offload change it.

12 of 53 matching variants shown.53 of 53 variants shown.

Tag	Type	Inputs	Digest	Download	Parameters	Quantization	Context	Est. memory	Run
70b	Typelocal	Inputstext	Digest39cf3e48a702	Download40 GB	Parameters70b	QuantizationUnknown	Context8K	Est. memory≈ 46 GB	`ollama run dolphin-llama3:70b`
70b-v2.9	Typelocal	Inputstext	Digest39cf3e48a702	Download40 GB	Parameters70b	QuantizationUnknown	Context8K	Est. memory≈ 46 GB	`ollama run dolphin-llama3:70b-v2.9`
70b-v2.9-fp16	Typelocal	Inputstext	Digest384d68211a76	Download141 GB	Parameters70b	QuantizationFP16	Context8K	Est. memory≈ 159 GB	`ollama run dolphin-llama3:70b-v2.9-fp16`
70b-v2.9-q2_K	Typelocal	Inputstext	Digest9167f4131518	Download26 GB	Parameters70b	QuantizationQ2_K	Context8K	Est. memory≈ 30.5 GB	`ollama run dolphin-llama3:70b-v2.9-q2_K`
70b-v2.9-q3_K_L	Typelocal	Inputstext	Digest0b1d3bbb0f87	Download37 GB	Parameters70b	QuantizationQ3_K_L	Context8K	Est. memory≈ 42.5 GB	`ollama run dolphin-llama3:70b-v2.9-q3_K_L`
70b-v2.9-q3_K_M	Typelocal	Inputstext	Digest9f14deb632a8	Download34 GB	Parameters70b	QuantizationQ3_K_M	Context8K	Est. memory≈ 39 GB	`ollama run dolphin-llama3:70b-v2.9-q3_K_M`
70b-v2.9-q3_K_S	Typelocal	Inputstext	Digest0ff6ff25af1a	Download31 GB	Parameters70b	QuantizationQ3_K_S	Context8K	Est. memory≈ 36 GB	`ollama run dolphin-llama3:70b-v2.9-q3_K_S`
70b-v2.9-q4_0	Typelocal	Inputstext	Digest39cf3e48a702	Download40 GB	Parameters70b	QuantizationQ4_0	Context8K	Est. memory≈ 46 GB	`ollama run dolphin-llama3:70b-v2.9-q4_0`
70b-v2.9-q4_1	Typelocal	Inputstext	Digestbe3648d90cec	Download44 GB	Parameters70b	QuantizationQ4_1	Context8K	Est. memory≈ 50.5 GB	`ollama run dolphin-llama3:70b-v2.9-q4_1`
70b-v2.9-q4_K_M	Typelocal	Inputstext	Digestff66659bf60a	Download43 GB	Parameters70b	QuantizationQ4_K_M	Context8K	Est. memory≈ 49.5 GB	`ollama run dolphin-llama3:70b-v2.9-q4_K_M`
70b-v2.9-q4_K_S	Typelocal	Inputstext	Digest08f394a4228a	Download40 GB	Parameters70b	QuantizationQ4_K_S	Context8K	Est. memory≈ 46 GB	`ollama run dolphin-llama3:70b-v2.9-q4_K_S`
70b-v2.9-q5_0	Typelocal	Inputstext	Digest1be4a47c2130	Download49 GB	Parameters70b	QuantizationQ5_0	Context8K	Est. memory≈ 56 GB	`ollama run dolphin-llama3:70b-v2.9-q5_0`
70b-v2.9-q5_1	Typelocal	Inputstext	Digest3c0bd6cd54b5	Download53 GB	Parameters70b	QuantizationQ5_1	Context8K	Est. memory≈ 60.5 GB	`ollama run dolphin-llama3:70b-v2.9-q5_1`
70b-v2.9-q5_K_M	Typelocal	Inputstext	Digestc76eccdaa1d4	Download50 GB	Parameters70b	QuantizationQ5_K_M	Context8K	Est. memory≈ 57 GB	`ollama run dolphin-llama3:70b-v2.9-q5_K_M`
70b-v2.9-q5_K_S	Typelocal	Inputstext	Digestc7f5f7f98fbf	Download49 GB	Parameters70b	QuantizationQ5_K_S	Context8K	Est. memory≈ 56 GB	`ollama run dolphin-llama3:70b-v2.9-q5_K_S`
70b-v2.9-q6_K	Typelocal	Inputstext	Digeste495c04eaf8d	Download58 GB	Parameters70b	QuantizationQ6_K	Context8K	Est. memory≈ 66 GB	`ollama run dolphin-llama3:70b-v2.9-q6_K`
70b-v2.9-q8_0	Typelocal	Inputstext	Digestf7ec3871505b	Download75 GB	Parameters70b	QuantizationQ8_0	Context8K	Est. memory≈ 85 GB	`ollama run dolphin-llama3:70b-v2.9-q8_0`
8b	Typelocal	Inputstext	Digest613f068e29f8	Download4.7 GB	Parameters8b	QuantizationUnknown	Context8K	Est. memory≈ 6.5 GB	`ollama run dolphin-llama3:8b`
8b-256k	Typelocal	Inputstext	Digest9f4257eb39a8	Download4.7 GB	Parameters8b	QuantizationUnknown	Context250K	Est. memory≈ 6.5 GB	`ollama run dolphin-llama3:8b-256k`
8b-256k-v2.9	Typelocal	Inputstext	Digest9f4257eb39a8	Download4.7 GB	Parameters8b	QuantizationUnknown	Context250K	Est. memory≈ 6.5 GB	`ollama run dolphin-llama3:8b-256k-v2.9`
8b-256k-v2.9-fp16	Typelocal	Inputstext	Digest04cb4b5c5b37	Download16 GB	Parameters8b	QuantizationFP16	Context250K	Est. memory≈ 19 GB	`ollama run dolphin-llama3:8b-256k-v2.9-fp16`
8b-256k-v2.9-q2_K	Typelocal	Inputstext	Digest7bb9753b38d1	Download3.2 GB	Parameters8b	QuantizationQ2_K	Context250K	Est. memory≈ 5 GB	`ollama run dolphin-llama3:8b-256k-v2.9-q2_K`
8b-256k-v2.9-q3_K_L	Typelocal	Inputstext	Digestfa30375d9ef6	Download4.3 GB	Parameters8b	QuantizationQ3_K_L	Context250K	Est. memory≈ 6 GB	`ollama run dolphin-llama3:8b-256k-v2.9-q3_K_L`
8b-256k-v2.9-q3_K_M	Typelocal	Inputstext	Digest23812b6dc8d1	Download4.0 GB	Parameters8b	QuantizationQ3_K_M	Context250K	Est. memory≈ 5.5 GB	`ollama run dolphin-llama3:8b-256k-v2.9-q3_K_M`
8b-256k-v2.9-q3_K_S	Typelocal	Inputstext	Digest9a8408761417	Download3.7 GB	Parameters8b	QuantizationQ3_K_S	Context250K	Est. memory≈ 5.5 GB	`ollama run dolphin-llama3:8b-256k-v2.9-q3_K_S`
8b-256k-v2.9-q4_0	Typelocal	Inputstext	Digest9f4257eb39a8	Download4.7 GB	Parameters8b	QuantizationQ4_0	Context250K	Est. memory≈ 6.5 GB	`ollama run dolphin-llama3:8b-256k-v2.9-q4_0`
8b-256k-v2.9-q4_1	Typelocal	Inputstext	Digeste5ff685455da	Download5.1 GB	Parameters8b	QuantizationQ4_1	Context250K	Est. memory≈ 7 GB	`ollama run dolphin-llama3:8b-256k-v2.9-q4_1`
8b-256k-v2.9-q4_K_M	Typelocal	Inputstext	Digestff5463167239	Download4.9 GB	Parameters8b	QuantizationQ4_K_M	Context250K	Est. memory≈ 6.5 GB	`ollama run dolphin-llama3:8b-256k-v2.9-q4_K_M`
8b-256k-v2.9-q4_K_S	Typelocal	Inputstext	Digest839a1d8b60be	Download4.7 GB	Parameters8b	QuantizationQ4_K_S	Context250K	Est. memory≈ 6.5 GB	`ollama run dolphin-llama3:8b-256k-v2.9-q4_K_S`
8b-256k-v2.9-q5_0	Typelocal	Inputstext	Digest18232d2131be	Download5.6 GB	Parameters8b	QuantizationQ5_0	Context250K	Est. memory≈ 7.5 GB	`ollama run dolphin-llama3:8b-256k-v2.9-q5_0`
8b-256k-v2.9-q5_1	Typelocal	Inputstext	Digesta91e7015a944	Download6.1 GB	Parameters8b	QuantizationQ5_1	Context250K	Est. memory≈ 8 GB	`ollama run dolphin-llama3:8b-256k-v2.9-q5_1`
8b-256k-v2.9-q5_K_M	Typelocal	Inputstext	Digest2e4bb0902c65	Download5.7 GB	Parameters8b	QuantizationQ5_K_M	Context250K	Est. memory≈ 7.5 GB	`ollama run dolphin-llama3:8b-256k-v2.9-q5_K_M`
8b-256k-v2.9-q5_K_S	Typelocal	Inputstext	Digesta609d3f403fa	Download5.6 GB	Parameters8b	QuantizationQ5_K_S	Context250K	Est. memory≈ 7.5 GB	`ollama run dolphin-llama3:8b-256k-v2.9-q5_K_S`
8b-256k-v2.9-q6_K	Typelocal	Inputstext	Digest7d4b80857cbe	Download6.6 GB	Parameters8b	QuantizationQ6_K	Context250K	Est. memory≈ 8.5 GB	`ollama run dolphin-llama3:8b-256k-v2.9-q6_K`
8b-256k-v2.9-q8_0	Typelocal	Inputstext	Digest22435ad7273c	Download8.5 GB	Parameters8b	QuantizationQ8_0	Context250K	Est. memory≈ 10.5 GB	`ollama run dolphin-llama3:8b-256k-v2.9-q8_0`
8b-v2.9	Typelocal	Inputstext	Digest613f068e29f8	Download4.7 GB	Parameters8b	QuantizationUnknown	Context8K	Est. memory≈ 6.5 GB	`ollama run dolphin-llama3:8b-v2.9`
8b-v2.9-fp16	Typelocal	Inputstext	Digest330b7914e4f9	Download16 GB	Parameters8b	QuantizationFP16	Context8K	Est. memory≈ 19 GB	`ollama run dolphin-llama3:8b-v2.9-fp16`
8b-v2.9-q2_K	Typelocal	Inputstext	Digeste38c22d1fefc	Download3.2 GB	Parameters8b	QuantizationQ2_K	Context8K	Est. memory≈ 5 GB	`ollama run dolphin-llama3:8b-v2.9-q2_K`
8b-v2.9-q3_K_L	Typelocal	Inputstext	Digestd4907340047d	Download4.3 GB	Parameters8b	QuantizationQ3_K_L	Context8K	Est. memory≈ 6 GB	`ollama run dolphin-llama3:8b-v2.9-q3_K_L`
8b-v2.9-q3_K_M	Typelocal	Inputstext	Digestffbebe9d9a89	Download4.0 GB	Parameters8b	QuantizationQ3_K_M	Context8K	Est. memory≈ 5.5 GB	`ollama run dolphin-llama3:8b-v2.9-q3_K_M`
8b-v2.9-q3_K_S	Typelocal	Inputstext	Digest4ee167a2b0ba	Download3.7 GB	Parameters8b	QuantizationQ3_K_S	Context8K	Est. memory≈ 5.5 GB	`ollama run dolphin-llama3:8b-v2.9-q3_K_S`
8b-v2.9-q4_0	Typelocal	Inputstext	Digest613f068e29f8	Download4.7 GB	Parameters8b	QuantizationQ4_0	Context8K	Est. memory≈ 6.5 GB	`ollama run dolphin-llama3:8b-v2.9-q4_0`
8b-v2.9-q4_1	Typelocal	Inputstext	Digestb91fdd625105	Download5.1 GB	Parameters8b	QuantizationQ4_1	Context8K	Est. memory≈ 7 GB	`ollama run dolphin-llama3:8b-v2.9-q4_1`
8b-v2.9-q4_K_M	Typelocal	Inputstext	Digest48e12807e1dd	Download4.9 GB	Parameters8b	QuantizationQ4_K_M	Context8K	Est. memory≈ 6.5 GB	`ollama run dolphin-llama3:8b-v2.9-q4_K_M`
8b-v2.9-q4_K_S	Typelocal	Inputstext	Digest3c68e9f4407e	Download4.7 GB	Parameters8b	QuantizationQ4_K_S	Context8K	Est. memory≈ 6.5 GB	`ollama run dolphin-llama3:8b-v2.9-q4_K_S`
8b-v2.9-q5_0	Typelocal	Inputstext	Digest6f5e6e184fd6	Download5.6 GB	Parameters8b	QuantizationQ5_0	Context8K	Est. memory≈ 7.5 GB	`ollama run dolphin-llama3:8b-v2.9-q5_0`
8b-v2.9-q5_1	Typelocal	Inputstext	Digestb83616aa2f82	Download6.1 GB	Parameters8b	QuantizationQ5_1	Context8K	Est. memory≈ 8 GB	`ollama run dolphin-llama3:8b-v2.9-q5_1`
8b-v2.9-q5_K_M	Typelocal	Inputstext	Digestff5532bbdbfd	Download5.7 GB	Parameters8b	QuantizationQ5_K_M	Context8K	Est. memory≈ 7.5 GB	`ollama run dolphin-llama3:8b-v2.9-q5_K_M`
8b-v2.9-q5_K_S	Typelocal	Inputstext	Digest9b438222d2e1	Download5.6 GB	Parameters8b	QuantizationQ5_K_S	Context8K	Est. memory≈ 7.5 GB	`ollama run dolphin-llama3:8b-v2.9-q5_K_S`
8b-v2.9-q6_K	Typelocal	Inputstext	Digestd76cc512a4c4	Download6.6 GB	Parameters8b	QuantizationQ6_K	Context8K	Est. memory≈ 8.5 GB	`ollama run dolphin-llama3:8b-v2.9-q6_K`
8b-v2.9-q8_0	Typelocal	Inputstext	Digest9b6fb904576c	Download8.5 GB	Parameters8b	QuantizationQ8_0	Context8K	Est. memory≈ 10.5 GB	`ollama run dolphin-llama3:8b-v2.9-q8_0`
latestdefault	Typelocal	Inputstext	Digest613f068e29f8	Download4.7 GB	ParametersUnknown	QuantizationUnknown	Context8K	Est. memory≈ 6.5 GB	`ollama run dolphin-llama3:latest`
v2.9	Typelocal	Inputstext	Digest613f068e29f8	Download4.7 GB	ParametersUnknown	QuantizationUnknown	Context8K	Est. memory≈ 6.5 GB	`ollama run dolphin-llama3:v2.9`

Related models

llama3.1local

Llama 3.1 is a new state-of-the-art model from Meta available in 8B, 70B and 405B parameter sizes.

llama3local

Meta Llama 3: The most capable openly available LLM to date

llavalocal

🌋 LLaVA is a novel end-to-end trained large multimodal model that combines a vision encoder and Vicuna for general-purpose visual and language understanding. Updated to version 1.6.

qwen2.5vllocal

Flagship vision-language model of Qwen and also a significant leap from the previous Qwen2-VL.