Quick start

ollama run vicuna:latest

Runnable variants

Memory is a rough file-size estimate; context length, runtime and GPU offload change it.

12 of 111 matching variants shown.111 of 111 variants shown.

Tag	Type	Inputs	Digest	Download	Parameters	Quantization	Context	Est. memory	Run
13b	Typelocal	Inputstext	Digeste311d03837d9	Download7.4 GB	Parameters13b	QuantizationUnknown	Context4K	Est. memory≈ 9.5 GB	`ollama run vicuna:13b`
13b-16k	Typelocal	Inputstext	Digest4ea0e2b82bc2	Download7.4 GB	Parameters13b	QuantizationUnknown	Context16K	Est. memory≈ 9.5 GB	`ollama run vicuna:13b-16k`
13b-fp16	Typelocal	Inputstext	Digest5c0aaca02f10	Download26 GB	Parameters13b	QuantizationFP16	Context2K	Est. memory≈ 30.5 GB	`ollama run vicuna:13b-fp16`
13b-q2_K	Typelocal	Inputstext	Digestc243d669ad2e	Download5.4 GB	Parameters13b	QuantizationQ2_K	Context2K	Est. memory≈ 7.5 GB	`ollama run vicuna:13b-q2_K`
13b-q3_K_L	Typelocal	Inputstext	Digest3ce284b06308	Download6.9 GB	Parameters13b	QuantizationQ3_K_L	Context2K	Est. memory≈ 9 GB	`ollama run vicuna:13b-q3_K_L`
13b-q3_K_M	Typelocal	Inputstext	Digest5c94116bb4df	Download6.3 GB	Parameters13b	QuantizationQ3_K_M	Context2K	Est. memory≈ 8.5 GB	`ollama run vicuna:13b-q3_K_M`
13b-q3_K_S	Typelocal	Inputstext	Digesta1f4ecdb04ba	Download5.7 GB	Parameters13b	QuantizationQ3_K_S	Context2K	Est. memory≈ 7.5 GB	`ollama run vicuna:13b-q3_K_S`
13b-q4_0	Typelocal	Inputstext	Digesta6aad17d1205	Download7.4 GB	Parameters13b	QuantizationQ4_0	Context2K	Est. memory≈ 9.5 GB	`ollama run vicuna:13b-q4_0`
13b-q4_1	Typelocal	Inputstext	Digestd7b312e7d741	Download8.2 GB	Parameters13b	QuantizationQ4_1	Context2K	Est. memory≈ 10.5 GB	`ollama run vicuna:13b-q4_1`
13b-q4_K_M	Typelocal	Inputstext	Digest0f5697218aef	Download7.9 GB	Parameters13b	QuantizationQ4_K_M	Context2K	Est. memory≈ 10 GB	`ollama run vicuna:13b-q4_K_M`
13b-q4_K_S	Typelocal	Inputstext	Digest96cc0c85539e	Download7.4 GB	Parameters13b	QuantizationQ4_K_S	Context2K	Est. memory≈ 9.5 GB	`ollama run vicuna:13b-q4_K_S`
13b-q5_0	Typelocal	Inputstext	Digestd775a7c5294b	Download9.0 GB	Parameters13b	QuantizationQ5_0	Context2K	Est. memory≈ 11.5 GB	`ollama run vicuna:13b-q5_0`
13b-q5_1	Typelocal	Inputstext	Digest65711d83a5ba	Download9.8 GB	Parameters13b	QuantizationQ5_1	Context2K	Est. memory≈ 12 GB	`ollama run vicuna:13b-q5_1`
13b-q5_K_M	Typelocal	Inputstext	Digest57fc4dcc89d7	Download9.2 GB	Parameters13b	QuantizationQ5_K_M	Context2K	Est. memory≈ 11.5 GB	`ollama run vicuna:13b-q5_K_M`
13b-q5_K_S	Typelocal	Inputstext	Digest9151c66c59cf	Download9.0 GB	Parameters13b	QuantizationQ5_K_S	Context2K	Est. memory≈ 11.5 GB	`ollama run vicuna:13b-q5_K_S`
13b-q6_K	Typelocal	Inputstext	Digest5771033f82b8	Download11 GB	Parameters13b	QuantizationQ6_K	Context2K	Est. memory≈ 13.5 GB	`ollama run vicuna:13b-q6_K`
13b-q8_0	Typelocal	Inputstext	Digest1f4a6e7b304c	Download14 GB	Parameters13b	QuantizationQ8_0	Context2K	Est. memory≈ 17 GB	`ollama run vicuna:13b-q8_0`
13b-v1.5-16k-fp16	Typelocal	Inputstext	Digestaa225f209212	Download26 GB	Parameters13b	QuantizationFP16	Context16K	Est. memory≈ 30.5 GB	`ollama run vicuna:13b-v1.5-16k-fp16`
13b-v1.5-16k-q2_K	Typelocal	Inputstext	Digestc4bc2aac929f	Download5.4 GB	Parameters13b	QuantizationQ2_K	Context16K	Est. memory≈ 7.5 GB	`ollama run vicuna:13b-v1.5-16k-q2_K`
13b-v1.5-16k-q3_K_L	Typelocal	Inputstext	Digest2354833bf609	Download6.9 GB	Parameters13b	QuantizationQ3_K_L	Context16K	Est. memory≈ 9 GB	`ollama run vicuna:13b-v1.5-16k-q3_K_L`
13b-v1.5-16k-q3_K_M	Typelocal	Inputstext	Digestf713797047ce	Download6.3 GB	Parameters13b	QuantizationQ3_K_M	Context16K	Est. memory≈ 8.5 GB	`ollama run vicuna:13b-v1.5-16k-q3_K_M`
13b-v1.5-16k-q3_K_S	Typelocal	Inputstext	Digest460254d8fc30	Download5.7 GB	Parameters13b	QuantizationQ3_K_S	Context16K	Est. memory≈ 7.5 GB	`ollama run vicuna:13b-v1.5-16k-q3_K_S`
13b-v1.5-16k-q4_0	Typelocal	Inputstext	Digest4ea0e2b82bc2	Download7.4 GB	Parameters13b	QuantizationQ4_0	Context16K	Est. memory≈ 9.5 GB	`ollama run vicuna:13b-v1.5-16k-q4_0`
13b-v1.5-16k-q4_1	Typelocal	Inputstext	Digestbeaca53a59b9	Download8.2 GB	Parameters13b	QuantizationQ4_1	Context16K	Est. memory≈ 10.5 GB	`ollama run vicuna:13b-v1.5-16k-q4_1`
13b-v1.5-16k-q4_K_M	Typelocal	Inputstext	Digest99611d39169d	Download7.9 GB	Parameters13b	QuantizationQ4_K_M	Context16K	Est. memory≈ 10 GB	`ollama run vicuna:13b-v1.5-16k-q4_K_M`
13b-v1.5-16k-q4_K_S	Typelocal	Inputstext	Digest6c1dcf76ddbd	Download7.4 GB	Parameters13b	QuantizationQ4_K_S	Context16K	Est. memory≈ 9.5 GB	`ollama run vicuna:13b-v1.5-16k-q4_K_S`
13b-v1.5-16k-q5_0	Typelocal	Inputstext	Digest8994818e295d	Download9.0 GB	Parameters13b	QuantizationQ5_0	Context16K	Est. memory≈ 11.5 GB	`ollama run vicuna:13b-v1.5-16k-q5_0`
13b-v1.5-16k-q5_1	Typelocal	Inputstext	Digestb1e60bd134ff	Download9.8 GB	Parameters13b	QuantizationQ5_1	Context16K	Est. memory≈ 12 GB	`ollama run vicuna:13b-v1.5-16k-q5_1`
13b-v1.5-16k-q5_K_M	Typelocal	Inputstext	Digest3374b3e9b520	Download9.2 GB	Parameters13b	QuantizationQ5_K_M	Context16K	Est. memory≈ 11.5 GB	`ollama run vicuna:13b-v1.5-16k-q5_K_M`
13b-v1.5-16k-q5_K_S	Typelocal	Inputstext	Digest5d960ceab7d0	Download9.0 GB	Parameters13b	QuantizationQ5_K_S	Context16K	Est. memory≈ 11.5 GB	`ollama run vicuna:13b-v1.5-16k-q5_K_S`
13b-v1.5-16k-q6_K	Typelocal	Inputstext	Digest3dabce096571	Download11 GB	Parameters13b	QuantizationQ6_K	Context16K	Est. memory≈ 13.5 GB	`ollama run vicuna:13b-v1.5-16k-q6_K`
13b-v1.5-16k-q8_0	Typelocal	Inputstext	Digest7e91afb2b027	Download14 GB	Parameters13b	QuantizationQ8_0	Context16K	Est. memory≈ 17 GB	`ollama run vicuna:13b-v1.5-16k-q8_0`
13b-v1.5-fp16	Typelocal	Inputstext	Digest3e2035c21594	Download26 GB	Parameters13b	QuantizationFP16	Context4K	Est. memory≈ 30.5 GB	`ollama run vicuna:13b-v1.5-fp16`
13b-v1.5-q2_K	Typelocal	Inputstext	Digestda124fb49a03	Download5.4 GB	Parameters13b	QuantizationQ2_K	Context4K	Est. memory≈ 7.5 GB	`ollama run vicuna:13b-v1.5-q2_K`
13b-v1.5-q3_K_L	Typelocal	Inputstext	Digest3a1c75a39e39	Download6.9 GB	Parameters13b	QuantizationQ3_K_L	Context4K	Est. memory≈ 9 GB	`ollama run vicuna:13b-v1.5-q3_K_L`
13b-v1.5-q3_K_M	Typelocal	Inputstext	Digest112a0a219973	Download6.3 GB	Parameters13b	QuantizationQ3_K_M	Context4K	Est. memory≈ 8.5 GB	`ollama run vicuna:13b-v1.5-q3_K_M`
13b-v1.5-q3_K_S	Typelocal	Inputstext	Digestdb9d5d8832a5	Download5.7 GB	Parameters13b	QuantizationQ3_K_S	Context4K	Est. memory≈ 7.5 GB	`ollama run vicuna:13b-v1.5-q3_K_S`
13b-v1.5-q4_0	Typelocal	Inputstext	Digeste311d03837d9	Download7.4 GB	Parameters13b	QuantizationQ4_0	Context4K	Est. memory≈ 9.5 GB	`ollama run vicuna:13b-v1.5-q4_0`
13b-v1.5-q4_1	Typelocal	Inputstext	Digestca8047f969be	Download8.2 GB	Parameters13b	QuantizationQ4_1	Context4K	Est. memory≈ 10.5 GB	`ollama run vicuna:13b-v1.5-q4_1`
13b-v1.5-q4_K_M	Typelocal	Inputstext	Digestd81bdd5ae575	Download7.9 GB	Parameters13b	QuantizationQ4_K_M	Context4K	Est. memory≈ 10 GB	`ollama run vicuna:13b-v1.5-q4_K_M`
13b-v1.5-q4_K_S	Typelocal	Inputstext	Digestc78c1ae11f55	Download7.4 GB	Parameters13b	QuantizationQ4_K_S	Context4K	Est. memory≈ 9.5 GB	`ollama run vicuna:13b-v1.5-q4_K_S`
13b-v1.5-q5_0	Typelocal	Inputstext	Digest33be3d9112bd	Download9.0 GB	Parameters13b	QuantizationQ5_0	Context4K	Est. memory≈ 11.5 GB	`ollama run vicuna:13b-v1.5-q5_0`
13b-v1.5-q5_1	Typelocal	Inputstext	Digestb03c2008cb04	Download9.8 GB	Parameters13b	QuantizationQ5_1	Context4K	Est. memory≈ 12 GB	`ollama run vicuna:13b-v1.5-q5_1`
13b-v1.5-q5_K_M	Typelocal	Inputstext	Digestc85a3d3b3b78	Download9.2 GB	Parameters13b	QuantizationQ5_K_M	Context4K	Est. memory≈ 11.5 GB	`ollama run vicuna:13b-v1.5-q5_K_M`
13b-v1.5-q5_K_S	Typelocal	Inputstext	Digestd3dd8af1f363	Download9.0 GB	Parameters13b	QuantizationQ5_K_S	Context4K	Est. memory≈ 11.5 GB	`ollama run vicuna:13b-v1.5-q5_K_S`
13b-v1.5-q6_K	Typelocal	Inputstext	Digest90d7ed92be1d	Download11 GB	Parameters13b	QuantizationQ6_K	Context4K	Est. memory≈ 13.5 GB	`ollama run vicuna:13b-v1.5-q6_K`
13b-v1.5-q8_0	Typelocal	Inputstext	Digestdb82e78d570a	Download14 GB	Parameters13b	QuantizationQ8_0	Context4K	Est. memory≈ 17 GB	`ollama run vicuna:13b-v1.5-q8_0`
33b	Typelocal	Inputstext	Digest86f0704901a4	Download18 GB	Parameters33b	QuantizationUnknown	Context2K	Est. memory≈ 21.5 GB	`ollama run vicuna:33b`
33b-fp16	Typelocal	Inputstext	Digest6bc47b18a625	Download65 GB	Parameters33b	QuantizationFP16	Context2K	Est. memory≈ 74 GB	`ollama run vicuna:33b-fp16`
33b-q2_K	Typelocal	Inputstext	Digest9129a0b1a6b1	Download14 GB	Parameters33b	QuantizationQ2_K	Context2K	Est. memory≈ 17 GB	`ollama run vicuna:33b-q2_K`
33b-q3_K_L	Typelocal	Inputstext	Digest5f73c820980e	Download17 GB	Parameters33b	QuantizationQ3_K_L	Context2K	Est. memory≈ 20 GB	`ollama run vicuna:33b-q3_K_L`
33b-q3_K_M	Typelocal	Inputstext	Digestfe6ff250b94e	Download16 GB	Parameters33b	QuantizationQ3_K_M	Context2K	Est. memory≈ 19 GB	`ollama run vicuna:33b-q3_K_M`
33b-q3_K_S	Typelocal	Inputstext	Digest029c30fb56ac	Download14 GB	Parameters33b	QuantizationQ3_K_S	Context2K	Est. memory≈ 17 GB	`ollama run vicuna:33b-q3_K_S`
33b-q4_0	Typelocal	Inputstext	Digest86f0704901a4	Download18 GB	Parameters33b	QuantizationQ4_0	Context2K	Est. memory≈ 21.5 GB	`ollama run vicuna:33b-q4_0`
33b-q4_1	Typelocal	Inputstext	Digest4b40d8826503	Download20 GB	Parameters33b	QuantizationQ4_1	Context2K	Est. memory≈ 23.5 GB	`ollama run vicuna:33b-q4_1`
33b-q4_K_M	Typelocal	Inputstext	Digestae8f63e7638e	Download20 GB	Parameters33b	QuantizationQ4_K_M	Context2K	Est. memory≈ 23.5 GB	`ollama run vicuna:33b-q4_K_M`
33b-q4_K_S	Typelocal	Inputstext	Digest933cc774ba3c	Download18 GB	Parameters33b	QuantizationQ4_K_S	Context2K	Est. memory≈ 21.5 GB	`ollama run vicuna:33b-q4_K_S`
33b-q5_0	Typelocal	Inputstext	Digest4a6fa67158d8	Download22 GB	Parameters33b	QuantizationQ5_0	Context2K	Est. memory≈ 26 GB	`ollama run vicuna:33b-q5_0`
33b-q5_1	Typelocal	Inputstext	Digest732296977ff9	Download24 GB	Parameters33b	QuantizationQ5_1	Context2K	Est. memory≈ 28 GB	`ollama run vicuna:33b-q5_1`
33b-q5_K_M	Typelocal	Inputstext	Digest45a15331c3d3	Download23 GB	Parameters33b	QuantizationQ5_K_M	Context2K	Est. memory≈ 27 GB	`ollama run vicuna:33b-q5_K_M`
33b-q5_K_S	Typelocal	Inputstext	Digest87a62b85e56f	Download22 GB	Parameters33b	QuantizationQ5_K_S	Context2K	Est. memory≈ 26 GB	`ollama run vicuna:33b-q5_K_S`
33b-q6_K	Typelocal	Inputstext	Digest594c8ae461ac	Download27 GB	Parameters33b	QuantizationQ6_K	Context2K	Est. memory≈ 31.5 GB	`ollama run vicuna:33b-q6_K`
33b-q8_0	Typelocal	Inputstext	Digestdc6380cf87ce	Download35 GB	Parameters33b	QuantizationQ8_0	Context2K	Est. memory≈ 40.5 GB	`ollama run vicuna:33b-q8_0`
7b	Typelocal	Inputstext	Digest370739dc897b	Download3.8 GB	Parameters7b	QuantizationUnknown	Context4K	Est. memory≈ 5.5 GB	`ollama run vicuna:7b`
7b-16k	Typelocal	Inputstext	Digeste17473565403	Download3.8 GB	Parameters7b	QuantizationUnknown	Context16K	Est. memory≈ 5.5 GB	`ollama run vicuna:7b-16k`
7b-fp16	Typelocal	Inputstext	Digest2b09615317cc	Download13 GB	Parameters7b	QuantizationFP16	Context2K	Est. memory≈ 16 GB	`ollama run vicuna:7b-fp16`
7b-q2_K	Typelocal	Inputstext	Digest7b111124e218	Download2.8 GB	Parameters7b	QuantizationQ2_K	Context2K	Est. memory≈ 4.5 GB	`ollama run vicuna:7b-q2_K`
7b-q3_K_L	Typelocal	Inputstext	Digest1ac57ff324d2	Download3.6 GB	Parameters7b	QuantizationQ3_K_L	Context2K	Est. memory≈ 5.5 GB	`ollama run vicuna:7b-q3_K_L`
7b-q3_K_M	Typelocal	Inputstext	Digesta510caa0fb6b	Download3.3 GB	Parameters7b	QuantizationQ3_K_M	Context2K	Est. memory≈ 5 GB	`ollama run vicuna:7b-q3_K_M`
7b-q3_K_S	Typelocal	Inputstext	Digest2b471de7ac09	Download2.9 GB	Parameters7b	QuantizationQ3_K_S	Context2K	Est. memory≈ 4.5 GB	`ollama run vicuna:7b-q3_K_S`
7b-q4_0	Typelocal	Inputstext	Digest722cb0fe032d	Download3.8 GB	Parameters7b	QuantizationQ4_0	Context2K	Est. memory≈ 5.5 GB	`ollama run vicuna:7b-q4_0`
7b-q4_1	Typelocal	Inputstext	Digestdaba6226e41c	Download4.2 GB	Parameters7b	QuantizationQ4_1	Context2K	Est. memory≈ 6 GB	`ollama run vicuna:7b-q4_1`
7b-q4_K_M	Typelocal	Inputstext	Digeste702c3f6d1da	Download4.1 GB	Parameters7b	QuantizationQ4_K_M	Context2K	Est. memory≈ 6 GB	`ollama run vicuna:7b-q4_K_M`
7b-q4_K_S	Typelocal	Inputstext	Digest7b22215a6f5a	Download3.9 GB	Parameters7b	QuantizationQ4_K_S	Context2K	Est. memory≈ 5.5 GB	`ollama run vicuna:7b-q4_K_S`
7b-q5_0	Typelocal	Inputstext	Digestb4be80922f5c	Download4.7 GB	Parameters7b	QuantizationQ5_0	Context2K	Est. memory≈ 6.5 GB	`ollama run vicuna:7b-q5_0`
7b-q5_1	Typelocal	Inputstext	Digest3958ed7d2994	Download5.1 GB	Parameters7b	QuantizationQ5_1	Context2K	Est. memory≈ 7 GB	`ollama run vicuna:7b-q5_1`
7b-q5_K_M	Typelocal	Inputstext	Digest2cc1a91b3ee5	Download4.8 GB	Parameters7b	QuantizationQ5_K_M	Context2K	Est. memory≈ 6.5 GB	`ollama run vicuna:7b-q5_K_M`
7b-q5_K_S	Typelocal	Inputstext	Digestaa085ae496ef	Download4.7 GB	Parameters7b	QuantizationQ5_K_S	Context2K	Est. memory≈ 6.5 GB	`ollama run vicuna:7b-q5_K_S`
7b-q6_K	Typelocal	Inputstext	Digest5bbfe6ccf426	Download5.5 GB	Parameters7b	QuantizationQ6_K	Context2K	Est. memory≈ 7.5 GB	`ollama run vicuna:7b-q6_K`
7b-q8_0	Typelocal	Inputstext	Digestabbdf2e7dab4	Download7.2 GB	Parameters7b	QuantizationQ8_0	Context2K	Est. memory≈ 9.5 GB	`ollama run vicuna:7b-q8_0`
7b-v1.5-16k-fp16	Typelocal	Inputstext	Digest7a1b09b09a43	Download13 GB	Parameters7b	QuantizationFP16	Context16K	Est. memory≈ 16 GB	`ollama run vicuna:7b-v1.5-16k-fp16`
7b-v1.5-16k-q2_K	Typelocal	Inputstext	Digest409c84f8f2cb	Download2.8 GB	Parameters7b	QuantizationQ2_K	Context16K	Est. memory≈ 4.5 GB	`ollama run vicuna:7b-v1.5-16k-q2_K`
7b-v1.5-16k-q3_K_L	Typelocal	Inputstext	Digest6e9eee2fdf07	Download3.6 GB	Parameters7b	QuantizationQ3_K_L	Context16K	Est. memory≈ 5.5 GB	`ollama run vicuna:7b-v1.5-16k-q3_K_L`
7b-v1.5-16k-q3_K_M	Typelocal	Inputstext	Digest9cd3422a7f75	Download3.3 GB	Parameters7b	QuantizationQ3_K_M	Context16K	Est. memory≈ 5 GB	`ollama run vicuna:7b-v1.5-16k-q3_K_M`
7b-v1.5-16k-q3_K_S	Typelocal	Inputstext	Digeste82ccebcca5c	Download2.9 GB	Parameters7b	QuantizationQ3_K_S	Context16K	Est. memory≈ 4.5 GB	`ollama run vicuna:7b-v1.5-16k-q3_K_S`
7b-v1.5-16k-q4_0	Typelocal	Inputstext	Digeste17473565403	Download3.8 GB	Parameters7b	QuantizationQ4_0	Context16K	Est. memory≈ 5.5 GB	`ollama run vicuna:7b-v1.5-16k-q4_0`
7b-v1.5-16k-q4_1	Typelocal	Inputstext	Digest8af11c99918c	Download4.2 GB	Parameters7b	QuantizationQ4_1	Context16K	Est. memory≈ 6 GB	`ollama run vicuna:7b-v1.5-16k-q4_1`
7b-v1.5-16k-q4_K_M	Typelocal	Inputstext	Digest493df7220cb7	Download4.1 GB	Parameters7b	QuantizationQ4_K_M	Context16K	Est. memory≈ 6 GB	`ollama run vicuna:7b-v1.5-16k-q4_K_M`
7b-v1.5-16k-q4_K_S	Typelocal	Inputstext	Digestcc8bb49d8400	Download3.9 GB	Parameters7b	QuantizationQ4_K_S	Context16K	Est. memory≈ 5.5 GB	`ollama run vicuna:7b-v1.5-16k-q4_K_S`
7b-v1.5-16k-q5_0	Typelocal	Inputstext	Digest5c89be046446	Download4.7 GB	Parameters7b	QuantizationQ5_0	Context16K	Est. memory≈ 6.5 GB	`ollama run vicuna:7b-v1.5-16k-q5_0`
7b-v1.5-16k-q5_1	Typelocal	Inputstext	Digest8988900a59a5	Download5.1 GB	Parameters7b	QuantizationQ5_1	Context16K	Est. memory≈ 7 GB	`ollama run vicuna:7b-v1.5-16k-q5_1`
7b-v1.5-16k-q5_K_M	Typelocal	Inputstext	Digest20d16dc9be3e	Download4.8 GB	Parameters7b	QuantizationQ5_K_M	Context16K	Est. memory≈ 6.5 GB	`ollama run vicuna:7b-v1.5-16k-q5_K_M`
7b-v1.5-16k-q5_K_S	Typelocal	Inputstext	Digest52cf0588ba15	Download4.7 GB	Parameters7b	QuantizationQ5_K_S	Context16K	Est. memory≈ 6.5 GB	`ollama run vicuna:7b-v1.5-16k-q5_K_S`
7b-v1.5-16k-q6_K	Typelocal	Inputstext	Digest62fe512efb47	Download5.5 GB	Parameters7b	QuantizationQ6_K	Context16K	Est. memory≈ 7.5 GB	`ollama run vicuna:7b-v1.5-16k-q6_K`
7b-v1.5-16k-q8_0	Typelocal	Inputstext	Digest32abbaf4d985	Download7.2 GB	Parameters7b	QuantizationQ8_0	Context16K	Est. memory≈ 9.5 GB	`ollama run vicuna:7b-v1.5-16k-q8_0`
7b-v1.5-fp16	Typelocal	Inputstext	Digest1e2de112296e	Download13 GB	Parameters7b	QuantizationFP16	Context4K	Est. memory≈ 16 GB	`ollama run vicuna:7b-v1.5-fp16`
7b-v1.5-q2_K	Typelocal	Inputstext	Digestce1d7d2d4c36	Download2.8 GB	Parameters7b	QuantizationQ2_K	Context4K	Est. memory≈ 4.5 GB	`ollama run vicuna:7b-v1.5-q2_K`
7b-v1.5-q3_K_L	Typelocal	Inputstext	Digest5958c72021fe	Download3.6 GB	Parameters7b	QuantizationQ3_K_L	Context4K	Est. memory≈ 5.5 GB	`ollama run vicuna:7b-v1.5-q3_K_L`
7b-v1.5-q3_K_M	Typelocal	Inputstext	Digestb617de3e65a1	Download3.3 GB	Parameters7b	QuantizationQ3_K_M	Context4K	Est. memory≈ 5 GB	`ollama run vicuna:7b-v1.5-q3_K_M`
7b-v1.5-q3_K_S	Typelocal	Inputstext	Digestd4a35f8b2ff8	Download2.9 GB	Parameters7b	QuantizationQ3_K_S	Context4K	Est. memory≈ 4.5 GB	`ollama run vicuna:7b-v1.5-q3_K_S`
7b-v1.5-q4_0	Typelocal	Inputstext	Digest370739dc897b	Download3.8 GB	Parameters7b	QuantizationQ4_0	Context4K	Est. memory≈ 5.5 GB	`ollama run vicuna:7b-v1.5-q4_0`
7b-v1.5-q4_1	Typelocal	Inputstext	Digest49882f87f7a7	Download4.2 GB	Parameters7b	QuantizationQ4_1	Context4K	Est. memory≈ 6 GB	`ollama run vicuna:7b-v1.5-q4_1`
7b-v1.5-q4_K_M	Typelocal	Inputstext	Digest33b5fd751101	Download4.1 GB	Parameters7b	QuantizationQ4_K_M	Context4K	Est. memory≈ 6 GB	`ollama run vicuna:7b-v1.5-q4_K_M`
7b-v1.5-q4_K_S	Typelocal	Inputstext	Digest9dbfd37d1be3	Download3.9 GB	Parameters7b	QuantizationQ4_K_S	Context4K	Est. memory≈ 5.5 GB	`ollama run vicuna:7b-v1.5-q4_K_S`
7b-v1.5-q5_0	Typelocal	Inputstext	Digest48de3e58864e	Download4.7 GB	Parameters7b	QuantizationQ5_0	Context4K	Est. memory≈ 6.5 GB	`ollama run vicuna:7b-v1.5-q5_0`
7b-v1.5-q5_1	Typelocal	Inputstext	Digestfa2d15c41d43	Download5.1 GB	Parameters7b	QuantizationQ5_1	Context4K	Est. memory≈ 7 GB	`ollama run vicuna:7b-v1.5-q5_1`
7b-v1.5-q5_K_M	Typelocal	Inputstext	Digestf734686befb8	Download4.8 GB	Parameters7b	QuantizationQ5_K_M	Context4K	Est. memory≈ 6.5 GB	`ollama run vicuna:7b-v1.5-q5_K_M`
7b-v1.5-q5_K_S	Typelocal	Inputstext	Digest6167e172bf05	Download4.7 GB	Parameters7b	QuantizationQ5_K_S	Context4K	Est. memory≈ 6.5 GB	`ollama run vicuna:7b-v1.5-q5_K_S`
7b-v1.5-q6_K	Typelocal	Inputstext	Digestcfceb01fd96f	Download5.5 GB	Parameters7b	QuantizationQ6_K	Context4K	Est. memory≈ 7.5 GB	`ollama run vicuna:7b-v1.5-q6_K`
7b-v1.5-q8_0	Typelocal	Inputstext	Digestdf07a6d74df1	Download7.2 GB	Parameters7b	QuantizationQ8_0	Context4K	Est. memory≈ 9.5 GB	`ollama run vicuna:7b-v1.5-q8_0`
latestdefault	Typelocal	Inputstext	Digest370739dc897b	Download3.8 GB	ParametersUnknown	QuantizationUnknown	Context4K	Est. memory≈ 5.5 GB	`ollama run vicuna:latest`

Related models

llama2local

Llama 2 is a collection of foundation language models ranging from 7B to 70B parameters.

codellamalocal

A large language model that can use text prompts to generate and discuss code.

llama2-uncensoredlocal

Uncensored Llama 2 model by George Sung and Jarrad Hope.

wizardcoderlocal

State-of-the-art code generation model