Quick start

ollama run orca-mini:latest

Runnable variants

Memory is a rough file-size estimate; context length, runtime and GPU offload change it.

12 of 119 matching variants shown.119 of 119 variants shown.

Tag	Type	Inputs	Digest	Download	Parameters	Quantization	Context	Est. memory	Run
13b	Typelocal	Inputstext	Digest1b4877c90807	Download7.4 GB	Parameters13b	QuantizationUnknown	Context4K	Est. memory≈ 9.5 GB	`ollama run orca-mini:13b`
13b-fp16	Typelocal	Inputstext	Digestff60f06ce009	Download26 GB	Parameters13b	QuantizationFP16	Context2K	Est. memory≈ 30.5 GB	`ollama run orca-mini:13b-fp16`
13b-q2_K	Typelocal	Inputstext	Digest13923842f12d	Download5.4 GB	Parameters13b	QuantizationQ2_K	Context2K	Est. memory≈ 7.5 GB	`ollama run orca-mini:13b-q2_K`
13b-q3_K_L	Typelocal	Inputstext	Digest93a769d0dbc0	Download6.9 GB	Parameters13b	QuantizationQ3_K_L	Context2K	Est. memory≈ 9 GB	`ollama run orca-mini:13b-q3_K_L`
13b-q3_K_M	Typelocal	Inputstext	Digest1cf7f5e0163b	Download6.3 GB	Parameters13b	QuantizationQ3_K_M	Context2K	Est. memory≈ 8.5 GB	`ollama run orca-mini:13b-q3_K_M`
13b-q3_K_S	Typelocal	Inputstext	Digest8e57088234d8	Download5.7 GB	Parameters13b	QuantizationQ3_K_S	Context2K	Est. memory≈ 7.5 GB	`ollama run orca-mini:13b-q3_K_S`
13b-q4_0	Typelocal	Inputstext	Digestd19fe19c0624	Download7.4 GB	Parameters13b	QuantizationQ4_0	Context2K	Est. memory≈ 9.5 GB	`ollama run orca-mini:13b-q4_0`
13b-q4_1	Typelocal	Inputstext	Digest06f127c8a31d	Download8.2 GB	Parameters13b	QuantizationQ4_1	Context2K	Est. memory≈ 10.5 GB	`ollama run orca-mini:13b-q4_1`
13b-q4_K_M	Typelocal	Inputstext	Digestb13d43a9ea63	Download7.9 GB	Parameters13b	QuantizationQ4_K_M	Context2K	Est. memory≈ 10 GB	`ollama run orca-mini:13b-q4_K_M`
13b-q4_K_S	Typelocal	Inputstext	Digest0b621a2c68ae	Download7.4 GB	Parameters13b	QuantizationQ4_K_S	Context2K	Est. memory≈ 9.5 GB	`ollama run orca-mini:13b-q4_K_S`
13b-q5_0	Typelocal	Inputstext	Digestd345f07d4365	Download9.0 GB	Parameters13b	QuantizationQ5_0	Context2K	Est. memory≈ 11.5 GB	`ollama run orca-mini:13b-q5_0`
13b-q5_1	Typelocal	Inputstext	Digest4c782fea6ce4	Download9.8 GB	Parameters13b	QuantizationQ5_1	Context2K	Est. memory≈ 12 GB	`ollama run orca-mini:13b-q5_1`
13b-q5_K_M	Typelocal	Inputstext	Digest9880bed763a2	Download9.2 GB	Parameters13b	QuantizationQ5_K_M	Context2K	Est. memory≈ 11.5 GB	`ollama run orca-mini:13b-q5_K_M`
13b-q5_K_S	Typelocal	Inputstext	Digest6531b87ef17f	Download9.0 GB	Parameters13b	QuantizationQ5_K_S	Context2K	Est. memory≈ 11.5 GB	`ollama run orca-mini:13b-q5_K_S`
13b-q6_K	Typelocal	Inputstext	Digestc3ec450a59ec	Download11 GB	Parameters13b	QuantizationQ6_K	Context2K	Est. memory≈ 13.5 GB	`ollama run orca-mini:13b-q6_K`
13b-q8_0	Typelocal	Inputstext	Digestbab5d684679e	Download14 GB	Parameters13b	QuantizationQ8_0	Context2K	Est. memory≈ 17 GB	`ollama run orca-mini:13b-q8_0`
13b-v2-fp16	Typelocal	Inputstext	Digest5fc4f577304e	Download26 GB	Parameters13b	QuantizationFP16	Context2K	Est. memory≈ 30.5 GB	`ollama run orca-mini:13b-v2-fp16`
13b-v2-q2_K	Typelocal	Inputstext	Digest77cd66457900	Download5.4 GB	Parameters13b	QuantizationQ2_K	Context2K	Est. memory≈ 7.5 GB	`ollama run orca-mini:13b-v2-q2_K`
13b-v2-q3_K_L	Typelocal	Inputstext	Digest039cea827fd3	Download6.9 GB	Parameters13b	QuantizationQ3_K_L	Context2K	Est. memory≈ 9 GB	`ollama run orca-mini:13b-v2-q3_K_L`
13b-v2-q3_K_M	Typelocal	Inputstext	Digestced974fd937d	Download6.3 GB	Parameters13b	QuantizationQ3_K_M	Context2K	Est. memory≈ 8.5 GB	`ollama run orca-mini:13b-v2-q3_K_M`
13b-v2-q3_K_S	Typelocal	Inputstext	Digeste87e20ccd984	Download5.7 GB	Parameters13b	QuantizationQ3_K_S	Context2K	Est. memory≈ 7.5 GB	`ollama run orca-mini:13b-v2-q3_K_S`
13b-v2-q4_0	Typelocal	Inputstext	Digest3e438b472999	Download7.4 GB	Parameters13b	QuantizationQ4_0	Context2K	Est. memory≈ 9.5 GB	`ollama run orca-mini:13b-v2-q4_0`
13b-v2-q4_1	Typelocal	Inputstext	Digest4ad005e5c90a	Download8.2 GB	Parameters13b	QuantizationQ4_1	Context2K	Est. memory≈ 10.5 GB	`ollama run orca-mini:13b-v2-q4_1`
13b-v2-q4_K_M	Typelocal	Inputstext	Digest0c79490ff43d	Download7.9 GB	Parameters13b	QuantizationQ4_K_M	Context2K	Est. memory≈ 10 GB	`ollama run orca-mini:13b-v2-q4_K_M`
13b-v2-q4_K_S	Typelocal	Inputstext	Digest579e615a7534	Download7.4 GB	Parameters13b	QuantizationQ4_K_S	Context2K	Est. memory≈ 9.5 GB	`ollama run orca-mini:13b-v2-q4_K_S`
13b-v2-q5_0	Typelocal	Inputstext	Digest988d2d90b3b0	Download9.0 GB	Parameters13b	QuantizationQ5_0	Context2K	Est. memory≈ 11.5 GB	`ollama run orca-mini:13b-v2-q5_0`
13b-v2-q5_1	Typelocal	Inputstext	Digestb293ce5356ed	Download9.8 GB	Parameters13b	QuantizationQ5_1	Context2K	Est. memory≈ 12 GB	`ollama run orca-mini:13b-v2-q5_1`
13b-v2-q5_K_M	Typelocal	Inputstext	Digest402e1a70ed67	Download9.2 GB	Parameters13b	QuantizationQ5_K_M	Context2K	Est. memory≈ 11.5 GB	`ollama run orca-mini:13b-v2-q5_K_M`
13b-v2-q5_K_S	Typelocal	Inputstext	Digestf4332ae13e4a	Download9.0 GB	Parameters13b	QuantizationQ5_K_S	Context2K	Est. memory≈ 11.5 GB	`ollama run orca-mini:13b-v2-q5_K_S`
13b-v2-q6_K	Typelocal	Inputstext	Digest12cfa06b9762	Download11 GB	Parameters13b	QuantizationQ6_K	Context2K	Est. memory≈ 13.5 GB	`ollama run orca-mini:13b-v2-q6_K`
13b-v2-q8_0	Typelocal	Inputstext	Digest17a9f01a8364	Download14 GB	Parameters13b	QuantizationQ8_0	Context2K	Est. memory≈ 17 GB	`ollama run orca-mini:13b-v2-q8_0`
13b-v3	Typelocal	Inputstext	Digest1b4877c90807	Download7.4 GB	Parameters13b	QuantizationUnknown	Context4K	Est. memory≈ 9.5 GB	`ollama run orca-mini:13b-v3`
13b-v3-fp16	Typelocal	Inputstext	Digest80bfde71168d	Download26 GB	Parameters13b	QuantizationFP16	Context4K	Est. memory≈ 30.5 GB	`ollama run orca-mini:13b-v3-fp16`
13b-v3-q2_K	Typelocal	Inputstext	Digest18c6529c1b31	Download5.4 GB	Parameters13b	QuantizationQ2_K	Context4K	Est. memory≈ 7.5 GB	`ollama run orca-mini:13b-v3-q2_K`
13b-v3-q3_K_L	Typelocal	Inputstext	Digest1e0ea2702693	Download6.9 GB	Parameters13b	QuantizationQ3_K_L	Context4K	Est. memory≈ 9 GB	`ollama run orca-mini:13b-v3-q3_K_L`
13b-v3-q3_K_M	Typelocal	Inputstext	Digestcd15b977684b	Download6.3 GB	Parameters13b	QuantizationQ3_K_M	Context4K	Est. memory≈ 8.5 GB	`ollama run orca-mini:13b-v3-q3_K_M`
13b-v3-q3_K_S	Typelocal	Inputstext	Digestfb5fe5934d97	Download5.7 GB	Parameters13b	QuantizationQ3_K_S	Context4K	Est. memory≈ 7.5 GB	`ollama run orca-mini:13b-v3-q3_K_S`
13b-v3-q4_0	Typelocal	Inputstext	Digest1b4877c90807	Download7.4 GB	Parameters13b	QuantizationQ4_0	Context4K	Est. memory≈ 9.5 GB	`ollama run orca-mini:13b-v3-q4_0`
13b-v3-q4_1	Typelocal	Inputstext	Digestbcffade49332	Download8.2 GB	Parameters13b	QuantizationQ4_1	Context4K	Est. memory≈ 10.5 GB	`ollama run orca-mini:13b-v3-q4_1`
13b-v3-q4_K_M	Typelocal	Inputstext	Digest47eb784e0b94	Download7.9 GB	Parameters13b	QuantizationQ4_K_M	Context4K	Est. memory≈ 10 GB	`ollama run orca-mini:13b-v3-q4_K_M`
13b-v3-q4_K_S	Typelocal	Inputstext	Digeste71486a020f5	Download7.4 GB	Parameters13b	QuantizationQ4_K_S	Context4K	Est. memory≈ 9.5 GB	`ollama run orca-mini:13b-v3-q4_K_S`
13b-v3-q5_0	Typelocal	Inputstext	Digest4d0b6a1fe56b	Download9.0 GB	Parameters13b	QuantizationQ5_0	Context4K	Est. memory≈ 11.5 GB	`ollama run orca-mini:13b-v3-q5_0`
13b-v3-q5_1	Typelocal	Inputstext	Digestbc17480cecbd	Download9.8 GB	Parameters13b	QuantizationQ5_1	Context4K	Est. memory≈ 12 GB	`ollama run orca-mini:13b-v3-q5_1`
13b-v3-q5_K_M	Typelocal	Inputstext	Digeste0062a6345f2	Download9.2 GB	Parameters13b	QuantizationQ5_K_M	Context4K	Est. memory≈ 11.5 GB	`ollama run orca-mini:13b-v3-q5_K_M`
13b-v3-q5_K_S	Typelocal	Inputstext	Digest25597b7203a0	Download9.0 GB	Parameters13b	QuantizationQ5_K_S	Context4K	Est. memory≈ 11.5 GB	`ollama run orca-mini:13b-v3-q5_K_S`
13b-v3-q6_K	Typelocal	Inputstext	Digestc67733d5f521	Download11 GB	Parameters13b	QuantizationQ6_K	Context4K	Est. memory≈ 13.5 GB	`ollama run orca-mini:13b-v3-q6_K`
13b-v3-q8_0	Typelocal	Inputstext	Digest22202d7bf265	Download14 GB	Parameters13b	QuantizationQ8_0	Context4K	Est. memory≈ 17 GB	`ollama run orca-mini:13b-v3-q8_0`
3b	Typelocal	Inputstext	Digest2dbd9f439647	Download2.0 GB	Parameters3b	QuantizationUnknown	Context2K	Est. memory≈ 3.5 GB	`ollama run orca-mini:3b`
3b-fp16	Typelocal	Inputstext	Digestf85802731409	Download6.9 GB	Parameters3b	QuantizationFP16	Context2K	Est. memory≈ 9 GB	`ollama run orca-mini:3b-fp16`
3b-q4_0	Typelocal	Inputstext	Digest2dbd9f439647	Download2.0 GB	Parameters3b	QuantizationQ4_0	Context2K	Est. memory≈ 3.5 GB	`ollama run orca-mini:3b-q4_0`
3b-q4_1	Typelocal	Inputstext	Digestbaaaf6d7885b	Download2.2 GB	Parameters3b	QuantizationQ4_1	Context2K	Est. memory≈ 3.5 GB	`ollama run orca-mini:3b-q4_1`
3b-q5_0	Typelocal	Inputstext	Digest6ab5f5489601	Download2.4 GB	Parameters3b	QuantizationQ5_0	Context2K	Est. memory≈ 4 GB	`ollama run orca-mini:3b-q5_0`
3b-q5_1	Typelocal	Inputstext	Digest4ad394056d0b	Download2.6 GB	Parameters3b	QuantizationQ5_1	Context2K	Est. memory≈ 4 GB	`ollama run orca-mini:3b-q5_1`
3b-q8_0	Typelocal	Inputstext	Digeste31654abca22	Download3.6 GB	Parameters3b	QuantizationQ8_0	Context2K	Est. memory≈ 5.5 GB	`ollama run orca-mini:3b-q8_0`
70b	Typelocal	Inputstext	Digestf184c0860491	Download39 GB	Parameters70b	QuantizationUnknown	Context4K	Est. memory≈ 45 GB	`ollama run orca-mini:70b`
70b-v3	Typelocal	Inputstext	Digestf184c0860491	Download39 GB	Parameters70b	QuantizationUnknown	Context4K	Est. memory≈ 45 GB	`ollama run orca-mini:70b-v3`
70b-v3-fp16	Typelocal	Inputstext	Digest423e70feb86a	Download138 GB	Parameters70b	QuantizationFP16	Context4K	Est. memory≈ 155.5 GB	`ollama run orca-mini:70b-v3-fp16`
70b-v3-q2_K	Typelocal	Inputstext	Digest28e06621edf0	Download29 GB	Parameters70b	QuantizationQ2_K	Context4K	Est. memory≈ 33.5 GB	`ollama run orca-mini:70b-v3-q2_K`
70b-v3-q3_K_L	Typelocal	Inputstext	Digestf7b928c050eb	Download36 GB	Parameters70b	QuantizationQ3_K_L	Context4K	Est. memory≈ 41.5 GB	`ollama run orca-mini:70b-v3-q3_K_L`
70b-v3-q3_K_M	Typelocal	Inputstext	Digest1d12e3416527	Download33 GB	Parameters70b	QuantizationQ3_K_M	Context4K	Est. memory≈ 38 GB	`ollama run orca-mini:70b-v3-q3_K_M`
70b-v3-q3_K_S	Typelocal	Inputstext	Digest5df07f064756	Download30 GB	Parameters70b	QuantizationQ3_K_S	Context4K	Est. memory≈ 35 GB	`ollama run orca-mini:70b-v3-q3_K_S`
70b-v3-q4_0	Typelocal	Inputstext	Digestf184c0860491	Download39 GB	Parameters70b	QuantizationQ4_0	Context4K	Est. memory≈ 45 GB	`ollama run orca-mini:70b-v3-q4_0`
70b-v3-q4_1	Typelocal	Inputstext	Digest210abd8a7b7a	Download43 GB	Parameters70b	QuantizationQ4_1	Context4K	Est. memory≈ 49.5 GB	`ollama run orca-mini:70b-v3-q4_1`
70b-v3-q4_K_M	Typelocal	Inputstext	Digest89313d84c131	Download41 GB	Parameters70b	QuantizationQ4_K_M	Context4K	Est. memory≈ 47 GB	`ollama run orca-mini:70b-v3-q4_K_M`
70b-v3-q4_K_S	Typelocal	Inputstext	Digest7f5fe7119c64	Download39 GB	Parameters70b	QuantizationQ4_K_S	Context4K	Est. memory≈ 45 GB	`ollama run orca-mini:70b-v3-q4_K_S`
70b-v3-q5_0	Typelocal	Inputstext	Digest0873d4fc8a05	Download47 GB	Parameters70b	QuantizationQ5_0	Context4K	Est. memory≈ 54 GB	`ollama run orca-mini:70b-v3-q5_0`
70b-v3-q5_1	Typelocal	Inputstext	Digest614a4b7f8c2d	Download52 GB	Parameters70b	QuantizationQ5_1	Context4K	Est. memory≈ 59.5 GB	`ollama run orca-mini:70b-v3-q5_1`
70b-v3-q5_K_M	Typelocal	Inputstext	Digestf6557e9aa182	Download49 GB	Parameters70b	QuantizationQ5_K_M	Context4K	Est. memory≈ 56 GB	`ollama run orca-mini:70b-v3-q5_K_M`
70b-v3-q5_K_S	Typelocal	Inputstext	Digestde93e5b2d85f	Download47 GB	Parameters70b	QuantizationQ5_K_S	Context4K	Est. memory≈ 54 GB	`ollama run orca-mini:70b-v3-q5_K_S`
70b-v3-q6_K	Typelocal	Inputstext	Digestcfdca07d69a0	Download57 GB	Parameters70b	QuantizationQ6_K	Context4K	Est. memory≈ 65 GB	`ollama run orca-mini:70b-v3-q6_K`
70b-v3-q8_0	Typelocal	Inputstext	Digest8f078884138d	Download73 GB	Parameters70b	QuantizationQ8_0	Context4K	Est. memory≈ 83 GB	`ollama run orca-mini:70b-v3-q8_0`
7b	Typelocal	Inputstext	Digest9c9618e2e895	Download3.8 GB	Parameters7b	QuantizationUnknown	Context4K	Est. memory≈ 5.5 GB	`ollama run orca-mini:7b`
7b-fp16	Typelocal	Inputstext	Digest8b7dcffd0a8a	Download13 GB	Parameters7b	QuantizationFP16	Context2K	Est. memory≈ 16 GB	`ollama run orca-mini:7b-fp16`
7b-q2_K	Typelocal	Inputstext	Digest629f61a16f8d	Download2.8 GB	Parameters7b	QuantizationQ2_K	Context2K	Est. memory≈ 4.5 GB	`ollama run orca-mini:7b-q2_K`
7b-q3_K_L	Typelocal	Inputstext	Digest678f10ad8ea6	Download3.6 GB	Parameters7b	QuantizationQ3_K_L	Context2K	Est. memory≈ 5.5 GB	`ollama run orca-mini:7b-q3_K_L`
7b-q3_K_M	Typelocal	Inputstext	Digest6f68c8ff61cc	Download3.3 GB	Parameters7b	QuantizationQ3_K_M	Context2K	Est. memory≈ 5 GB	`ollama run orca-mini:7b-q3_K_M`
7b-q3_K_S	Typelocal	Inputstext	Digest32d73761c966	Download2.9 GB	Parameters7b	QuantizationQ3_K_S	Context2K	Est. memory≈ 4.5 GB	`ollama run orca-mini:7b-q3_K_S`
7b-q4_0	Typelocal	Inputstext	Digest52f6f01e3ce0	Download3.8 GB	Parameters7b	QuantizationQ4_0	Context2K	Est. memory≈ 5.5 GB	`ollama run orca-mini:7b-q4_0`
7b-q4_1	Typelocal	Inputstext	Digesta8d2800046a7	Download4.2 GB	Parameters7b	QuantizationQ4_1	Context2K	Est. memory≈ 6 GB	`ollama run orca-mini:7b-q4_1`
7b-q4_K_M	Typelocal	Inputstext	Digest913e18f06270	Download4.1 GB	Parameters7b	QuantizationQ4_K_M	Context2K	Est. memory≈ 6 GB	`ollama run orca-mini:7b-q4_K_M`
7b-q4_K_S	Typelocal	Inputstext	Digestffb8dddf6fab	Download3.9 GB	Parameters7b	QuantizationQ4_K_S	Context2K	Est. memory≈ 5.5 GB	`ollama run orca-mini:7b-q4_K_S`
7b-q5_0	Typelocal	Inputstext	Digest4ab6288e4914	Download4.7 GB	Parameters7b	QuantizationQ5_0	Context2K	Est. memory≈ 6.5 GB	`ollama run orca-mini:7b-q5_0`
7b-q5_1	Typelocal	Inputstext	Digest2d46758c14de	Download5.1 GB	Parameters7b	QuantizationQ5_1	Context2K	Est. memory≈ 7 GB	`ollama run orca-mini:7b-q5_1`
7b-q5_K_M	Typelocal	Inputstext	Digestc7ba573e08a3	Download4.8 GB	Parameters7b	QuantizationQ5_K_M	Context2K	Est. memory≈ 6.5 GB	`ollama run orca-mini:7b-q5_K_M`
7b-q5_K_S	Typelocal	Inputstext	Digest3817a43d9eba	Download4.7 GB	Parameters7b	QuantizationQ5_K_S	Context2K	Est. memory≈ 6.5 GB	`ollama run orca-mini:7b-q5_K_S`
7b-q6_K	Typelocal	Inputstext	Digest637ee36ed8eb	Download5.5 GB	Parameters7b	QuantizationQ6_K	Context2K	Est. memory≈ 7.5 GB	`ollama run orca-mini:7b-q6_K`
7b-q8_0	Typelocal	Inputstext	Digest51fea4a8a2ce	Download7.2 GB	Parameters7b	QuantizationQ8_0	Context2K	Est. memory≈ 9.5 GB	`ollama run orca-mini:7b-q8_0`
7b-v2-fp16	Typelocal	Inputstext	Digest1a716fc27577	Download13 GB	Parameters7b	QuantizationFP16	Context2K	Est. memory≈ 16 GB	`ollama run orca-mini:7b-v2-fp16`
7b-v2-q2_K	Typelocal	Inputstext	Digestcf92e423fb3c	Download2.8 GB	Parameters7b	QuantizationQ2_K	Context2K	Est. memory≈ 4.5 GB	`ollama run orca-mini:7b-v2-q2_K`
7b-v2-q3_K_L	Typelocal	Inputstext	Digest07065b6e4ff7	Download3.6 GB	Parameters7b	QuantizationQ3_K_L	Context2K	Est. memory≈ 5.5 GB	`ollama run orca-mini:7b-v2-q3_K_L`
7b-v2-q3_K_M	Typelocal	Inputstext	Digest2b42986f156b	Download3.3 GB	Parameters7b	QuantizationQ3_K_M	Context2K	Est. memory≈ 5 GB	`ollama run orca-mini:7b-v2-q3_K_M`
7b-v2-q3_K_S	Typelocal	Inputstext	Digest8fa2889ecb51	Download2.9 GB	Parameters7b	QuantizationQ3_K_S	Context2K	Est. memory≈ 4.5 GB	`ollama run orca-mini:7b-v2-q3_K_S`
7b-v2-q4_0	Typelocal	Inputstext	Digestdb096cc7b3f9	Download3.8 GB	Parameters7b	QuantizationQ4_0	Context2K	Est. memory≈ 5.5 GB	`ollama run orca-mini:7b-v2-q4_0`
7b-v2-q4_1	Typelocal	Inputstext	Digestaee6823a849a	Download4.2 GB	Parameters7b	QuantizationQ4_1	Context2K	Est. memory≈ 6 GB	`ollama run orca-mini:7b-v2-q4_1`
7b-v2-q4_K_M	Typelocal	Inputstext	Digesteb586ac4d97f	Download4.1 GB	Parameters7b	QuantizationQ4_K_M	Context2K	Est. memory≈ 6 GB	`ollama run orca-mini:7b-v2-q4_K_M`
7b-v2-q4_K_S	Typelocal	Inputstext	Digest7ed973ab6559	Download3.9 GB	Parameters7b	QuantizationQ4_K_S	Context2K	Est. memory≈ 5.5 GB	`ollama run orca-mini:7b-v2-q4_K_S`
7b-v2-q5_0	Typelocal	Inputstext	Digest2c7a2952ffe9	Download4.7 GB	Parameters7b	QuantizationQ5_0	Context2K	Est. memory≈ 6.5 GB	`ollama run orca-mini:7b-v2-q5_0`
7b-v2-q5_1	Typelocal	Inputstext	Digeste9d24fc8a9ee	Download5.1 GB	Parameters7b	QuantizationQ5_1	Context2K	Est. memory≈ 7 GB	`ollama run orca-mini:7b-v2-q5_1`
7b-v2-q5_K_M	Typelocal	Inputstext	Digest3d950d4864ea	Download4.8 GB	Parameters7b	QuantizationQ5_K_M	Context2K	Est. memory≈ 6.5 GB	`ollama run orca-mini:7b-v2-q5_K_M`
7b-v2-q5_K_S	Typelocal	Inputstext	Digeste38ccaaaed8a	Download4.7 GB	Parameters7b	QuantizationQ5_K_S	Context2K	Est. memory≈ 6.5 GB	`ollama run orca-mini:7b-v2-q5_K_S`
7b-v2-q6_K	Typelocal	Inputstext	Digestd55eb108b6d2	Download5.5 GB	Parameters7b	QuantizationQ6_K	Context2K	Est. memory≈ 7.5 GB	`ollama run orca-mini:7b-v2-q6_K`
7b-v2-q8_0	Typelocal	Inputstext	Digest755b6f0925e9	Download7.2 GB	Parameters7b	QuantizationQ8_0	Context2K	Est. memory≈ 9.5 GB	`ollama run orca-mini:7b-v2-q8_0`
7b-v3	Typelocal	Inputstext	Digest9c9618e2e895	Download3.8 GB	Parameters7b	QuantizationUnknown	Context4K	Est. memory≈ 5.5 GB	`ollama run orca-mini:7b-v3`
7b-v3-fp16	Typelocal	Inputstext	Digest089339690b0a	Download13 GB	Parameters7b	QuantizationFP16	Context4K	Est. memory≈ 16 GB	`ollama run orca-mini:7b-v3-fp16`
7b-v3-q2_K	Typelocal	Inputstext	Digest1b17d4503dd9	Download2.8 GB	Parameters7b	QuantizationQ2_K	Context4K	Est. memory≈ 4.5 GB	`ollama run orca-mini:7b-v3-q2_K`
7b-v3-q3_K_L	Typelocal	Inputstext	Digest0c6a46e8fc6d	Download3.6 GB	Parameters7b	QuantizationQ3_K_L	Context4K	Est. memory≈ 5.5 GB	`ollama run orca-mini:7b-v3-q3_K_L`
7b-v3-q3_K_M	Typelocal	Inputstext	Digest5a6e8b1fe604	Download3.3 GB	Parameters7b	QuantizationQ3_K_M	Context4K	Est. memory≈ 5 GB	`ollama run orca-mini:7b-v3-q3_K_M`
7b-v3-q3_K_S	Typelocal	Inputstext	Digestf876ae8b69c2	Download2.9 GB	Parameters7b	QuantizationQ3_K_S	Context4K	Est. memory≈ 4.5 GB	`ollama run orca-mini:7b-v3-q3_K_S`
7b-v3-q4_0	Typelocal	Inputstext	Digest9c9618e2e895	Download3.8 GB	Parameters7b	QuantizationQ4_0	Context4K	Est. memory≈ 5.5 GB	`ollama run orca-mini:7b-v3-q4_0`
7b-v3-q4_1	Typelocal	Inputstext	Digest85670bb801a0	Download4.2 GB	Parameters7b	QuantizationQ4_1	Context4K	Est. memory≈ 6 GB	`ollama run orca-mini:7b-v3-q4_1`
7b-v3-q4_K_M	Typelocal	Inputstext	Digest2c472475e892	Download4.1 GB	Parameters7b	QuantizationQ4_K_M	Context4K	Est. memory≈ 6 GB	`ollama run orca-mini:7b-v3-q4_K_M`
7b-v3-q4_K_S	Typelocal	Inputstext	Digestdf1ac2dbb3eb	Download3.9 GB	Parameters7b	QuantizationQ4_K_S	Context4K	Est. memory≈ 5.5 GB	`ollama run orca-mini:7b-v3-q4_K_S`
7b-v3-q5_0	Typelocal	Inputstext	Digest98d33166886d	Download4.7 GB	Parameters7b	QuantizationQ5_0	Context4K	Est. memory≈ 6.5 GB	`ollama run orca-mini:7b-v3-q5_0`
7b-v3-q5_1	Typelocal	Inputstext	Digestc144d27c6729	Download5.1 GB	Parameters7b	QuantizationQ5_1	Context4K	Est. memory≈ 7 GB	`ollama run orca-mini:7b-v3-q5_1`
7b-v3-q5_K_M	Typelocal	Inputstext	Digest6518fa5b7aed	Download4.8 GB	Parameters7b	QuantizationQ5_K_M	Context4K	Est. memory≈ 6.5 GB	`ollama run orca-mini:7b-v3-q5_K_M`
7b-v3-q5_K_S	Typelocal	Inputstext	Digest806eac42db69	Download4.7 GB	Parameters7b	QuantizationQ5_K_S	Context4K	Est. memory≈ 6.5 GB	`ollama run orca-mini:7b-v3-q5_K_S`
7b-v3-q6_K	Typelocal	Inputstext	Digest702e61f3cc0a	Download5.5 GB	Parameters7b	QuantizationQ6_K	Context4K	Est. memory≈ 7.5 GB	`ollama run orca-mini:7b-v3-q6_K`
7b-v3-q8_0	Typelocal	Inputstext	Digest7707879d3793	Download7.2 GB	Parameters7b	QuantizationQ8_0	Context4K	Est. memory≈ 9.5 GB	`ollama run orca-mini:7b-v3-q8_0`
latestdefault	Typelocal	Inputstext	Digest2dbd9f439647	Download2.0 GB	ParametersUnknown	QuantizationUnknown	Context2K	Est. memory≈ 3.5 GB	`ollama run orca-mini:latest`

Related models

smallthinkerlocal

A new small reasoning model fine-tuned from the Qwen 2.5 3B Instruct model.

qwen3-vllocal

The most powerful vision-language model in the Qwen model family to date.

nemotron-minilocal

A commercial-friendly small language model by NVIDIA optimized for roleplay, RAG QA, and function calling.

cogitolocal

Cogito v1 Preview is a family of hybrid reasoning models by Deep Cogito that outperform the best available open models of the same size, including counterparts from LLaMA, DeepSeek, and Qwen across most standard benchmarks.