Quick start

ollama run orca2:latest

Runnable variants

Memory is a rough file-size estimate; context length, runtime and GPU offload change it.

12 of 33 matching variants shown.33 of 33 variants shown.

Tag	Type	Inputs	Digest	Download	Parameters	Quantization	Context	Est. memory	Run
13b	Typelocal	Inputstext	Digesta8dcfac3ac32	Download7.4 GB	Parameters13b	QuantizationUnknown	Context4K	Est. memory≈ 9.5 GB	`ollama run orca2:13b`
13b-fp16	Typelocal	Inputstext	Digest05c18f850182	Download26 GB	Parameters13b	QuantizationFP16	Context4K	Est. memory≈ 30.5 GB	`ollama run orca2:13b-fp16`
13b-q2_K	Typelocal	Inputstext	Digest1894951dcdf4	Download5.4 GB	Parameters13b	QuantizationQ2_K	Context4K	Est. memory≈ 7.5 GB	`ollama run orca2:13b-q2_K`
13b-q3_K_L	Typelocal	Inputstext	Digest9fcd1fe1c136	Download6.9 GB	Parameters13b	QuantizationQ3_K_L	Context4K	Est. memory≈ 9 GB	`ollama run orca2:13b-q3_K_L`
13b-q3_K_M	Typelocal	Inputstext	Digestbfb9c1d63867	Download6.3 GB	Parameters13b	QuantizationQ3_K_M	Context4K	Est. memory≈ 8.5 GB	`ollama run orca2:13b-q3_K_M`
13b-q3_K_S	Typelocal	Inputstext	Digest2f11b018f3d9	Download5.7 GB	Parameters13b	QuantizationQ3_K_S	Context4K	Est. memory≈ 7.5 GB	`ollama run orca2:13b-q3_K_S`
13b-q4_0	Typelocal	Inputstext	Digesta8dcfac3ac32	Download7.4 GB	Parameters13b	QuantizationQ4_0	Context4K	Est. memory≈ 9.5 GB	`ollama run orca2:13b-q4_0`
13b-q4_1	Typelocal	Inputstext	Digest5f4ea0781d67	Download8.2 GB	Parameters13b	QuantizationQ4_1	Context4K	Est. memory≈ 10.5 GB	`ollama run orca2:13b-q4_1`
13b-q4_K_M	Typelocal	Inputstext	Digestd379f87d30c1	Download7.9 GB	Parameters13b	QuantizationQ4_K_M	Context4K	Est. memory≈ 10 GB	`ollama run orca2:13b-q4_K_M`
13b-q4_K_S	Typelocal	Inputstext	Digest474f0b43f3d9	Download7.4 GB	Parameters13b	QuantizationQ4_K_S	Context4K	Est. memory≈ 9.5 GB	`ollama run orca2:13b-q4_K_S`
13b-q5_0	Typelocal	Inputstext	Digesteee22c031e7b	Download9.0 GB	Parameters13b	QuantizationQ5_0	Context4K	Est. memory≈ 11.5 GB	`ollama run orca2:13b-q5_0`
13b-q5_1	Typelocal	Inputstext	Digest3a321577ac7e	Download9.8 GB	Parameters13b	QuantizationQ5_1	Context4K	Est. memory≈ 12 GB	`ollama run orca2:13b-q5_1`
13b-q5_K_M	Typelocal	Inputstext	Digestd5e443067226	Download9.2 GB	Parameters13b	QuantizationQ5_K_M	Context4K	Est. memory≈ 11.5 GB	`ollama run orca2:13b-q5_K_M`
13b-q5_K_S	Typelocal	Inputstext	Digestf8e9283dfba9	Download9.0 GB	Parameters13b	QuantizationQ5_K_S	Context4K	Est. memory≈ 11.5 GB	`ollama run orca2:13b-q5_K_S`
13b-q6_K	Typelocal	Inputstext	Digest4c059cbdfec7	Download11 GB	Parameters13b	QuantizationQ6_K	Context4K	Est. memory≈ 13.5 GB	`ollama run orca2:13b-q6_K`
13b-q8_0	Typelocal	Inputstext	Digest4e9ddd77d77f	Download14 GB	Parameters13b	QuantizationQ8_0	Context4K	Est. memory≈ 17 GB	`ollama run orca2:13b-q8_0`
7b	Typelocal	Inputstext	Digestea98cc422de3	Download3.8 GB	Parameters7b	QuantizationUnknown	Context4K	Est. memory≈ 5.5 GB	`ollama run orca2:7b`
7b-fp16	Typelocal	Inputstext	Digest61bd6364c766	Download13 GB	Parameters7b	QuantizationFP16	Context4K	Est. memory≈ 16 GB	`ollama run orca2:7b-fp16`
7b-q2_K	Typelocal	Inputstext	Digest2f2dab4b40ee	Download2.8 GB	Parameters7b	QuantizationQ2_K	Context4K	Est. memory≈ 4.5 GB	`ollama run orca2:7b-q2_K`
7b-q3_K_L	Typelocal	Inputstext	Digest49d05d9decd4	Download3.6 GB	Parameters7b	QuantizationQ3_K_L	Context4K	Est. memory≈ 5.5 GB	`ollama run orca2:7b-q3_K_L`
7b-q3_K_M	Typelocal	Inputstext	Digestd4399b54aee2	Download3.3 GB	Parameters7b	QuantizationQ3_K_M	Context4K	Est. memory≈ 5 GB	`ollama run orca2:7b-q3_K_M`
7b-q3_K_S	Typelocal	Inputstext	Digestf0dd7ec070fa	Download2.9 GB	Parameters7b	QuantizationQ3_K_S	Context4K	Est. memory≈ 4.5 GB	`ollama run orca2:7b-q3_K_S`
7b-q4_0	Typelocal	Inputstext	Digestea98cc422de3	Download3.8 GB	Parameters7b	QuantizationQ4_0	Context4K	Est. memory≈ 5.5 GB	`ollama run orca2:7b-q4_0`
7b-q4_1	Typelocal	Inputstext	Digest3fea2b93215d	Download4.2 GB	Parameters7b	QuantizationQ4_1	Context4K	Est. memory≈ 6 GB	`ollama run orca2:7b-q4_1`
7b-q4_K_M	Typelocal	Inputstext	Digest93619d71625e	Download4.1 GB	Parameters7b	QuantizationQ4_K_M	Context4K	Est. memory≈ 6 GB	`ollama run orca2:7b-q4_K_M`
7b-q4_K_S	Typelocal	Inputstext	Digestd535ef02a017	Download3.9 GB	Parameters7b	QuantizationQ4_K_S	Context4K	Est. memory≈ 5.5 GB	`ollama run orca2:7b-q4_K_S`
7b-q5_0	Typelocal	Inputstext	Digest0da3e963986f	Download4.7 GB	Parameters7b	QuantizationQ5_0	Context4K	Est. memory≈ 6.5 GB	`ollama run orca2:7b-q5_0`
7b-q5_1	Typelocal	Inputstext	Digest9e505122b129	Download5.1 GB	Parameters7b	QuantizationQ5_1	Context4K	Est. memory≈ 7 GB	`ollama run orca2:7b-q5_1`
7b-q5_K_M	Typelocal	Inputstext	Digest156c325b1780	Download4.8 GB	Parameters7b	QuantizationQ5_K_M	Context4K	Est. memory≈ 6.5 GB	`ollama run orca2:7b-q5_K_M`
7b-q5_K_S	Typelocal	Inputstext	Digest8e8d3fad4a9c	Download4.7 GB	Parameters7b	QuantizationQ5_K_S	Context4K	Est. memory≈ 6.5 GB	`ollama run orca2:7b-q5_K_S`
7b-q6_K	Typelocal	Inputstext	Digest5268e870e74e	Download5.5 GB	Parameters7b	QuantizationQ6_K	Context4K	Est. memory≈ 7.5 GB	`ollama run orca2:7b-q6_K`
7b-q8_0	Typelocal	Inputstext	Digest74bc8213e567	Download7.2 GB	Parameters7b	QuantizationQ8_0	Context4K	Est. memory≈ 9.5 GB	`ollama run orca2:7b-q8_0`
latestdefault	Typelocal	Inputstext	Digestea98cc422de3	Download3.8 GB	ParametersUnknown	QuantizationUnknown	Context4K	Est. memory≈ 5.5 GB	`ollama run orca2:latest`

Related models

llama2local

Llama 2 is a collection of foundation language models ranging from 7B to 70B parameters.

codellamalocal

A large language model that can use text prompts to generate and discuss code.

llama2-uncensoredlocal

Uncensored Llama 2 model by George Sung and Jarrad Hope.

wizardcoderlocal

State-of-the-art code generation model