Quick start

ollama run nous-hermes:latest

Runnable variants

Memory is a rough file-size estimate; context length, runtime and GPU offload change it.

12 of 63 matching variants shown.63 of 63 variants shown.

Tag	Type	Inputs	Digest	Download	Parameters	Quantization	Context	Est. memory	Run
13b	Typelocal	Inputstext	Digeste6251854aa4c	Download7.4 GB	Parameters13b	QuantizationUnknown	Context4K	Est. memory≈ 9.5 GB	`ollama run nous-hermes:13b`
13b-fp16	Typelocal	Inputstext	Digest83e200dff28c	Download26 GB	Parameters13b	QuantizationFP16	Context2K	Est. memory≈ 30.5 GB	`ollama run nous-hermes:13b-fp16`
13b-llama2	Typelocal	Inputstext	Digeste6251854aa4c	Download7.4 GB	Parameters13b	QuantizationUnknown	Context4K	Est. memory≈ 9.5 GB	`ollama run nous-hermes:13b-llama2`
13b-llama2-fp16	Typelocal	Inputstext	Digest0e2f44eb0773	Download26 GB	Parameters13b	QuantizationFP16	Context4K	Est. memory≈ 30.5 GB	`ollama run nous-hermes:13b-llama2-fp16`
13b-llama2-q2_K	Typelocal	Inputstext	Digest351d072134ee	Download5.4 GB	Parameters13b	QuantizationQ2_K	Context4K	Est. memory≈ 7.5 GB	`ollama run nous-hermes:13b-llama2-q2_K`
13b-llama2-q3_K_L	Typelocal	Inputstext	Digest55510b4db076	Download6.9 GB	Parameters13b	QuantizationQ3_K_L	Context4K	Est. memory≈ 9 GB	`ollama run nous-hermes:13b-llama2-q3_K_L`
13b-llama2-q3_K_M	Typelocal	Inputstext	Digested2a0543a4f2	Download6.3 GB	Parameters13b	QuantizationQ3_K_M	Context4K	Est. memory≈ 8.5 GB	`ollama run nous-hermes:13b-llama2-q3_K_M`
13b-llama2-q3_K_S	Typelocal	Inputstext	Digest12fcbf2adcd7	Download5.7 GB	Parameters13b	QuantizationQ3_K_S	Context4K	Est. memory≈ 7.5 GB	`ollama run nous-hermes:13b-llama2-q3_K_S`
13b-llama2-q4_0	Typelocal	Inputstext	Digeste6251854aa4c	Download7.4 GB	Parameters13b	QuantizationQ4_0	Context4K	Est. memory≈ 9.5 GB	`ollama run nous-hermes:13b-llama2-q4_0`
13b-llama2-q4_1	Typelocal	Inputstext	Digest52cf8c8c1f43	Download8.2 GB	Parameters13b	QuantizationQ4_1	Context4K	Est. memory≈ 10.5 GB	`ollama run nous-hermes:13b-llama2-q4_1`
13b-llama2-q4_K_M	Typelocal	Inputstext	Digest2baf9b8ebbbc	Download7.9 GB	Parameters13b	QuantizationQ4_K_M	Context4K	Est. memory≈ 10 GB	`ollama run nous-hermes:13b-llama2-q4_K_M`
13b-llama2-q4_K_S	Typelocal	Inputstext	Digest26f1237d26d7	Download7.4 GB	Parameters13b	QuantizationQ4_K_S	Context4K	Est. memory≈ 9.5 GB	`ollama run nous-hermes:13b-llama2-q4_K_S`
13b-llama2-q5_0	Typelocal	Inputstext	Digestaa60531ab05e	Download9.0 GB	Parameters13b	QuantizationQ5_0	Context4K	Est. memory≈ 11.5 GB	`ollama run nous-hermes:13b-llama2-q5_0`
13b-llama2-q5_1	Typelocal	Inputstext	Digest301d1bce8506	Download9.8 GB	Parameters13b	QuantizationQ5_1	Context4K	Est. memory≈ 12 GB	`ollama run nous-hermes:13b-llama2-q5_1`
13b-llama2-q5_K_M	Typelocal	Inputstext	Digestf712a98ac03c	Download9.2 GB	Parameters13b	QuantizationQ5_K_M	Context4K	Est. memory≈ 11.5 GB	`ollama run nous-hermes:13b-llama2-q5_K_M`
13b-llama2-q5_K_S	Typelocal	Inputstext	Digest499c44fdcbf9	Download9.0 GB	Parameters13b	QuantizationQ5_K_S	Context4K	Est. memory≈ 11.5 GB	`ollama run nous-hermes:13b-llama2-q5_K_S`
13b-llama2-q6_K	Typelocal	Inputstext	Digesteedd114c4d95	Download11 GB	Parameters13b	QuantizationQ6_K	Context4K	Est. memory≈ 13.5 GB	`ollama run nous-hermes:13b-llama2-q6_K`
13b-llama2-q8_0	Typelocal	Inputstext	Digest7c6c80693fd9	Download14 GB	Parameters13b	QuantizationQ8_0	Context4K	Est. memory≈ 17 GB	`ollama run nous-hermes:13b-llama2-q8_0`
13b-q2_K	Typelocal	Inputstext	Digest5049c9c4bc2a	Download5.4 GB	Parameters13b	QuantizationQ2_K	Context2K	Est. memory≈ 7.5 GB	`ollama run nous-hermes:13b-q2_K`
13b-q3_K_L	Typelocal	Inputstext	Digestda82ae0a2f34	Download6.9 GB	Parameters13b	QuantizationQ3_K_L	Context2K	Est. memory≈ 9 GB	`ollama run nous-hermes:13b-q3_K_L`
13b-q3_K_M	Typelocal	Inputstext	Digest541fa538fcc0	Download6.3 GB	Parameters13b	QuantizationQ3_K_M	Context2K	Est. memory≈ 8.5 GB	`ollama run nous-hermes:13b-q3_K_M`
13b-q3_K_S	Typelocal	Inputstext	Digest88a44838868d	Download5.7 GB	Parameters13b	QuantizationQ3_K_S	Context2K	Est. memory≈ 7.5 GB	`ollama run nous-hermes:13b-q3_K_S`
13b-q4_0	Typelocal	Inputstext	Digest61fe5b2ccd82	Download7.4 GB	Parameters13b	QuantizationQ4_0	Context2K	Est. memory≈ 9.5 GB	`ollama run nous-hermes:13b-q4_0`
13b-q4_1	Typelocal	Inputstext	Digesta651d3847eac	Download8.2 GB	Parameters13b	QuantizationQ4_1	Context2K	Est. memory≈ 10.5 GB	`ollama run nous-hermes:13b-q4_1`
13b-q4_K_M	Typelocal	Inputstext	Digesta89c261261df	Download7.9 GB	Parameters13b	QuantizationQ4_K_M	Context2K	Est. memory≈ 10 GB	`ollama run nous-hermes:13b-q4_K_M`
13b-q4_K_S	Typelocal	Inputstext	Digestdfdcc8b0cb9b	Download7.4 GB	Parameters13b	QuantizationQ4_K_S	Context2K	Est. memory≈ 9.5 GB	`ollama run nous-hermes:13b-q4_K_S`
13b-q5_0	Typelocal	Inputstext	Digesteeb742832a51	Download9.0 GB	Parameters13b	QuantizationQ5_0	Context2K	Est. memory≈ 11.5 GB	`ollama run nous-hermes:13b-q5_0`
13b-q5_1	Typelocal	Inputstext	Digest038fe176c480	Download9.8 GB	Parameters13b	QuantizationQ5_1	Context2K	Est. memory≈ 12 GB	`ollama run nous-hermes:13b-q5_1`
13b-q5_K_M	Typelocal	Inputstext	Digest00a91bb87bab	Download9.2 GB	Parameters13b	QuantizationQ5_K_M	Context2K	Est. memory≈ 11.5 GB	`ollama run nous-hermes:13b-q5_K_M`
13b-q5_K_S	Typelocal	Inputstext	Digest9168dcc08386	Download9.0 GB	Parameters13b	QuantizationQ5_K_S	Context2K	Est. memory≈ 11.5 GB	`ollama run nous-hermes:13b-q5_K_S`
13b-q6_K	Typelocal	Inputstext	Digestd13a63be6cce	Download11 GB	Parameters13b	QuantizationQ6_K	Context2K	Est. memory≈ 13.5 GB	`ollama run nous-hermes:13b-q6_K`
13b-q8_0	Typelocal	Inputstext	Digest46d4bb81ee05	Download14 GB	Parameters13b	QuantizationQ8_0	Context2K	Est. memory≈ 17 GB	`ollama run nous-hermes:13b-q8_0`
70b-llama2-fp16	Typelocal	Inputstext	Digest1da6e95d6cea	Download138 GB	Parameters70b	QuantizationFP16	Context4K	Est. memory≈ 155.5 GB	`ollama run nous-hermes:70b-llama2-fp16`
70b-llama2-q2_K	Typelocal	Inputstext	Digest9c6cf2f685c9	Download29 GB	Parameters70b	QuantizationQ2_K	Context4K	Est. memory≈ 33.5 GB	`ollama run nous-hermes:70b-llama2-q2_K`
70b-llama2-q3_K_L	Typelocal	Inputstext	Digestc872f2a366df	Download36 GB	Parameters70b	QuantizationQ3_K_L	Context4K	Est. memory≈ 41.5 GB	`ollama run nous-hermes:70b-llama2-q3_K_L`
70b-llama2-q3_K_M	Typelocal	Inputstext	Digest32c31c64cdbf	Download33 GB	Parameters70b	QuantizationQ3_K_M	Context4K	Est. memory≈ 38 GB	`ollama run nous-hermes:70b-llama2-q3_K_M`
70b-llama2-q3_K_S	Typelocal	Inputstext	Digest18e62dbb016a	Download30 GB	Parameters70b	QuantizationQ3_K_S	Context4K	Est. memory≈ 35 GB	`ollama run nous-hermes:70b-llama2-q3_K_S`
70b-llama2-q4_0	Typelocal	Inputstext	Digestcadbb9c53eca	Download39 GB	Parameters70b	QuantizationQ4_0	Context4K	Est. memory≈ 45 GB	`ollama run nous-hermes:70b-llama2-q4_0`
70b-llama2-q4_1	Typelocal	Inputstext	Digest440fbf2182c3	Download43 GB	Parameters70b	QuantizationQ4_1	Context4K	Est. memory≈ 49.5 GB	`ollama run nous-hermes:70b-llama2-q4_1`
70b-llama2-q4_K_M	Typelocal	Inputstext	Digest21314c236bdf	Download41 GB	Parameters70b	QuantizationQ4_K_M	Context4K	Est. memory≈ 47 GB	`ollama run nous-hermes:70b-llama2-q4_K_M`
70b-llama2-q4_K_S	Typelocal	Inputstext	Digest12421faf08d0	Download39 GB	Parameters70b	QuantizationQ4_K_S	Context4K	Est. memory≈ 45 GB	`ollama run nous-hermes:70b-llama2-q4_K_S`
70b-llama2-q5_0	Typelocal	Inputstext	Digest122da3aab28d	Download47 GB	Parameters70b	QuantizationQ5_0	Context4K	Est. memory≈ 54 GB	`ollama run nous-hermes:70b-llama2-q5_0`
70b-llama2-q5_1	Typelocal	Inputstext	Digestb654542cc786	Download52 GB	Parameters70b	QuantizationQ5_1	Context4K	Est. memory≈ 59.5 GB	`ollama run nous-hermes:70b-llama2-q5_1`
70b-llama2-q5_K_M	Typelocal	Inputstext	Digest7add3f814c3c	Download49 GB	Parameters70b	QuantizationQ5_K_M	Context4K	Est. memory≈ 56 GB	`ollama run nous-hermes:70b-llama2-q5_K_M`
70b-llama2-q6_K	Typelocal	Inputstext	Digest110cec2e283d	Download57 GB	Parameters70b	QuantizationQ6_K	Context4K	Est. memory≈ 65 GB	`ollama run nous-hermes:70b-llama2-q6_K`
7b	Typelocal	Inputstext	Digest4bfb8ab0bd02	Download3.8 GB	Parameters7b	QuantizationUnknown	Context4K	Est. memory≈ 5.5 GB	`ollama run nous-hermes:7b`
7b-llama2	Typelocal	Inputstext	Digest4bfb8ab0bd02	Download3.8 GB	Parameters7b	QuantizationUnknown	Context4K	Est. memory≈ 5.5 GB	`ollama run nous-hermes:7b-llama2`
7b-llama2-fp16	Typelocal	Inputstext	Digest38afafe3e533	Download13 GB	Parameters7b	QuantizationFP16	Context4K	Est. memory≈ 16 GB	`ollama run nous-hermes:7b-llama2-fp16`
7b-llama2-q2_K	Typelocal	Inputstext	Digest4968fef8e8b9	Download2.8 GB	Parameters7b	QuantizationQ2_K	Context4K	Est. memory≈ 4.5 GB	`ollama run nous-hermes:7b-llama2-q2_K`
7b-llama2-q3_K_L	Typelocal	Inputstext	Digeste6a435b97b57	Download3.6 GB	Parameters7b	QuantizationQ3_K_L	Context4K	Est. memory≈ 5.5 GB	`ollama run nous-hermes:7b-llama2-q3_K_L`
7b-llama2-q3_K_M	Typelocal	Inputstext	Digest70cf80e138af	Download3.3 GB	Parameters7b	QuantizationQ3_K_M	Context4K	Est. memory≈ 5 GB	`ollama run nous-hermes:7b-llama2-q3_K_M`
7b-llama2-q3_K_S	Typelocal	Inputstext	Digest5969474f335c	Download2.9 GB	Parameters7b	QuantizationQ3_K_S	Context4K	Est. memory≈ 4.5 GB	`ollama run nous-hermes:7b-llama2-q3_K_S`
7b-llama2-q4_0	Typelocal	Inputstext	Digest4bfb8ab0bd02	Download3.8 GB	Parameters7b	QuantizationQ4_0	Context4K	Est. memory≈ 5.5 GB	`ollama run nous-hermes:7b-llama2-q4_0`
7b-llama2-q4_1	Typelocal	Inputstext	Digest52cda9e6f6da	Download4.2 GB	Parameters7b	QuantizationQ4_1	Context4K	Est. memory≈ 6 GB	`ollama run nous-hermes:7b-llama2-q4_1`
7b-llama2-q4_K_M	Typelocal	Inputstext	Digestab3cdd3e85cd	Download4.1 GB	Parameters7b	QuantizationQ4_K_M	Context4K	Est. memory≈ 6 GB	`ollama run nous-hermes:7b-llama2-q4_K_M`
7b-llama2-q4_K_S	Typelocal	Inputstext	Digest8040a0492349	Download3.9 GB	Parameters7b	QuantizationQ4_K_S	Context4K	Est. memory≈ 5.5 GB	`ollama run nous-hermes:7b-llama2-q4_K_S`
7b-llama2-q5_0	Typelocal	Inputstext	Digestc6a3388bcc53	Download4.7 GB	Parameters7b	QuantizationQ5_0	Context4K	Est. memory≈ 6.5 GB	`ollama run nous-hermes:7b-llama2-q5_0`
7b-llama2-q5_1	Typelocal	Inputstext	Digest3c0e1768c975	Download5.1 GB	Parameters7b	QuantizationQ5_1	Context4K	Est. memory≈ 7 GB	`ollama run nous-hermes:7b-llama2-q5_1`
7b-llama2-q5_K_M	Typelocal	Inputstext	Digest177be89aeec9	Download4.8 GB	Parameters7b	QuantizationQ5_K_M	Context4K	Est. memory≈ 6.5 GB	`ollama run nous-hermes:7b-llama2-q5_K_M`
7b-llama2-q5_K_S	Typelocal	Inputstext	Digest2b05878efeb9	Download4.7 GB	Parameters7b	QuantizationQ5_K_S	Context4K	Est. memory≈ 6.5 GB	`ollama run nous-hermes:7b-llama2-q5_K_S`
7b-llama2-q6_K	Typelocal	Inputstext	Digeste9913ad528c9	Download5.5 GB	Parameters7b	QuantizationQ6_K	Context4K	Est. memory≈ 7.5 GB	`ollama run nous-hermes:7b-llama2-q6_K`
7b-llama2-q8_0	Typelocal	Inputstext	Digesta512e84c0ad5	Download7.2 GB	Parameters7b	QuantizationQ8_0	Context4K	Est. memory≈ 9.5 GB	`ollama run nous-hermes:7b-llama2-q8_0`
latestdefault	Typelocal	Inputstext	Digest4bfb8ab0bd02	Download3.8 GB	ParametersUnknown	QuantizationUnknown	Context4K	Est. memory≈ 5.5 GB	`ollama run nous-hermes:latest`

Related models

llama2local

Llama 2 is a collection of foundation language models ranging from 7B to 70B parameters.

codellamalocal

A large language model that can use text prompts to generate and discuss code.

llama2-uncensoredlocal

Uncensored Llama 2 model by George Sung and Jarrad Hope.

wizardcoderlocal

State-of-the-art code generation model