Quick start

ollama run neural-chat:latest

Runnable variants

Memory is a rough file-size estimate; context length, runtime and GPU offload change it.

12 of 50 matching variants shown.50 of 50 variants shown.

Tag	Type	Inputs	Digest	Download	Parameters	Quantization	Context	Est. memory	Run
7b	Typelocal	Inputstext	Digest89fa737d3b85	Download4.1 GB	Parameters7b	QuantizationUnknown	Context32K	Est. memory≈ 6 GB	`ollama run neural-chat:7b`
7b-v3.1	Typelocal	Inputstext	Digest73940af9fe02	Download4.1 GB	Parameters7b	QuantizationUnknown	Context32K	Est. memory≈ 6 GB	`ollama run neural-chat:7b-v3.1`
7b-v3.1-fp16	Typelocal	Inputstext	Digest1b3251040972	Download14 GB	Parameters7b	QuantizationFP16	Context32K	Est. memory≈ 17 GB	`ollama run neural-chat:7b-v3.1-fp16`
7b-v3.1-q2_K	Typelocal	Inputstext	Digest620f8a81424b	Download3.1 GB	Parameters7b	QuantizationQ2_K	Context32K	Est. memory≈ 4.5 GB	`ollama run neural-chat:7b-v3.1-q2_K`
7b-v3.1-q3_K_L	Typelocal	Inputstext	Digestacf7b66e2aee	Download3.8 GB	Parameters7b	QuantizationQ3_K_L	Context32K	Est. memory≈ 5.5 GB	`ollama run neural-chat:7b-v3.1-q3_K_L`
7b-v3.1-q3_K_M	Typelocal	Inputstext	Digestcf3dc2d014a5	Download3.5 GB	Parameters7b	QuantizationQ3_K_M	Context32K	Est. memory≈ 5 GB	`ollama run neural-chat:7b-v3.1-q3_K_M`
7b-v3.1-q3_K_S	Typelocal	Inputstext	Digest7825c6bd7656	Download3.2 GB	Parameters7b	QuantizationQ3_K_S	Context32K	Est. memory≈ 5 GB	`ollama run neural-chat:7b-v3.1-q3_K_S`
7b-v3.1-q4_0	Typelocal	Inputstext	Digest73940af9fe02	Download4.1 GB	Parameters7b	QuantizationQ4_0	Context32K	Est. memory≈ 6 GB	`ollama run neural-chat:7b-v3.1-q4_0`
7b-v3.1-q4_1	Typelocal	Inputstext	Digeste94062f979ad	Download4.6 GB	Parameters7b	QuantizationQ4_1	Context32K	Est. memory≈ 6.5 GB	`ollama run neural-chat:7b-v3.1-q4_1`
7b-v3.1-q4_K_M	Typelocal	Inputstext	Digestd2fbc68137fc	Download4.4 GB	Parameters7b	QuantizationQ4_K_M	Context32K	Est. memory≈ 6 GB	`ollama run neural-chat:7b-v3.1-q4_K_M`
7b-v3.1-q4_K_S	Typelocal	Inputstext	Digest7d8b92a60fab	Download4.1 GB	Parameters7b	QuantizationQ4_K_S	Context32K	Est. memory≈ 6 GB	`ollama run neural-chat:7b-v3.1-q4_K_S`
7b-v3.1-q5_0	Typelocal	Inputstext	Digestb31c14a4bfcf	Download5.0 GB	Parameters7b	QuantizationQ5_0	Context32K	Est. memory≈ 7 GB	`ollama run neural-chat:7b-v3.1-q5_0`
7b-v3.1-q5_1	Typelocal	Inputstext	Digest874ed3640927	Download5.4 GB	Parameters7b	QuantizationQ5_1	Context32K	Est. memory≈ 7.5 GB	`ollama run neural-chat:7b-v3.1-q5_1`
7b-v3.1-q5_K_M	Typelocal	Inputstext	Digestf36c54b7e769	Download5.1 GB	Parameters7b	QuantizationQ5_K_M	Context32K	Est. memory≈ 7 GB	`ollama run neural-chat:7b-v3.1-q5_K_M`
7b-v3.1-q5_K_S	Typelocal	Inputstext	Digestd2c083566569	Download5.0 GB	Parameters7b	QuantizationQ5_K_S	Context32K	Est. memory≈ 7 GB	`ollama run neural-chat:7b-v3.1-q5_K_S`
7b-v3.1-q6_K	Typelocal	Inputstext	Digest824a1e326c89	Download5.9 GB	Parameters7b	QuantizationQ6_K	Context32K	Est. memory≈ 8 GB	`ollama run neural-chat:7b-v3.1-q6_K`
7b-v3.1-q8_0	Typelocal	Inputstext	Digest2965939336f6	Download7.7 GB	Parameters7b	QuantizationQ8_0	Context32K	Est. memory≈ 10 GB	`ollama run neural-chat:7b-v3.1-q8_0`
7b-v3.2	Typelocal	Inputstext	Digestf4c6a8e532e8	Download4.1 GB	Parameters7b	QuantizationUnknown	Context32K	Est. memory≈ 6 GB	`ollama run neural-chat:7b-v3.2`
7b-v3.2-fp16	Typelocal	Inputstext	Digestf5256ca4757e	Download14 GB	Parameters7b	QuantizationFP16	Context32K	Est. memory≈ 17 GB	`ollama run neural-chat:7b-v3.2-fp16`
7b-v3.2-q2_K	Typelocal	Inputstext	Digest103bcb6b16f2	Download3.1 GB	Parameters7b	QuantizationQ2_K	Context32K	Est. memory≈ 4.5 GB	`ollama run neural-chat:7b-v3.2-q2_K`
7b-v3.2-q3_K_L	Typelocal	Inputstext	Digest66750b08787d	Download3.8 GB	Parameters7b	QuantizationQ3_K_L	Context32K	Est. memory≈ 5.5 GB	`ollama run neural-chat:7b-v3.2-q3_K_L`
7b-v3.2-q3_K_M	Typelocal	Inputstext	Digestf719737f98a2	Download3.5 GB	Parameters7b	QuantizationQ3_K_M	Context32K	Est. memory≈ 5 GB	`ollama run neural-chat:7b-v3.2-q3_K_M`
7b-v3.2-q3_K_S	Typelocal	Inputstext	Digestaac750b8a41e	Download3.2 GB	Parameters7b	QuantizationQ3_K_S	Context32K	Est. memory≈ 5 GB	`ollama run neural-chat:7b-v3.2-q3_K_S`
7b-v3.2-q4_0	Typelocal	Inputstext	Digestf4c6a8e532e8	Download4.1 GB	Parameters7b	QuantizationQ4_0	Context32K	Est. memory≈ 6 GB	`ollama run neural-chat:7b-v3.2-q4_0`
7b-v3.2-q4_1	Typelocal	Inputstext	Digest7a06e87d4696	Download4.6 GB	Parameters7b	QuantizationQ4_1	Context32K	Est. memory≈ 6.5 GB	`ollama run neural-chat:7b-v3.2-q4_1`
7b-v3.2-q4_K_M	Typelocal	Inputstext	Digest33172df918d2	Download4.4 GB	Parameters7b	QuantizationQ4_K_M	Context32K	Est. memory≈ 6 GB	`ollama run neural-chat:7b-v3.2-q4_K_M`
7b-v3.2-q4_K_S	Typelocal	Inputstext	Digest4a8f50c4525a	Download4.1 GB	Parameters7b	QuantizationQ4_K_S	Context32K	Est. memory≈ 6 GB	`ollama run neural-chat:7b-v3.2-q4_K_S`
7b-v3.2-q5_0	Typelocal	Inputstext	Digest070678810598	Download5.0 GB	Parameters7b	QuantizationQ5_0	Context32K	Est. memory≈ 7 GB	`ollama run neural-chat:7b-v3.2-q5_0`
7b-v3.2-q5_1	Typelocal	Inputstext	Digest379f3f601243	Download5.4 GB	Parameters7b	QuantizationQ5_1	Context32K	Est. memory≈ 7.5 GB	`ollama run neural-chat:7b-v3.2-q5_1`
7b-v3.2-q5_K_M	Typelocal	Inputstext	Digest4f8475c82182	Download5.1 GB	Parameters7b	QuantizationQ5_K_M	Context32K	Est. memory≈ 7 GB	`ollama run neural-chat:7b-v3.2-q5_K_M`
7b-v3.2-q5_K_S	Typelocal	Inputstext	Digest79ae554db28d	Download5.0 GB	Parameters7b	QuantizationQ5_K_S	Context32K	Est. memory≈ 7 GB	`ollama run neural-chat:7b-v3.2-q5_K_S`
7b-v3.2-q6_K	Typelocal	Inputstext	Digest9c0c2ea9c046	Download5.9 GB	Parameters7b	QuantizationQ6_K	Context32K	Est. memory≈ 8 GB	`ollama run neural-chat:7b-v3.2-q6_K`
7b-v3.2-q8_0	Typelocal	Inputstext	Digest6e958fe1fd6e	Download7.7 GB	Parameters7b	QuantizationQ8_0	Context32K	Est. memory≈ 10 GB	`ollama run neural-chat:7b-v3.2-q8_0`
7b-v3.3	Typelocal	Inputstext	Digest89fa737d3b85	Download4.1 GB	Parameters7b	QuantizationUnknown	Context32K	Est. memory≈ 6 GB	`ollama run neural-chat:7b-v3.3`
7b-v3.3-fp16	Typelocal	Inputstext	Digest7b7e1b58d372	Download14 GB	Parameters7b	QuantizationFP16	Context32K	Est. memory≈ 17 GB	`ollama run neural-chat:7b-v3.3-fp16`
7b-v3.3-q2_K	Typelocal	Inputstext	Digest85dca14ccac6	Download3.1 GB	Parameters7b	QuantizationQ2_K	Context32K	Est. memory≈ 4.5 GB	`ollama run neural-chat:7b-v3.3-q2_K`
7b-v3.3-q3_K_L	Typelocal	Inputstext	Digest5b9c964d9ac8	Download3.8 GB	Parameters7b	QuantizationQ3_K_L	Context32K	Est. memory≈ 5.5 GB	`ollama run neural-chat:7b-v3.3-q3_K_L`
7b-v3.3-q3_K_M	Typelocal	Inputstext	Digest189d5ae31c17	Download3.5 GB	Parameters7b	QuantizationQ3_K_M	Context32K	Est. memory≈ 5 GB	`ollama run neural-chat:7b-v3.3-q3_K_M`
7b-v3.3-q3_K_S	Typelocal	Inputstext	Digest645fb17707c9	Download3.2 GB	Parameters7b	QuantizationQ3_K_S	Context32K	Est. memory≈ 5 GB	`ollama run neural-chat:7b-v3.3-q3_K_S`
7b-v3.3-q4_0	Typelocal	Inputstext	Digest89fa737d3b85	Download4.1 GB	Parameters7b	QuantizationQ4_0	Context32K	Est. memory≈ 6 GB	`ollama run neural-chat:7b-v3.3-q4_0`
7b-v3.3-q4_1	Typelocal	Inputstext	Digeste081f623106e	Download4.6 GB	Parameters7b	QuantizationQ4_1	Context32K	Est. memory≈ 6.5 GB	`ollama run neural-chat:7b-v3.3-q4_1`
7b-v3.3-q4_K_M	Typelocal	Inputstext	Digestb1a7b3b85566	Download4.4 GB	Parameters7b	QuantizationQ4_K_M	Context32K	Est. memory≈ 6 GB	`ollama run neural-chat:7b-v3.3-q4_K_M`
7b-v3.3-q4_K_S	Typelocal	Inputstext	Digest07c6aaab950b	Download4.1 GB	Parameters7b	QuantizationQ4_K_S	Context32K	Est. memory≈ 6 GB	`ollama run neural-chat:7b-v3.3-q4_K_S`
7b-v3.3-q5_0	Typelocal	Inputstext	Digestf5372fe561c2	Download5.0 GB	Parameters7b	QuantizationQ5_0	Context32K	Est. memory≈ 7 GB	`ollama run neural-chat:7b-v3.3-q5_0`
7b-v3.3-q5_1	Typelocal	Inputstext	Digestb8ba685c1303	Download5.4 GB	Parameters7b	QuantizationQ5_1	Context32K	Est. memory≈ 7.5 GB	`ollama run neural-chat:7b-v3.3-q5_1`
7b-v3.3-q5_K_M	Typelocal	Inputstext	Digest6e7f6242bbec	Download5.1 GB	Parameters7b	QuantizationQ5_K_M	Context32K	Est. memory≈ 7 GB	`ollama run neural-chat:7b-v3.3-q5_K_M`
7b-v3.3-q5_K_S	Typelocal	Inputstext	Digestfb872be705fd	Download5.0 GB	Parameters7b	QuantizationQ5_K_S	Context32K	Est. memory≈ 7 GB	`ollama run neural-chat:7b-v3.3-q5_K_S`
7b-v3.3-q6_K	Typelocal	Inputstext	Digest3098763b2a1d	Download5.9 GB	Parameters7b	QuantizationQ6_K	Context32K	Est. memory≈ 8 GB	`ollama run neural-chat:7b-v3.3-q6_K`
7b-v3.3-q8_0	Typelocal	Inputstext	Digestfc8c63cac8c7	Download7.7 GB	Parameters7b	QuantizationQ8_0	Context32K	Est. memory≈ 10 GB	`ollama run neural-chat:7b-v3.3-q8_0`
latestdefault	Typelocal	Inputstext	Digest89fa737d3b85	Download4.1 GB	ParametersUnknown	QuantizationUnknown	Context32K	Est. memory≈ 6 GB	`ollama run neural-chat:latest`

Related models

sqlcoderlocal

SQLCoder is a code completion model fined-tuned on StarCoder for SQL generation tasks

openchatlocal

A family of open-source models trained on a wide variety of data, surpassing ChatGPT on various benchmarks. Updated to version 3.5-0106.

openhermeslocal

OpenHermes 2.5 is a 7B model fine-tuned by Teknium on Mistral with fully open datasets.

zephyrlocal

Zephyr is a series of fine-tuned versions of the Mistral and Mixtral models that are trained to act as helpful assistants.