Quick start

ollama run openchat:latest

Runnable variants

Memory is a rough file-size estimate; context length, runtime and GPU offload change it.

12 of 50 matching variants shown.50 of 50 variants shown.

Tag	Type	Inputs	Digest	Download	Parameters	Quantization	Context	Est. memory	Run
7b	Typelocal	Inputstext	Digest537a4e03b649	Download4.1 GB	Parameters7b	QuantizationUnknown	Context8K	Est. memory≈ 6 GB	`ollama run openchat:7b`
7b-v3.5	Typelocal	Inputstext	Digest980eba937c08	Download4.1 GB	Parameters7b	QuantizationUnknown	Context8K	Est. memory≈ 6 GB	`ollama run openchat:7b-v3.5`
7b-v3.5-0106	Typelocal	Inputstext	Digest537a4e03b649	Download4.1 GB	Parameters7b	QuantizationUnknown	Context8K	Est. memory≈ 6 GB	`ollama run openchat:7b-v3.5-0106`
7b-v3.5-0106-fp16	Typelocal	Inputstext	Digest904ff9758131	Download14 GB	Parameters7b	QuantizationFP16	Context8K	Est. memory≈ 17 GB	`ollama run openchat:7b-v3.5-0106-fp16`
7b-v3.5-0106-q2_K	Typelocal	Inputstext	Digest40a9b8bdcd51	Download3.1 GB	Parameters7b	QuantizationQ2_K	Context8K	Est. memory≈ 4.5 GB	`ollama run openchat:7b-v3.5-0106-q2_K`
7b-v3.5-0106-q3_K_L	Typelocal	Inputstext	Digest7c4478e7725d	Download3.8 GB	Parameters7b	QuantizationQ3_K_L	Context8K	Est. memory≈ 5.5 GB	`ollama run openchat:7b-v3.5-0106-q3_K_L`
7b-v3.5-0106-q3_K_M	Typelocal	Inputstext	Digest76cd9a0c98ff	Download3.5 GB	Parameters7b	QuantizationQ3_K_M	Context8K	Est. memory≈ 5 GB	`ollama run openchat:7b-v3.5-0106-q3_K_M`
7b-v3.5-0106-q3_K_S	Typelocal	Inputstext	Digest43be12a77c78	Download3.2 GB	Parameters7b	QuantizationQ3_K_S	Context8K	Est. memory≈ 5 GB	`ollama run openchat:7b-v3.5-0106-q3_K_S`
7b-v3.5-0106-q4_0	Typelocal	Inputstext	Digest537a4e03b649	Download4.1 GB	Parameters7b	QuantizationQ4_0	Context8K	Est. memory≈ 6 GB	`ollama run openchat:7b-v3.5-0106-q4_0`
7b-v3.5-0106-q4_1	Typelocal	Inputstext	Digest029a27df0e0e	Download4.6 GB	Parameters7b	QuantizationQ4_1	Context8K	Est. memory≈ 6.5 GB	`ollama run openchat:7b-v3.5-0106-q4_1`
7b-v3.5-0106-q4_K_M	Typelocal	Inputstext	Digest606fbe86851f	Download4.4 GB	Parameters7b	QuantizationQ4_K_M	Context8K	Est. memory≈ 6 GB	`ollama run openchat:7b-v3.5-0106-q4_K_M`
7b-v3.5-0106-q4_K_S	Typelocal	Inputstext	Digestfe011350d88f	Download4.1 GB	Parameters7b	QuantizationQ4_K_S	Context8K	Est. memory≈ 6 GB	`ollama run openchat:7b-v3.5-0106-q4_K_S`
7b-v3.5-0106-q5_0	Typelocal	Inputstext	Digestbf796ce1e6e4	Download5.0 GB	Parameters7b	QuantizationQ5_0	Context8K	Est. memory≈ 7 GB	`ollama run openchat:7b-v3.5-0106-q5_0`
7b-v3.5-0106-q5_1	Typelocal	Inputstext	Digest87023ab68886	Download5.4 GB	Parameters7b	QuantizationQ5_1	Context8K	Est. memory≈ 7.5 GB	`ollama run openchat:7b-v3.5-0106-q5_1`
7b-v3.5-0106-q5_K_M	Typelocal	Inputstext	Digest75e83c02831a	Download5.1 GB	Parameters7b	QuantizationQ5_K_M	Context8K	Est. memory≈ 7 GB	`ollama run openchat:7b-v3.5-0106-q5_K_M`
7b-v3.5-0106-q5_K_S	Typelocal	Inputstext	Digest6ed7bb1af154	Download5.0 GB	Parameters7b	QuantizationQ5_K_S	Context8K	Est. memory≈ 7 GB	`ollama run openchat:7b-v3.5-0106-q5_K_S`
7b-v3.5-0106-q6_K	Typelocal	Inputstext	Digest068f00f96fbf	Download5.9 GB	Parameters7b	QuantizationQ6_K	Context8K	Est. memory≈ 8 GB	`ollama run openchat:7b-v3.5-0106-q6_K`
7b-v3.5-0106-q8_0	Typelocal	Inputstext	Digest54a3b6ecd5ec	Download7.7 GB	Parameters7b	QuantizationQ8_0	Context8K	Est. memory≈ 10 GB	`ollama run openchat:7b-v3.5-0106-q8_0`
7b-v3.5-1210	Typelocal	Inputstext	Digestaa6d10add428	Download4.1 GB	Parameters7b	QuantizationUnknown	Context8K	Est. memory≈ 6 GB	`ollama run openchat:7b-v3.5-1210`
7b-v3.5-1210-fp16	Typelocal	Inputstext	Digest24a0134d29f6	Download14 GB	Parameters7b	QuantizationFP16	Context8K	Est. memory≈ 17 GB	`ollama run openchat:7b-v3.5-1210-fp16`
7b-v3.5-1210-q2_K	Typelocal	Inputstext	Digest90cfa4fd3ee4	Download3.1 GB	Parameters7b	QuantizationQ2_K	Context8K	Est. memory≈ 4.5 GB	`ollama run openchat:7b-v3.5-1210-q2_K`
7b-v3.5-1210-q3_K_L	Typelocal	Inputstext	Digestcdab528998e3	Download3.8 GB	Parameters7b	QuantizationQ3_K_L	Context8K	Est. memory≈ 5.5 GB	`ollama run openchat:7b-v3.5-1210-q3_K_L`
7b-v3.5-1210-q3_K_M	Typelocal	Inputstext	Digestad84860337cb	Download3.5 GB	Parameters7b	QuantizationQ3_K_M	Context8K	Est. memory≈ 5 GB	`ollama run openchat:7b-v3.5-1210-q3_K_M`
7b-v3.5-1210-q3_K_S	Typelocal	Inputstext	Digest4a07652bf006	Download3.2 GB	Parameters7b	QuantizationQ3_K_S	Context8K	Est. memory≈ 5 GB	`ollama run openchat:7b-v3.5-1210-q3_K_S`
7b-v3.5-1210-q4_0	Typelocal	Inputstext	Digestaa6d10add428	Download4.1 GB	Parameters7b	QuantizationQ4_0	Context8K	Est. memory≈ 6 GB	`ollama run openchat:7b-v3.5-1210-q4_0`
7b-v3.5-1210-q4_1	Typelocal	Inputstext	Digest525ce9ede1d8	Download4.6 GB	Parameters7b	QuantizationQ4_1	Context8K	Est. memory≈ 6.5 GB	`ollama run openchat:7b-v3.5-1210-q4_1`
7b-v3.5-1210-q4_K_M	Typelocal	Inputstext	Digestc0f6439075b8	Download4.4 GB	Parameters7b	QuantizationQ4_K_M	Context8K	Est. memory≈ 6 GB	`ollama run openchat:7b-v3.5-1210-q4_K_M`
7b-v3.5-1210-q4_K_S	Typelocal	Inputstext	Digest8d50e6d40482	Download4.1 GB	Parameters7b	QuantizationQ4_K_S	Context8K	Est. memory≈ 6 GB	`ollama run openchat:7b-v3.5-1210-q4_K_S`
7b-v3.5-1210-q5_0	Typelocal	Inputstext	Digest4c6db90c2db0	Download5.0 GB	Parameters7b	QuantizationQ5_0	Context8K	Est. memory≈ 7 GB	`ollama run openchat:7b-v3.5-1210-q5_0`
7b-v3.5-1210-q5_1	Typelocal	Inputstext	Digest2185cdd08ed8	Download5.4 GB	Parameters7b	QuantizationQ5_1	Context8K	Est. memory≈ 7.5 GB	`ollama run openchat:7b-v3.5-1210-q5_1`
7b-v3.5-1210-q5_K_M	Typelocal	Inputstext	Digest64e4cb9bb506	Download5.1 GB	Parameters7b	QuantizationQ5_K_M	Context8K	Est. memory≈ 7 GB	`ollama run openchat:7b-v3.5-1210-q5_K_M`
7b-v3.5-1210-q5_K_S	Typelocal	Inputstext	Digestf78feecd69cf	Download5.0 GB	Parameters7b	QuantizationQ5_K_S	Context8K	Est. memory≈ 7 GB	`ollama run openchat:7b-v3.5-1210-q5_K_S`
7b-v3.5-1210-q6_K	Typelocal	Inputstext	Digest2f844aee86ba	Download5.9 GB	Parameters7b	QuantizationQ6_K	Context8K	Est. memory≈ 8 GB	`ollama run openchat:7b-v3.5-1210-q6_K`
7b-v3.5-1210-q8_0	Typelocal	Inputstext	Digest2911bfb27389	Download7.7 GB	Parameters7b	QuantizationQ8_0	Context8K	Est. memory≈ 10 GB	`ollama run openchat:7b-v3.5-1210-q8_0`
7b-v3.5-fp16	Typelocal	Inputstext	Digestb2cb2e8359a3	Download14 GB	Parameters7b	QuantizationFP16	Context8K	Est. memory≈ 17 GB	`ollama run openchat:7b-v3.5-fp16`
7b-v3.5-q2_K	Typelocal	Inputstext	Digestc8a422048247	Download3.1 GB	Parameters7b	QuantizationQ2_K	Context8K	Est. memory≈ 4.5 GB	`ollama run openchat:7b-v3.5-q2_K`
7b-v3.5-q3_K_L	Typelocal	Inputstext	Digestcce7d2d85cc1	Download3.8 GB	Parameters7b	QuantizationQ3_K_L	Context8K	Est. memory≈ 5.5 GB	`ollama run openchat:7b-v3.5-q3_K_L`
7b-v3.5-q3_K_M	Typelocal	Inputstext	Digestbb9a71d66b29	Download3.5 GB	Parameters7b	QuantizationQ3_K_M	Context8K	Est. memory≈ 5 GB	`ollama run openchat:7b-v3.5-q3_K_M`
7b-v3.5-q3_K_S	Typelocal	Inputstext	Digest961a8432de51	Download3.2 GB	Parameters7b	QuantizationQ3_K_S	Context8K	Est. memory≈ 5 GB	`ollama run openchat:7b-v3.5-q3_K_S`
7b-v3.5-q4_0	Typelocal	Inputstext	Digest980eba937c08	Download4.1 GB	Parameters7b	QuantizationQ4_0	Context8K	Est. memory≈ 6 GB	`ollama run openchat:7b-v3.5-q4_0`
7b-v3.5-q4_1	Typelocal	Inputstext	Digest2d59d300369b	Download4.6 GB	Parameters7b	QuantizationQ4_1	Context8K	Est. memory≈ 6.5 GB	`ollama run openchat:7b-v3.5-q4_1`
7b-v3.5-q4_K_M	Typelocal	Inputstext	Digestf7d0a07c2357	Download4.4 GB	Parameters7b	QuantizationQ4_K_M	Context8K	Est. memory≈ 6 GB	`ollama run openchat:7b-v3.5-q4_K_M`
7b-v3.5-q4_K_S	Typelocal	Inputstext	Digest99507f29347f	Download4.1 GB	Parameters7b	QuantizationQ4_K_S	Context8K	Est. memory≈ 6 GB	`ollama run openchat:7b-v3.5-q4_K_S`
7b-v3.5-q5_0	Typelocal	Inputstext	Digest311f9cb4a2f3	Download5.0 GB	Parameters7b	QuantizationQ5_0	Context8K	Est. memory≈ 7 GB	`ollama run openchat:7b-v3.5-q5_0`
7b-v3.5-q5_1	Typelocal	Inputstext	Digestbf4eb0e1d37f	Download5.4 GB	Parameters7b	QuantizationQ5_1	Context8K	Est. memory≈ 7.5 GB	`ollama run openchat:7b-v3.5-q5_1`
7b-v3.5-q5_K_M	Typelocal	Inputstext	Digest6b9271b7e00e	Download5.1 GB	Parameters7b	QuantizationQ5_K_M	Context8K	Est. memory≈ 7 GB	`ollama run openchat:7b-v3.5-q5_K_M`
7b-v3.5-q5_K_S	Typelocal	Inputstext	Digest213e534d3f58	Download5.0 GB	Parameters7b	QuantizationQ5_K_S	Context8K	Est. memory≈ 7 GB	`ollama run openchat:7b-v3.5-q5_K_S`
7b-v3.5-q6_K	Typelocal	Inputstext	Digest95a82d202137	Download5.9 GB	Parameters7b	QuantizationQ6_K	Context8K	Est. memory≈ 8 GB	`ollama run openchat:7b-v3.5-q6_K`
7b-v3.5-q8_0	Typelocal	Inputstext	Digest663a54b072bf	Download7.7 GB	Parameters7b	QuantizationQ8_0	Context8K	Est. memory≈ 10 GB	`ollama run openchat:7b-v3.5-q8_0`
latestdefault	Typelocal	Inputstext	Digest537a4e03b649	Download4.1 GB	ParametersUnknown	QuantizationUnknown	Context8K	Est. memory≈ 6 GB	`ollama run openchat:latest`

Related models

sqlcoderlocal

SQLCoder is a code completion model fined-tuned on StarCoder for SQL generation tasks

openhermeslocal

OpenHermes 2.5 is a 7B model fine-tuned by Teknium on Mistral with fully open datasets.

zephyrlocal

Zephyr is a series of fine-tuned versions of the Mistral and Mixtral models that are trained to act as helpful assistants.

neural-chatlocal

A fine-tuned model based on Mistral with good coverage of domain and language.