Quick start

ollama run codeqwen:latest

Runnable variants

Memory is a rough file-size estimate; context length, runtime and GPU offload change it.

12 of 30 matching variants shown.30 of 30 variants shown.

Tag	Type	Inputs	Digest	Download	Parameters	Quantization	Context	Est. memory	Run
7b	Typelocal	Inputstext	Digestdf352abf55b1	Download4.2 GB	Parameters7b	QuantizationUnknown	Context64K	Est. memory≈ 6 GB	`ollama run codeqwen:7b`
7b-chat	Typelocal	Inputstext	Digestdf352abf55b1	Download4.2 GB	Parameters7b	QuantizationUnknown	Context64K	Est. memory≈ 6 GB	`ollama run codeqwen:7b-chat`
7b-chat-v1.5-fp16	Typelocal	Inputstext	Digestf1b41fd8b5cc	Download15 GB	Parameters7b	QuantizationFP16	Context64K	Est. memory≈ 18 GB	`ollama run codeqwen:7b-chat-v1.5-fp16`
7b-chat-v1.5-q2_K	Typelocal	Inputstext	Digest58bf9e268b33	Download3.1 GB	Parameters7b	QuantizationQ2_K	Context64K	Est. memory≈ 4.5 GB	`ollama run codeqwen:7b-chat-v1.5-q2_K`
7b-chat-v1.5-q3_K_L	Typelocal	Inputstext	Digest3dc83ecb767e	Download4.0 GB	Parameters7b	QuantizationQ3_K_L	Context64K	Est. memory≈ 5.5 GB	`ollama run codeqwen:7b-chat-v1.5-q3_K_L`
7b-chat-v1.5-q3_K_M	Typelocal	Inputstext	Digest60e192727d09	Download3.8 GB	Parameters7b	QuantizationQ3_K_M	Context64K	Est. memory≈ 5.5 GB	`ollama run codeqwen:7b-chat-v1.5-q3_K_M`
7b-chat-v1.5-q3_K_S	Typelocal	Inputstext	Digest8ac6e4f8622c	Download3.5 GB	Parameters7b	QuantizationQ3_K_S	Context64K	Est. memory≈ 5 GB	`ollama run codeqwen:7b-chat-v1.5-q3_K_S`
7b-chat-v1.5-q4_0	Typelocal	Inputstext	Digestdf352abf55b1	Download4.2 GB	Parameters7b	QuantizationQ4_0	Context64K	Est. memory≈ 6 GB	`ollama run codeqwen:7b-chat-v1.5-q4_0`
7b-chat-v1.5-q4_1	Typelocal	Inputstext	Digest659a8d7026c9	Download4.6 GB	Parameters7b	QuantizationQ4_1	Context64K	Est. memory≈ 6.5 GB	`ollama run codeqwen:7b-chat-v1.5-q4_1`
7b-chat-v1.5-q4_K_M	Typelocal	Inputstext	Digest9cb4225e1c5d	Download4.7 GB	Parameters7b	QuantizationQ4_K_M	Context64K	Est. memory≈ 6.5 GB	`ollama run codeqwen:7b-chat-v1.5-q4_K_M`
7b-chat-v1.5-q4_K_S	Typelocal	Inputstext	Digestbafc9e528fc3	Download4.4 GB	Parameters7b	QuantizationQ4_K_S	Context64K	Est. memory≈ 6 GB	`ollama run codeqwen:7b-chat-v1.5-q4_K_S`
7b-chat-v1.5-q5_0	Typelocal	Inputstext	Digest5fa058937b9d	Download5.0 GB	Parameters7b	QuantizationQ5_0	Context64K	Est. memory≈ 7 GB	`ollama run codeqwen:7b-chat-v1.5-q5_0`
7b-chat-v1.5-q5_1	Typelocal	Inputstext	Digest656f0c7923b8	Download5.5 GB	Parameters7b	QuantizationQ5_1	Context64K	Est. memory≈ 7.5 GB	`ollama run codeqwen:7b-chat-v1.5-q5_1`
7b-chat-v1.5-q5_K_M	Typelocal	Inputstext	Digest1e38f440836a	Download5.4 GB	Parameters7b	QuantizationQ5_K_M	Context64K	Est. memory≈ 7.5 GB	`ollama run codeqwen:7b-chat-v1.5-q5_K_M`
7b-chat-v1.5-q5_K_S	Typelocal	Inputstext	Digest353c5070c5db	Download5.1 GB	Parameters7b	QuantizationQ5_K_S	Context64K	Est. memory≈ 7 GB	`ollama run codeqwen:7b-chat-v1.5-q5_K_S`
7b-chat-v1.5-q6_K	Typelocal	Inputstext	Digest1140b50f25a0	Download6.4 GB	Parameters7b	QuantizationQ6_K	Context64K	Est. memory≈ 8.5 GB	`ollama run codeqwen:7b-chat-v1.5-q6_K`
7b-chat-v1.5-q8_0	Typelocal	Inputstext	Digest19343b80cbc6	Download7.7 GB	Parameters7b	QuantizationQ8_0	Context64K	Est. memory≈ 10 GB	`ollama run codeqwen:7b-chat-v1.5-q8_0`
7b-code	Typelocal	Inputstext	Digestd469cddb7d04	Download4.2 GB	Parameters7b	QuantizationUnknown	Context64K	Est. memory≈ 6 GB	`ollama run codeqwen:7b-code`
7b-code-v1.5-fp16	Typelocal	Inputstext	Digest18f779849b86	Download15 GB	Parameters7b	QuantizationFP16	Context64K	Est. memory≈ 18 GB	`ollama run codeqwen:7b-code-v1.5-fp16`
7b-code-v1.5-q4_0	Typelocal	Inputstext	Digestd469cddb7d04	Download4.2 GB	Parameters7b	QuantizationQ4_0	Context64K	Est. memory≈ 6 GB	`ollama run codeqwen:7b-code-v1.5-q4_0`
7b-code-v1.5-q4_1	Typelocal	Inputstext	Digest1054e6ce1430	Download4.6 GB	Parameters7b	QuantizationQ4_1	Context64K	Est. memory≈ 6.5 GB	`ollama run codeqwen:7b-code-v1.5-q4_1`
7b-code-v1.5-q5_0	Typelocal	Inputstext	Digestdf00ae037785	Download5.0 GB	Parameters7b	QuantizationQ5_0	Context64K	Est. memory≈ 7 GB	`ollama run codeqwen:7b-code-v1.5-q5_0`
7b-code-v1.5-q5_1	Typelocal	Inputstext	Digestf9f1cdb01bda	Download5.5 GB	Parameters7b	QuantizationQ5_1	Context64K	Est. memory≈ 7.5 GB	`ollama run codeqwen:7b-code-v1.5-q5_1`
7b-code-v1.5-q8_0	Typelocal	Inputstext	Digestf076b41b0d2e	Download7.7 GB	Parameters7b	QuantizationQ8_0	Context64K	Est. memory≈ 10 GB	`ollama run codeqwen:7b-code-v1.5-q8_0`
chat	Typelocal	Inputstext	Digestdf352abf55b1	Download4.2 GB	ParametersUnknown	QuantizationUnknown	Context64K	Est. memory≈ 6 GB	`ollama run codeqwen:chat`
code	Typelocal	Inputstext	Digestd469cddb7d04	Download4.2 GB	ParametersUnknown	QuantizationUnknown	Context64K	Est. memory≈ 6 GB	`ollama run codeqwen:code`
latestdefault	Typelocal	Inputstext	Digestdf352abf55b1	Download4.2 GB	ParametersUnknown	QuantizationUnknown	Context64K	Est. memory≈ 6 GB	`ollama run codeqwen:latest`
v1.5	Typelocal	Inputstext	Digestdf352abf55b1	Download4.2 GB	ParametersUnknown	QuantizationUnknown	Context64K	Est. memory≈ 6 GB	`ollama run codeqwen:v1.5`
v1.5-chat	Typelocal	Inputstext	Digestdf352abf55b1	Download4.2 GB	ParametersUnknown	QuantizationUnknown	Context64K	Est. memory≈ 6 GB	`ollama run codeqwen:v1.5-chat`
v1.5-code	Typelocal	Inputstext	Digestd469cddb7d04	Download4.2 GB	ParametersUnknown	QuantizationUnknown	Context64K	Est. memory≈ 6 GB	`ollama run codeqwen:v1.5-code`

Related models

sqlcoderlocal

SQLCoder is a code completion model fined-tuned on StarCoder for SQL generation tasks

openchatlocal

A family of open-source models trained on a wide variety of data, surpassing ChatGPT on various benchmarks. Updated to version 3.5-0106.

openhermeslocal

OpenHermes 2.5 is a 7B model fine-tuned by Teknium on Mistral with fully open datasets.

zephyrlocal

Zephyr is a series of fine-tuned versions of the Mistral and Mixtral models that are trained to act as helpful assistants.