Quick start

ollama run sqlcoder:latest

Runnable variants

Memory is a rough file-size estimate; context length, runtime and GPU offload change it.

12 of 48 matching variants shown.48 of 48 variants shown.

Tag	Type	Inputs	Digest	Download	Parameters	Quantization	Context	Est. memory	Run
15b	Typelocal	Inputstext	Digest93bb0e8a904f	Download9.0 GB	Parameters15b	QuantizationUnknown	Context8K	Est. memory≈ 11.5 GB	`ollama run sqlcoder:15b`
15b-fp16	Typelocal	Inputstext	Digest6369c7277e63	Download32 GB	Parameters15b	QuantizationFP16	Context8K	Est. memory≈ 37 GB	`ollama run sqlcoder:15b-fp16`
15b-q2_K	Typelocal	Inputstext	Digestdd88fa6c88f9	Download6.7 GB	Parameters15b	QuantizationQ2_K	Context8K	Est. memory≈ 8.5 GB	`ollama run sqlcoder:15b-q2_K`
15b-q3_K_L	Typelocal	Inputstext	Digeste897d393ebf1	Download9.1 GB	Parameters15b	QuantizationQ3_K_L	Context8K	Est. memory≈ 11.5 GB	`ollama run sqlcoder:15b-q3_K_L`
15b-q3_K_M	Typelocal	Inputstext	Digest35f5a2532a9f	Download8.2 GB	Parameters15b	QuantizationQ3_K_M	Context8K	Est. memory≈ 10.5 GB	`ollama run sqlcoder:15b-q3_K_M`
15b-q3_K_S	Typelocal	Inputstext	Digest02328caa22ea	Download6.9 GB	Parameters15b	QuantizationQ3_K_S	Context8K	Est. memory≈ 9 GB	`ollama run sqlcoder:15b-q3_K_S`
15b-q4_0	Typelocal	Inputstext	Digest93bb0e8a904f	Download9.0 GB	Parameters15b	QuantizationQ4_0	Context8K	Est. memory≈ 11.5 GB	`ollama run sqlcoder:15b-q4_0`
15b-q4_1	Typelocal	Inputstext	Digest78804bd67731	Download10 GB	Parameters15b	QuantizationQ4_1	Context8K	Est. memory≈ 12.5 GB	`ollama run sqlcoder:15b-q4_1`
15b-q4_K_M	Typelocal	Inputstext	Digestaee77323d6c4	Download10 GB	Parameters15b	QuantizationQ4_K_M	Context8K	Est. memory≈ 12.5 GB	`ollama run sqlcoder:15b-q4_K_M`
15b-q4_K_S	Typelocal	Inputstext	Digest11c41fea3fed	Download9.1 GB	Parameters15b	QuantizationQ4_K_S	Context8K	Est. memory≈ 11.5 GB	`ollama run sqlcoder:15b-q4_K_S`
15b-q5_0	Typelocal	Inputstext	Digest2a1ff495d518	Download11 GB	Parameters15b	QuantizationQ5_0	Context8K	Est. memory≈ 13.5 GB	`ollama run sqlcoder:15b-q5_0`
15b-q5_1	Typelocal	Inputstext	Digestc8efb3a98ee1	Download12 GB	Parameters15b	QuantizationQ5_1	Context8K	Est. memory≈ 14.5 GB	`ollama run sqlcoder:15b-q5_1`
15b-q5_K_M	Typelocal	Inputstext	Digestfbbab943ddb2	Download12 GB	Parameters15b	QuantizationQ5_K_M	Context8K	Est. memory≈ 14.5 GB	`ollama run sqlcoder:15b-q5_K_M`
15b-q5_K_S	Typelocal	Inputstext	Digest11b67891395e	Download11 GB	Parameters15b	QuantizationQ5_K_S	Context8K	Est. memory≈ 13.5 GB	`ollama run sqlcoder:15b-q5_K_S`
15b-q6_K	Typelocal	Inputstext	Digestcd5d9138d61e	Download13 GB	Parameters15b	QuantizationQ6_K	Context8K	Est. memory≈ 16 GB	`ollama run sqlcoder:15b-q6_K`
15b-q8_0	Typelocal	Inputstext	Digeste07554606510	Download17 GB	Parameters15b	QuantizationQ8_0	Context8K	Est. memory≈ 20 GB	`ollama run sqlcoder:15b-q8_0`
70b-alpha-fp16	Typelocal	Inputstext	Digest2a20f63ebd1d	Download138 GB	Parameters70b	QuantizationFP16	Context16K	Est. memory≈ 155.5 GB	`ollama run sqlcoder:70b-alpha-fp16`
70b-alpha-q2_K	Typelocal	Inputstext	Digest510d7936f38d	Download25 GB	Parameters70b	QuantizationQ2_K	Context16K	Est. memory≈ 29 GB	`ollama run sqlcoder:70b-alpha-q2_K`
70b-alpha-q3_K_L	Typelocal	Inputstext	Digest8841830edc80	Download36 GB	Parameters70b	QuantizationQ3_K_L	Context16K	Est. memory≈ 41.5 GB	`ollama run sqlcoder:70b-alpha-q3_K_L`
70b-alpha-q3_K_M	Typelocal	Inputstext	Digeste58e4a7b8c15	Download33 GB	Parameters70b	QuantizationQ3_K_M	Context16K	Est. memory≈ 38 GB	`ollama run sqlcoder:70b-alpha-q3_K_M`
70b-alpha-q3_K_S	Typelocal	Inputstext	Digest7fa3e5dcdb07	Download30 GB	Parameters70b	QuantizationQ3_K_S	Context16K	Est. memory≈ 35 GB	`ollama run sqlcoder:70b-alpha-q3_K_S`
70b-alpha-q4_0	Typelocal	Inputstext	Digest23ca04b201dd	Download39 GB	Parameters70b	QuantizationQ4_0	Context16K	Est. memory≈ 45 GB	`ollama run sqlcoder:70b-alpha-q4_0`
70b-alpha-q4_1	Typelocal	Inputstext	Digeste431137fc239	Download43 GB	Parameters70b	QuantizationQ4_1	Context16K	Est. memory≈ 49.5 GB	`ollama run sqlcoder:70b-alpha-q4_1`
70b-alpha-q4_K_M	Typelocal	Inputstext	Digesta8d3eb52b519	Download41 GB	Parameters70b	QuantizationQ4_K_M	Context16K	Est. memory≈ 47 GB	`ollama run sqlcoder:70b-alpha-q4_K_M`
70b-alpha-q4_K_S	Typelocal	Inputstext	Digest5be5f1377e74	Download39 GB	Parameters70b	QuantizationQ4_K_S	Context16K	Est. memory≈ 45 GB	`ollama run sqlcoder:70b-alpha-q4_K_S`
70b-alpha-q5_0	Typelocal	Inputstext	Digestfaad68f73fc2	Download47 GB	Parameters70b	QuantizationQ5_0	Context16K	Est. memory≈ 54 GB	`ollama run sqlcoder:70b-alpha-q5_0`
70b-alpha-q5_1	Typelocal	Inputstext	Digestd05ce9b94ffd	Download52 GB	Parameters70b	QuantizationQ5_1	Context16K	Est. memory≈ 59.5 GB	`ollama run sqlcoder:70b-alpha-q5_1`
70b-alpha-q5_K_M	Typelocal	Inputstext	Digestfdc1971644d8	Download49 GB	Parameters70b	QuantizationQ5_K_M	Context16K	Est. memory≈ 56 GB	`ollama run sqlcoder:70b-alpha-q5_K_M`
70b-alpha-q5_K_S	Typelocal	Inputstext	Digesta83028f215d3	Download47 GB	Parameters70b	QuantizationQ5_K_S	Context16K	Est. memory≈ 54 GB	`ollama run sqlcoder:70b-alpha-q5_K_S`
70b-alpha-q6_K	Typelocal	Inputstext	Digest334382eb1aff	Download57 GB	Parameters70b	QuantizationQ6_K	Context16K	Est. memory≈ 65 GB	`ollama run sqlcoder:70b-alpha-q6_K`
70b-alpha-q8_0	Typelocal	Inputstext	Digestf9eec4ca6793	Download73 GB	Parameters70b	QuantizationQ8_0	Context16K	Est. memory≈ 83 GB	`ollama run sqlcoder:70b-alpha-q8_0`
7b	Typelocal	Inputstext	Digest77ac14348387	Download4.1 GB	Parameters7b	QuantizationUnknown	Context32K	Est. memory≈ 6 GB	`ollama run sqlcoder:7b`
7b-fp16	Typelocal	Inputstext	Digest186b67d3cc81	Download14 GB	Parameters7b	QuantizationFP16	Context32K	Est. memory≈ 17 GB	`ollama run sqlcoder:7b-fp16`
7b-q2_K	Typelocal	Inputstext	Digestef8dfd2a47a9	Download3.1 GB	Parameters7b	QuantizationQ2_K	Context32K	Est. memory≈ 4.5 GB	`ollama run sqlcoder:7b-q2_K`
7b-q3_K_L	Typelocal	Inputstext	Digestcab35c00ef41	Download3.8 GB	Parameters7b	QuantizationQ3_K_L	Context32K	Est. memory≈ 5.5 GB	`ollama run sqlcoder:7b-q3_K_L`
7b-q3_K_M	Typelocal	Inputstext	Digest77511b137ab8	Download3.5 GB	Parameters7b	QuantizationQ3_K_M	Context32K	Est. memory≈ 5 GB	`ollama run sqlcoder:7b-q3_K_M`
7b-q3_K_S	Typelocal	Inputstext	Digest9b217fbd379f	Download3.2 GB	Parameters7b	QuantizationQ3_K_S	Context32K	Est. memory≈ 5 GB	`ollama run sqlcoder:7b-q3_K_S`
7b-q4_0	Typelocal	Inputstext	Digest77ac14348387	Download4.1 GB	Parameters7b	QuantizationQ4_0	Context32K	Est. memory≈ 6 GB	`ollama run sqlcoder:7b-q4_0`
7b-q4_1	Typelocal	Inputstext	Digest2497c9ce8ce5	Download4.6 GB	Parameters7b	QuantizationQ4_1	Context32K	Est. memory≈ 6.5 GB	`ollama run sqlcoder:7b-q4_1`
7b-q4_K_M	Typelocal	Inputstext	Digest83f394c3724e	Download4.4 GB	Parameters7b	QuantizationQ4_K_M	Context32K	Est. memory≈ 6 GB	`ollama run sqlcoder:7b-q4_K_M`
7b-q4_K_S	Typelocal	Inputstext	Digest1af8f9ec2947	Download4.1 GB	Parameters7b	QuantizationQ4_K_S	Context32K	Est. memory≈ 6 GB	`ollama run sqlcoder:7b-q4_K_S`
7b-q5_0	Typelocal	Inputstext	Digest71532749cb66	Download5.0 GB	Parameters7b	QuantizationQ5_0	Context32K	Est. memory≈ 7 GB	`ollama run sqlcoder:7b-q5_0`
7b-q5_1	Typelocal	Inputstext	Digest4f8985282cb3	Download5.4 GB	Parameters7b	QuantizationQ5_1	Context32K	Est. memory≈ 7.5 GB	`ollama run sqlcoder:7b-q5_1`
7b-q5_K_M	Typelocal	Inputstext	Digest422d0b916aa2	Download5.1 GB	Parameters7b	QuantizationQ5_K_M	Context32K	Est. memory≈ 7 GB	`ollama run sqlcoder:7b-q5_K_M`
7b-q5_K_S	Typelocal	Inputstext	Digestbac5bb21f4f1	Download5.0 GB	Parameters7b	QuantizationQ5_K_S	Context32K	Est. memory≈ 7 GB	`ollama run sqlcoder:7b-q5_K_S`
7b-q6_K	Typelocal	Inputstext	Digestb8436a415945	Download5.9 GB	Parameters7b	QuantizationQ6_K	Context32K	Est. memory≈ 8 GB	`ollama run sqlcoder:7b-q6_K`
7b-q8_0	Typelocal	Inputstext	Digest07db64a3ecb0	Download7.7 GB	Parameters7b	QuantizationQ8_0	Context32K	Est. memory≈ 10 GB	`ollama run sqlcoder:7b-q8_0`
latestdefault	Typelocal	Inputstext	Digest77ac14348387	Download4.1 GB	ParametersUnknown	QuantizationUnknown	Context32K	Est. memory≈ 6 GB	`ollama run sqlcoder:latest`

Related models

openchatlocal

A family of open-source models trained on a wide variety of data, surpassing ChatGPT on various benchmarks. Updated to version 3.5-0106.

openhermeslocal

OpenHermes 2.5 is a 7B model fine-tuned by Teknium on Mistral with fully open datasets.

zephyrlocal

Zephyr is a series of fine-tuned versions of the Mistral and Mixtral models that are trained to act as helpful assistants.

neural-chatlocal

A fine-tuned model based on Mistral with good coverage of domain and language.