Quick start

ollama run yarn-mistral:latest

Runnable variants

Memory is a rough file-size estimate; context length, runtime and GPU offload change it.

12 of 33 matching variants shown.33 of 33 variants shown.

Tag	Type	Inputs	Digest	Download	Parameters	Quantization	Context	Est. memory	Run
7b	Typelocal	Inputstext	Digest8e9c368a0ae4	Download4.1 GB	Parameters7b	QuantizationUnknown	Context32K	Est. memory≈ 6 GB	`ollama run yarn-mistral:7b`
7b-128k	Typelocal	Inputstext	Digest6511b83c33d5	Download4.1 GB	Parameters7b	QuantizationUnknown	Context128K	Est. memory≈ 6 GB	`ollama run yarn-mistral:7b-128k`
7b-128k-fp16	Typelocal	Inputstext	Digest24fcccd3ec98	Download14 GB	Parameters7b	QuantizationFP16	Context128K	Est. memory≈ 17 GB	`ollama run yarn-mistral:7b-128k-fp16`
7b-128k-q2_K	Typelocal	Inputstext	Digest4801801e65c9	Download3.1 GB	Parameters7b	QuantizationQ2_K	Context128K	Est. memory≈ 4.5 GB	`ollama run yarn-mistral:7b-128k-q2_K`
7b-128k-q3_K_L	Typelocal	Inputstext	Digest04e1735cc221	Download3.8 GB	Parameters7b	QuantizationQ3_K_L	Context128K	Est. memory≈ 5.5 GB	`ollama run yarn-mistral:7b-128k-q3_K_L`
7b-128k-q3_K_M	Typelocal	Inputstext	Digestc910ed0b2220	Download3.5 GB	Parameters7b	QuantizationQ3_K_M	Context128K	Est. memory≈ 5 GB	`ollama run yarn-mistral:7b-128k-q3_K_M`
7b-128k-q3_K_S	Typelocal	Inputstext	Digest150773407811	Download3.2 GB	Parameters7b	QuantizationQ3_K_S	Context128K	Est. memory≈ 5 GB	`ollama run yarn-mistral:7b-128k-q3_K_S`
7b-128k-q4_0	Typelocal	Inputstext	Digest6511b83c33d5	Download4.1 GB	Parameters7b	QuantizationQ4_0	Context128K	Est. memory≈ 6 GB	`ollama run yarn-mistral:7b-128k-q4_0`
7b-128k-q4_1	Typelocal	Inputstext	Digest2f2460d79fe1	Download4.6 GB	Parameters7b	QuantizationQ4_1	Context128K	Est. memory≈ 6.5 GB	`ollama run yarn-mistral:7b-128k-q4_1`
7b-128k-q4_K_M	Typelocal	Inputstext	Digestb29d79d2f3ef	Download4.4 GB	Parameters7b	QuantizationQ4_K_M	Context128K	Est. memory≈ 6 GB	`ollama run yarn-mistral:7b-128k-q4_K_M`
7b-128k-q4_K_S	Typelocal	Inputstext	Digest60021a54efbe	Download4.1 GB	Parameters7b	QuantizationQ4_K_S	Context128K	Est. memory≈ 6 GB	`ollama run yarn-mistral:7b-128k-q4_K_S`
7b-128k-q5_0	Typelocal	Inputstext	Digestf6e752bb89ba	Download5.0 GB	Parameters7b	QuantizationQ5_0	Context128K	Est. memory≈ 7 GB	`ollama run yarn-mistral:7b-128k-q5_0`
7b-128k-q5_1	Typelocal	Inputstext	Digest27a21ac0ee02	Download5.4 GB	Parameters7b	QuantizationQ5_1	Context128K	Est. memory≈ 7.5 GB	`ollama run yarn-mistral:7b-128k-q5_1`
7b-128k-q5_K_M	Typelocal	Inputstext	Digeste73d718076ea	Download5.1 GB	Parameters7b	QuantizationQ5_K_M	Context128K	Est. memory≈ 7 GB	`ollama run yarn-mistral:7b-128k-q5_K_M`
7b-128k-q5_K_S	Typelocal	Inputstext	Digest48e075e27562	Download5.0 GB	Parameters7b	QuantizationQ5_K_S	Context128K	Est. memory≈ 7 GB	`ollama run yarn-mistral:7b-128k-q5_K_S`
7b-128k-q6_K	Typelocal	Inputstext	Digestd2efb1f4a053	Download5.9 GB	Parameters7b	QuantizationQ6_K	Context128K	Est. memory≈ 8 GB	`ollama run yarn-mistral:7b-128k-q6_K`
7b-128k-q8_0	Typelocal	Inputstext	Digestc7d7fcc635b3	Download7.7 GB	Parameters7b	QuantizationQ8_0	Context128K	Est. memory≈ 10 GB	`ollama run yarn-mistral:7b-128k-q8_0`
7b-64k	Typelocal	Inputstext	Digest8e9c368a0ae4	Download4.1 GB	Parameters7b	QuantizationUnknown	Context32K	Est. memory≈ 6 GB	`ollama run yarn-mistral:7b-64k`
7b-64k-q2_K	Typelocal	Inputstext	Digest7e69098a0185	Download3.1 GB	Parameters7b	QuantizationQ2_K	Context32K	Est. memory≈ 4.5 GB	`ollama run yarn-mistral:7b-64k-q2_K`
7b-64k-q3_K_L	Typelocal	Inputstext	Digest6fec537d7505	Download3.8 GB	Parameters7b	QuantizationQ3_K_L	Context32K	Est. memory≈ 5.5 GB	`ollama run yarn-mistral:7b-64k-q3_K_L`
7b-64k-q3_K_M	Typelocal	Inputstext	Digest2fe3d1edecaa	Download3.5 GB	Parameters7b	QuantizationQ3_K_M	Context32K	Est. memory≈ 5 GB	`ollama run yarn-mistral:7b-64k-q3_K_M`
7b-64k-q3_K_S	Typelocal	Inputstext	Digest9f1a8b3eec09	Download3.2 GB	Parameters7b	QuantizationQ3_K_S	Context32K	Est. memory≈ 5 GB	`ollama run yarn-mistral:7b-64k-q3_K_S`
7b-64k-q4_0	Typelocal	Inputstext	Digest8e9c368a0ae4	Download4.1 GB	Parameters7b	QuantizationQ4_0	Context32K	Est. memory≈ 6 GB	`ollama run yarn-mistral:7b-64k-q4_0`
7b-64k-q4_1	Typelocal	Inputstext	Digest0b1ddb2af722	Download4.6 GB	Parameters7b	QuantizationQ4_1	Context32K	Est. memory≈ 6.5 GB	`ollama run yarn-mistral:7b-64k-q4_1`
7b-64k-q4_K_M	Typelocal	Inputstext	Digestf9434e5ec017	Download4.4 GB	Parameters7b	QuantizationQ4_K_M	Context32K	Est. memory≈ 6 GB	`ollama run yarn-mistral:7b-64k-q4_K_M`
7b-64k-q4_K_S	Typelocal	Inputstext	Digest6a3c24b1e938	Download4.1 GB	Parameters7b	QuantizationQ4_K_S	Context32K	Est. memory≈ 6 GB	`ollama run yarn-mistral:7b-64k-q4_K_S`
7b-64k-q5_0	Typelocal	Inputstext	Digest917060ebb0d8	Download5.0 GB	Parameters7b	QuantizationQ5_0	Context32K	Est. memory≈ 7 GB	`ollama run yarn-mistral:7b-64k-q5_0`
7b-64k-q5_1	Typelocal	Inputstext	Digest5efec29a0821	Download5.4 GB	Parameters7b	QuantizationQ5_1	Context32K	Est. memory≈ 7.5 GB	`ollama run yarn-mistral:7b-64k-q5_1`
7b-64k-q5_K_M	Typelocal	Inputstext	Digest1ac045b0f86f	Download5.1 GB	Parameters7b	QuantizationQ5_K_M	Context32K	Est. memory≈ 7 GB	`ollama run yarn-mistral:7b-64k-q5_K_M`
7b-64k-q5_K_S	Typelocal	Inputstext	Digest1fb11cbfb6ad	Download5.0 GB	Parameters7b	QuantizationQ5_K_S	Context32K	Est. memory≈ 7 GB	`ollama run yarn-mistral:7b-64k-q5_K_S`
7b-64k-q6_K	Typelocal	Inputstext	Digestc3108d901ef7	Download5.9 GB	Parameters7b	QuantizationQ6_K	Context32K	Est. memory≈ 8 GB	`ollama run yarn-mistral:7b-64k-q6_K`
7b-64k-q8_0	Typelocal	Inputstext	Digest236ce568b73c	Download7.7 GB	Parameters7b	QuantizationQ8_0	Context32K	Est. memory≈ 10 GB	`ollama run yarn-mistral:7b-64k-q8_0`
latestdefault	Typelocal	Inputstext	Digest8e9c368a0ae4	Download4.1 GB	ParametersUnknown	QuantizationUnknown	Context32K	Est. memory≈ 6 GB	`ollama run yarn-mistral:latest`

Related models

sqlcoderlocal

SQLCoder is a code completion model fined-tuned on StarCoder for SQL generation tasks

openchatlocal

A family of open-source models trained on a wide variety of data, surpassing ChatGPT on various benchmarks. Updated to version 3.5-0106.

openhermeslocal

OpenHermes 2.5 is a 7B model fine-tuned by Teknium on Mistral with fully open datasets.

zephyrlocal

Zephyr is a series of fine-tuned versions of the Mistral and Mixtral models that are trained to act as helpful assistants.