Quick start

ollama run samantha-mistral:latest

Runnable variants

Memory is a rough file-size estimate; context length, runtime and GPU offload change it.

12 of 49 matching variants shown.49 of 49 variants shown.

Tag	Type	Inputs	Digest	Download	Parameters	Quantization	Context	Est. memory	Run
7b	Typelocal	Inputstext	Digestf7c8c9be1da0	Download4.1 GB	Parameters7b	QuantizationUnknown	Context32K	Est. memory≈ 6 GB	`ollama run samantha-mistral:7b`
7b-instruct-fp16	Typelocal	Inputstext	Digest84081f5ce595	Download14 GB	Parameters7b	QuantizationFP16	Context32K	Est. memory≈ 17 GB	`ollama run samantha-mistral:7b-instruct-fp16`
7b-instruct-q2_K	Typelocal	Inputstext	Digest96a147f46c78	Download3.1 GB	Parameters7b	QuantizationQ2_K	Context32K	Est. memory≈ 4.5 GB	`ollama run samantha-mistral:7b-instruct-q2_K`
7b-instruct-q3_K_L	Typelocal	Inputstext	Digest8a362799bb4c	Download3.8 GB	Parameters7b	QuantizationQ3_K_L	Context32K	Est. memory≈ 5.5 GB	`ollama run samantha-mistral:7b-instruct-q3_K_L`
7b-instruct-q3_K_M	Typelocal	Inputstext	Digestd15ec1ea22a4	Download3.5 GB	Parameters7b	QuantizationQ3_K_M	Context32K	Est. memory≈ 5 GB	`ollama run samantha-mistral:7b-instruct-q3_K_M`
7b-instruct-q3_K_S	Typelocal	Inputstext	Digest62fd2b9a2876	Download3.2 GB	Parameters7b	QuantizationQ3_K_S	Context32K	Est. memory≈ 5 GB	`ollama run samantha-mistral:7b-instruct-q3_K_S`
7b-instruct-q4_0	Typelocal	Inputstext	Digest024406c7422a	Download4.1 GB	Parameters7b	QuantizationQ4_0	Context32K	Est. memory≈ 6 GB	`ollama run samantha-mistral:7b-instruct-q4_0`
7b-instruct-q4_1	Typelocal	Inputstext	Digest8794444548a4	Download4.6 GB	Parameters7b	QuantizationQ4_1	Context32K	Est. memory≈ 6.5 GB	`ollama run samantha-mistral:7b-instruct-q4_1`
7b-instruct-q4_K_M	Typelocal	Inputstext	Digest0f6d2b5ca5e2	Download4.4 GB	Parameters7b	QuantizationQ4_K_M	Context32K	Est. memory≈ 6 GB	`ollama run samantha-mistral:7b-instruct-q4_K_M`
7b-instruct-q4_K_S	Typelocal	Inputstext	Digest7628c0eabf6e	Download4.1 GB	Parameters7b	QuantizationQ4_K_S	Context32K	Est. memory≈ 6 GB	`ollama run samantha-mistral:7b-instruct-q4_K_S`
7b-instruct-q5_0	Typelocal	Inputstext	Digest68d25cf334e8	Download5.0 GB	Parameters7b	QuantizationQ5_0	Context32K	Est. memory≈ 7 GB	`ollama run samantha-mistral:7b-instruct-q5_0`
7b-instruct-q5_1	Typelocal	Inputstext	Digest4f2a05b98ad7	Download5.4 GB	Parameters7b	QuantizationQ5_1	Context32K	Est. memory≈ 7.5 GB	`ollama run samantha-mistral:7b-instruct-q5_1`
7b-instruct-q5_K_M	Typelocal	Inputstext	Digestc74ed33532e3	Download5.1 GB	Parameters7b	QuantizationQ5_K_M	Context32K	Est. memory≈ 7 GB	`ollama run samantha-mistral:7b-instruct-q5_K_M`
7b-instruct-q5_K_S	Typelocal	Inputstext	Digestd3a4b4169288	Download5.0 GB	Parameters7b	QuantizationQ5_K_S	Context32K	Est. memory≈ 7 GB	`ollama run samantha-mistral:7b-instruct-q5_K_S`
7b-instruct-q6_K	Typelocal	Inputstext	Digest8fdefc023b71	Download5.9 GB	Parameters7b	QuantizationQ6_K	Context32K	Est. memory≈ 8 GB	`ollama run samantha-mistral:7b-instruct-q6_K`
7b-instruct-q8_0	Typelocal	Inputstext	Digestc555922ee59b	Download7.7 GB	Parameters7b	QuantizationQ8_0	Context32K	Est. memory≈ 10 GB	`ollama run samantha-mistral:7b-instruct-q8_0`
7b-text	Typelocal	Inputstext	Digestb085c9c5fcec	Download4.1 GB	Parameters7b	QuantizationUnknown	Context32K	Est. memory≈ 6 GB	`ollama run samantha-mistral:7b-text`
7b-text-fp16	Typelocal	Inputstext	Digest18f0d3b9dab7	Download14 GB	Parameters7b	QuantizationFP16	Context32K	Est. memory≈ 17 GB	`ollama run samantha-mistral:7b-text-fp16`
7b-text-q2_K	Typelocal	Inputstext	Digestfad0a3e1761e	Download3.1 GB	Parameters7b	QuantizationQ2_K	Context32K	Est. memory≈ 4.5 GB	`ollama run samantha-mistral:7b-text-q2_K`
7b-text-q3_K_L	Typelocal	Inputstext	Digeste7eda3fb21ce	Download3.8 GB	Parameters7b	QuantizationQ3_K_L	Context32K	Est. memory≈ 5.5 GB	`ollama run samantha-mistral:7b-text-q3_K_L`
7b-text-q3_K_M	Typelocal	Inputstext	Digest2b119f04be81	Download3.5 GB	Parameters7b	QuantizationQ3_K_M	Context32K	Est. memory≈ 5 GB	`ollama run samantha-mistral:7b-text-q3_K_M`
7b-text-q3_K_S	Typelocal	Inputstext	Digeste9be9d2c1626	Download3.2 GB	Parameters7b	QuantizationQ3_K_S	Context32K	Est. memory≈ 5 GB	`ollama run samantha-mistral:7b-text-q3_K_S`
7b-text-q4_0	Typelocal	Inputstext	Digestb085c9c5fcec	Download4.1 GB	Parameters7b	QuantizationQ4_0	Context32K	Est. memory≈ 6 GB	`ollama run samantha-mistral:7b-text-q4_0`
7b-text-q4_1	Typelocal	Inputstext	Digest85970f1f192a	Download4.6 GB	Parameters7b	QuantizationQ4_1	Context32K	Est. memory≈ 6.5 GB	`ollama run samantha-mistral:7b-text-q4_1`
7b-text-q4_K_M	Typelocal	Inputstext	Digest39cf8171959a	Download4.4 GB	Parameters7b	QuantizationQ4_K_M	Context32K	Est. memory≈ 6 GB	`ollama run samantha-mistral:7b-text-q4_K_M`
7b-text-q4_K_S	Typelocal	Inputstext	Digest7b0b68d63c1f	Download4.1 GB	Parameters7b	QuantizationQ4_K_S	Context32K	Est. memory≈ 6 GB	`ollama run samantha-mistral:7b-text-q4_K_S`
7b-text-q5_0	Typelocal	Inputstext	Digestd4bfb5684edc	Download5.0 GB	Parameters7b	QuantizationQ5_0	Context32K	Est. memory≈ 7 GB	`ollama run samantha-mistral:7b-text-q5_0`
7b-text-q5_1	Typelocal	Inputstext	Digest80d8a3a2cda0	Download5.4 GB	Parameters7b	QuantizationQ5_1	Context32K	Est. memory≈ 7.5 GB	`ollama run samantha-mistral:7b-text-q5_1`
7b-text-q5_K_M	Typelocal	Inputstext	Digest5c857161b387	Download5.1 GB	Parameters7b	QuantizationQ5_K_M	Context32K	Est. memory≈ 7 GB	`ollama run samantha-mistral:7b-text-q5_K_M`
7b-text-q5_K_S	Typelocal	Inputstext	Digest5dcb0fd60a87	Download5.0 GB	Parameters7b	QuantizationQ5_K_S	Context32K	Est. memory≈ 7 GB	`ollama run samantha-mistral:7b-text-q5_K_S`
7b-text-q6_K	Typelocal	Inputstext	Digesta06d56b9f941	Download5.9 GB	Parameters7b	QuantizationQ6_K	Context32K	Est. memory≈ 8 GB	`ollama run samantha-mistral:7b-text-q6_K`
7b-text-q8_0	Typelocal	Inputstext	Digestf77f5c9b59eb	Download7.7 GB	Parameters7b	QuantizationQ8_0	Context32K	Est. memory≈ 10 GB	`ollama run samantha-mistral:7b-text-q8_0`
7b-v1.2-text	Typelocal	Inputstext	Digestf7c8c9be1da0	Download4.1 GB	Parameters7b	QuantizationUnknown	Context32K	Est. memory≈ 6 GB	`ollama run samantha-mistral:7b-v1.2-text`
7b-v1.2-text-fp16	Typelocal	Inputstext	Digest463d6b8187c1	Download14 GB	Parameters7b	QuantizationFP16	Context32K	Est. memory≈ 17 GB	`ollama run samantha-mistral:7b-v1.2-text-fp16`
7b-v1.2-text-q2_K	Typelocal	Inputstext	Digest7b218927bbd2	Download3.1 GB	Parameters7b	QuantizationQ2_K	Context32K	Est. memory≈ 4.5 GB	`ollama run samantha-mistral:7b-v1.2-text-q2_K`
7b-v1.2-text-q3_K_L	Typelocal	Inputstext	Digest58fb1513b0bd	Download3.8 GB	Parameters7b	QuantizationQ3_K_L	Context32K	Est. memory≈ 5.5 GB	`ollama run samantha-mistral:7b-v1.2-text-q3_K_L`
7b-v1.2-text-q3_K_M	Typelocal	Inputstext	Digestb6193d2efa40	Download3.5 GB	Parameters7b	QuantizationQ3_K_M	Context32K	Est. memory≈ 5 GB	`ollama run samantha-mistral:7b-v1.2-text-q3_K_M`
7b-v1.2-text-q3_K_S	Typelocal	Inputstext	Digest9b8db3fe08c2	Download3.2 GB	Parameters7b	QuantizationQ3_K_S	Context32K	Est. memory≈ 5 GB	`ollama run samantha-mistral:7b-v1.2-text-q3_K_S`
7b-v1.2-text-q4_0	Typelocal	Inputstext	Digestf7c8c9be1da0	Download4.1 GB	Parameters7b	QuantizationQ4_0	Context32K	Est. memory≈ 6 GB	`ollama run samantha-mistral:7b-v1.2-text-q4_0`
7b-v1.2-text-q4_1	Typelocal	Inputstext	Digest1f5844c5902c	Download4.6 GB	Parameters7b	QuantizationQ4_1	Context32K	Est. memory≈ 6.5 GB	`ollama run samantha-mistral:7b-v1.2-text-q4_1`
7b-v1.2-text-q4_K_M	Typelocal	Inputstext	Digestff1e08836eec	Download4.4 GB	Parameters7b	QuantizationQ4_K_M	Context32K	Est. memory≈ 6 GB	`ollama run samantha-mistral:7b-v1.2-text-q4_K_M`
7b-v1.2-text-q4_K_S	Typelocal	Inputstext	Digest444790e2878d	Download4.1 GB	Parameters7b	QuantizationQ4_K_S	Context32K	Est. memory≈ 6 GB	`ollama run samantha-mistral:7b-v1.2-text-q4_K_S`
7b-v1.2-text-q5_0	Typelocal	Inputstext	Digest3871c24e3323	Download5.0 GB	Parameters7b	QuantizationQ5_0	Context32K	Est. memory≈ 7 GB	`ollama run samantha-mistral:7b-v1.2-text-q5_0`
7b-v1.2-text-q5_1	Typelocal	Inputstext	Digest141eea79136d	Download5.4 GB	Parameters7b	QuantizationQ5_1	Context32K	Est. memory≈ 7.5 GB	`ollama run samantha-mistral:7b-v1.2-text-q5_1`
7b-v1.2-text-q5_K_M	Typelocal	Inputstext	Digest759bccff2e2e	Download5.1 GB	Parameters7b	QuantizationQ5_K_M	Context32K	Est. memory≈ 7 GB	`ollama run samantha-mistral:7b-v1.2-text-q5_K_M`
7b-v1.2-text-q5_K_S	Typelocal	Inputstext	Digest192548ac3ab0	Download5.0 GB	Parameters7b	QuantizationQ5_K_S	Context32K	Est. memory≈ 7 GB	`ollama run samantha-mistral:7b-v1.2-text-q5_K_S`
7b-v1.2-text-q6_K	Typelocal	Inputstext	Digest28b60c3a346d	Download5.9 GB	Parameters7b	QuantizationQ6_K	Context32K	Est. memory≈ 8 GB	`ollama run samantha-mistral:7b-v1.2-text-q6_K`
7b-v1.2-text-q8_0	Typelocal	Inputstext	Digest495b300e8bb1	Download7.7 GB	Parameters7b	QuantizationQ8_0	Context32K	Est. memory≈ 10 GB	`ollama run samantha-mistral:7b-v1.2-text-q8_0`
latestdefault	Typelocal	Inputstext	Digestf7c8c9be1da0	Download4.1 GB	ParametersUnknown	QuantizationUnknown	Context32K	Est. memory≈ 6 GB	`ollama run samantha-mistral:latest`

Related models

sqlcoderlocal

SQLCoder is a code completion model fined-tuned on StarCoder for SQL generation tasks

openchatlocal

A family of open-source models trained on a wide variety of data, surpassing ChatGPT on various benchmarks. Updated to version 3.5-0106.

openhermeslocal

OpenHermes 2.5 is a 7B model fine-tuned by Teknium on Mistral with fully open datasets.

zephyrlocal

Zephyr is a series of fine-tuned versions of the Mistral and Mixtral models that are trained to act as helpful assistants.