Quick start

ollama run mathstral:latest

Runnable variants

Memory is a rough file-size estimate; context length, runtime and GPU offload change it.

12 of 17 matching variants shown.17 of 17 variants shown.

Tag	Type	Inputs	Digest	Download	Parameters	Quantization	Context	Est. memory	Run
7b	Typelocal	Inputstext	Digest4ee7052be55a	Download4.1 GB	Parameters7b	QuantizationUnknown	Context32K	Est. memory≈ 6 GB	`ollama run mathstral:7b`
7b-v0.1-fp16	Typelocal	Inputstext	Digestce1616d5e8c6	Download14 GB	Parameters7b	QuantizationFP16	Context32K	Est. memory≈ 17 GB	`ollama run mathstral:7b-v0.1-fp16`
7b-v0.1-q2_K	Typelocal	Inputstext	Digest5137b80a2f9f	Download2.7 GB	Parameters7b	QuantizationQ2_K	Context32K	Est. memory≈ 4.5 GB	`ollama run mathstral:7b-v0.1-q2_K`
7b-v0.1-q3_K_L	Typelocal	Inputstext	Digestf1a0d196fc05	Download3.8 GB	Parameters7b	QuantizationQ3_K_L	Context32K	Est. memory≈ 5.5 GB	`ollama run mathstral:7b-v0.1-q3_K_L`
7b-v0.1-q3_K_M	Typelocal	Inputstext	Digest67dafe37f729	Download3.5 GB	Parameters7b	QuantizationQ3_K_M	Context32K	Est. memory≈ 5 GB	`ollama run mathstral:7b-v0.1-q3_K_M`
7b-v0.1-q3_K_S	Typelocal	Inputstext	Digestb75c7eed8cf3	Download3.2 GB	Parameters7b	QuantizationQ3_K_S	Context32K	Est. memory≈ 5 GB	`ollama run mathstral:7b-v0.1-q3_K_S`
7b-v0.1-q4_0	Typelocal	Inputstext	Digest4ee7052be55a	Download4.1 GB	Parameters7b	QuantizationQ4_0	Context32K	Est. memory≈ 6 GB	`ollama run mathstral:7b-v0.1-q4_0`
7b-v0.1-q4_1	Typelocal	Inputstext	Digest7d1005348e61	Download4.6 GB	Parameters7b	QuantizationQ4_1	Context32K	Est. memory≈ 6.5 GB	`ollama run mathstral:7b-v0.1-q4_1`
7b-v0.1-q4_K_M	Typelocal	Inputstext	Digest8cf37cd9128d	Download4.4 GB	Parameters7b	QuantizationQ4_K_M	Context32K	Est. memory≈ 6 GB	`ollama run mathstral:7b-v0.1-q4_K_M`
7b-v0.1-q4_K_S	Typelocal	Inputstext	Digest4c06df180823	Download4.1 GB	Parameters7b	QuantizationQ4_K_S	Context32K	Est. memory≈ 6 GB	`ollama run mathstral:7b-v0.1-q4_K_S`
7b-v0.1-q5_0	Typelocal	Inputstext	Digestc766c6cbd32e	Download5.0 GB	Parameters7b	QuantizationQ5_0	Context32K	Est. memory≈ 7 GB	`ollama run mathstral:7b-v0.1-q5_0`
7b-v0.1-q5_1	Typelocal	Inputstext	Digestf0082439d2ba	Download5.4 GB	Parameters7b	QuantizationQ5_1	Context32K	Est. memory≈ 7.5 GB	`ollama run mathstral:7b-v0.1-q5_1`
7b-v0.1-q5_K_M	Typelocal	Inputstext	Digest562985e7a5a8	Download5.1 GB	Parameters7b	QuantizationQ5_K_M	Context32K	Est. memory≈ 7 GB	`ollama run mathstral:7b-v0.1-q5_K_M`
7b-v0.1-q5_K_S	Typelocal	Inputstext	Digeste37cf555b2ed	Download5.0 GB	Parameters7b	QuantizationQ5_K_S	Context32K	Est. memory≈ 7 GB	`ollama run mathstral:7b-v0.1-q5_K_S`
7b-v0.1-q6_K	Typelocal	Inputstext	Digest696c00e5bba0	Download5.9 GB	Parameters7b	QuantizationQ6_K	Context32K	Est. memory≈ 8 GB	`ollama run mathstral:7b-v0.1-q6_K`
7b-v0.1-q8_0	Typelocal	Inputstext	Digest939f2d6f06c5	Download7.7 GB	Parameters7b	QuantizationQ8_0	Context32K	Est. memory≈ 10 GB	`ollama run mathstral:7b-v0.1-q8_0`
latestdefault	Typelocal	Inputstext	Digest4ee7052be55a	Download4.1 GB	ParametersUnknown	QuantizationUnknown	Context32K	Est. memory≈ 6 GB	`ollama run mathstral:latest`

Related models

mistrallocal

The 7B model released by Mistral AI, updated to version 0.3.

dolphin-mistrallocal

The uncensored Dolphin model based on Mistral that excels at coding tasks. Updated to version 2.8.

wizardlm2local

State of the art large language model from Microsoft AI with improved performance on complex chat, multilingual, reasoning and agent use cases.

starling-lmlocal

Starling is a large language model trained by reinforcement learning from AI feedback focused on improving chatbot helpfulness.