Quick start

ollama run notus:latest

Runnable variants

Memory is a rough file-size estimate; context length, runtime and GPU offload change it.

12 of 18 matching variants shown.18 of 18 variants shown.

Tag	Type	Inputs	Digest	Download	Parameters	Quantization	Context	Est. memory	Run
7b	Typelocal	Inputstext	Digest43c512e16786	Download4.1 GB	Parameters7b	QuantizationUnknown	Context32K	Est. memory≈ 6 GB	`ollama run notus:7b`
7b-v1	Typelocal	Inputstext	Digest43c512e16786	Download4.1 GB	Parameters7b	QuantizationUnknown	Context32K	Est. memory≈ 6 GB	`ollama run notus:7b-v1`
7b-v1-fp16	Typelocal	Inputstext	Digest2da08fbc17f3	Download14 GB	Parameters7b	QuantizationFP16	Context32K	Est. memory≈ 17 GB	`ollama run notus:7b-v1-fp16`
7b-v1-q2_K	Typelocal	Inputstext	Digest577ecb9ceace	Download3.1 GB	Parameters7b	QuantizationQ2_K	Context32K	Est. memory≈ 4.5 GB	`ollama run notus:7b-v1-q2_K`
7b-v1-q3_K_L	Typelocal	Inputstext	Digestfba4029e7992	Download3.8 GB	Parameters7b	QuantizationQ3_K_L	Context32K	Est. memory≈ 5.5 GB	`ollama run notus:7b-v1-q3_K_L`
7b-v1-q3_K_M	Typelocal	Inputstext	Digest3293885c4fdb	Download3.5 GB	Parameters7b	QuantizationQ3_K_M	Context32K	Est. memory≈ 5 GB	`ollama run notus:7b-v1-q3_K_M`
7b-v1-q3_K_S	Typelocal	Inputstext	Digest86c3a67a139d	Download3.2 GB	Parameters7b	QuantizationQ3_K_S	Context32K	Est. memory≈ 5 GB	`ollama run notus:7b-v1-q3_K_S`
7b-v1-q4_0	Typelocal	Inputstext	Digest43c512e16786	Download4.1 GB	Parameters7b	QuantizationQ4_0	Context32K	Est. memory≈ 6 GB	`ollama run notus:7b-v1-q4_0`
7b-v1-q4_1	Typelocal	Inputstext	Digest38a71126d0df	Download4.6 GB	Parameters7b	QuantizationQ4_1	Context32K	Est. memory≈ 6.5 GB	`ollama run notus:7b-v1-q4_1`
7b-v1-q4_K_M	Typelocal	Inputstext	Digest444648af6d37	Download4.4 GB	Parameters7b	QuantizationQ4_K_M	Context32K	Est. memory≈ 6 GB	`ollama run notus:7b-v1-q4_K_M`
7b-v1-q4_K_S	Typelocal	Inputstext	Digest3321b0e7eb01	Download4.1 GB	Parameters7b	QuantizationQ4_K_S	Context32K	Est. memory≈ 6 GB	`ollama run notus:7b-v1-q4_K_S`
7b-v1-q5_0	Typelocal	Inputstext	Digest1b3a120c0ee4	Download5.0 GB	Parameters7b	QuantizationQ5_0	Context32K	Est. memory≈ 7 GB	`ollama run notus:7b-v1-q5_0`
7b-v1-q5_1	Typelocal	Inputstext	Digesta1a23c0638d0	Download5.4 GB	Parameters7b	QuantizationQ5_1	Context32K	Est. memory≈ 7.5 GB	`ollama run notus:7b-v1-q5_1`
7b-v1-q5_K_M	Typelocal	Inputstext	Digest07fe7b1736b9	Download5.1 GB	Parameters7b	QuantizationQ5_K_M	Context32K	Est. memory≈ 7 GB	`ollama run notus:7b-v1-q5_K_M`
7b-v1-q5_K_S	Typelocal	Inputstext	Digest00bb14ed7fca	Download5.0 GB	Parameters7b	QuantizationQ5_K_S	Context32K	Est. memory≈ 7 GB	`ollama run notus:7b-v1-q5_K_S`
7b-v1-q6_K	Typelocal	Inputstext	Digestf55d593525c3	Download5.9 GB	Parameters7b	QuantizationQ6_K	Context32K	Est. memory≈ 8 GB	`ollama run notus:7b-v1-q6_K`
7b-v1-q8_0	Typelocal	Inputstext	Digest4f664c6f7b54	Download7.7 GB	Parameters7b	QuantizationQ8_0	Context32K	Est. memory≈ 10 GB	`ollama run notus:7b-v1-q8_0`
latestdefault	Typelocal	Inputstext	Digest43c512e16786	Download4.1 GB	ParametersUnknown	QuantizationUnknown	Context32K	Est. memory≈ 6 GB	`ollama run notus:latest`

Related models

sqlcoderlocal

SQLCoder is a code completion model fined-tuned on StarCoder for SQL generation tasks

openchatlocal

A family of open-source models trained on a wide variety of data, surpassing ChatGPT on various benchmarks. Updated to version 3.5-0106.

openhermeslocal

OpenHermes 2.5 is a 7B model fine-tuned by Teknium on Mistral with fully open datasets.

zephyrlocal

Zephyr is a series of fine-tuned versions of the Mistral and Mixtral models that are trained to act as helpful assistants.