Quick start

ollama run llama-guard3:latest

Runnable variants

Memory is a rough file-size estimate; context length, runtime and GPU offload change it.

12 of 33 matching variants shown.33 of 33 variants shown.

Tag	Type	Inputs	Digest	Download	Parameters	Quantization	Context	Est. memory	Run
1b	Typelocal	Inputstext	Digest494147e06bf9	Download1.6 GB	Parameters1b	QuantizationUnknown	Context128K	Est. memory≈ 3 GB	`ollama run llama-guard3:1b`
1b-fp16	Typelocal	Inputstext	Digestd72f84e54012	Download3.0 GB	Parameters1b	QuantizationFP16	Context128K	Est. memory≈ 4.5 GB	`ollama run llama-guard3:1b-fp16`
1b-q2_K	Typelocal	Inputstext	Digest4f4a8f765204	Download667 MB	Parameters1b	QuantizationQ2_K	Context128K	Est. memory≈ 2 GB	`ollama run llama-guard3:1b-q2_K`
1b-q3_K_L	Typelocal	Inputstext	Digest56573dbb7522	Download845 MB	Parameters1b	QuantizationQ3_K_L	Context128K	Est. memory≈ 2 GB	`ollama run llama-guard3:1b-q3_K_L`
1b-q3_K_M	Typelocal	Inputstext	Digestb78caaa936b2	Download804 MB	Parameters1b	QuantizationQ3_K_M	Context128K	Est. memory≈ 2 GB	`ollama run llama-guard3:1b-q3_K_M`
1b-q3_K_S	Typelocal	Inputstext	Digestba60616a0c42	Download755 MB	Parameters1b	QuantizationQ3_K_S	Context128K	Est. memory≈ 2 GB	`ollama run llama-guard3:1b-q3_K_S`
1b-q4_0	Typelocal	Inputstext	Digest9ef1b1d8bcf1	Download919 MB	Parameters1b	QuantizationQ4_0	Context128K	Est. memory≈ 2.5 GB	`ollama run llama-guard3:1b-q4_0`
1b-q4_1	Typelocal	Inputstext	Digest472f17649b81	Download996 MB	Parameters1b	QuantizationQ4_1	Context128K	Est. memory≈ 2.5 GB	`ollama run llama-guard3:1b-q4_1`
1b-q4_K_M	Typelocal	Inputstext	Digestf00008beff55	Download955 MB	Parameters1b	QuantizationQ4_K_M	Context128K	Est. memory≈ 2.5 GB	`ollama run llama-guard3:1b-q4_K_M`
1b-q4_K_S	Typelocal	Inputstext	Digestc704818a1eb7	Download923 MB	Parameters1b	QuantizationQ4_K_S	Context128K	Est. memory≈ 2.5 GB	`ollama run llama-guard3:1b-q4_K_S`
1b-q5_0	Typelocal	Inputstext	Digestaddf16c29474	Download1.1 GB	Parameters1b	QuantizationQ5_0	Context128K	Est. memory≈ 2.5 GB	`ollama run llama-guard3:1b-q5_0`
1b-q5_1	Typelocal	Inputstext	Digestb50f55fc799b	Download1.2 GB	Parameters1b	QuantizationQ5_1	Context128K	Est. memory≈ 2.5 GB	`ollama run llama-guard3:1b-q5_1`
1b-q5_K_M	Typelocal	Inputstext	Digestce0d5502e1e3	Download1.1 GB	Parameters1b	QuantizationQ5_K_M	Context128K	Est. memory≈ 2.5 GB	`ollama run llama-guard3:1b-q5_K_M`
1b-q5_K_S	Typelocal	Inputstext	Digest0d2095859cf0	Download1.1 GB	Parameters1b	QuantizationQ5_K_S	Context128K	Est. memory≈ 2.5 GB	`ollama run llama-guard3:1b-q5_K_S`
1b-q6_K	Typelocal	Inputstext	Digestfa99080590a2	Download1.2 GB	Parameters1b	QuantizationQ6_K	Context128K	Est. memory≈ 2.5 GB	`ollama run llama-guard3:1b-q6_K`
1b-q8_0	Typelocal	Inputstext	Digest494147e06bf9	Download1.6 GB	Parameters1b	QuantizationQ8_0	Context128K	Est. memory≈ 3 GB	`ollama run llama-guard3:1b-q8_0`
8b	Typelocal	Inputstext	Digest46f211c3d866	Download4.9 GB	Parameters8b	QuantizationUnknown	Context128K	Est. memory≈ 6.5 GB	`ollama run llama-guard3:8b`
8b-fp16	Typelocal	Inputstext	Digest6945df9ed1fe	Download16 GB	Parameters8b	QuantizationFP16	Context128K	Est. memory≈ 19 GB	`ollama run llama-guard3:8b-fp16`
8b-q2_K	Typelocal	Inputstext	Digest48bd36a8a40c	Download3.2 GB	Parameters8b	QuantizationQ2_K	Context128K	Est. memory≈ 5 GB	`ollama run llama-guard3:8b-q2_K`
8b-q3_K_L	Typelocal	Inputstext	Digestbea5c2385dc2	Download4.3 GB	Parameters8b	QuantizationQ3_K_L	Context128K	Est. memory≈ 6 GB	`ollama run llama-guard3:8b-q3_K_L`
8b-q3_K_M	Typelocal	Inputstext	Digest0043e6c0f561	Download4.0 GB	Parameters8b	QuantizationQ3_K_M	Context128K	Est. memory≈ 5.5 GB	`ollama run llama-guard3:8b-q3_K_M`
8b-q3_K_S	Typelocal	Inputstext	Digestd1fa14fbd1a6	Download3.7 GB	Parameters8b	QuantizationQ3_K_S	Context128K	Est. memory≈ 5.5 GB	`ollama run llama-guard3:8b-q3_K_S`
8b-q4_0	Typelocal	Inputstext	Digestd8d7fb8dfa56	Download4.7 GB	Parameters8b	QuantizationQ4_0	Context128K	Est. memory≈ 6.5 GB	`ollama run llama-guard3:8b-q4_0`
8b-q4_1	Typelocal	Inputstext	Digestdbdbb468940f	Download5.1 GB	Parameters8b	QuantizationQ4_1	Context128K	Est. memory≈ 7 GB	`ollama run llama-guard3:8b-q4_1`
8b-q4_K_M	Typelocal	Inputstext	Digest46f211c3d866	Download4.9 GB	Parameters8b	QuantizationQ4_K_M	Context128K	Est. memory≈ 6.5 GB	`ollama run llama-guard3:8b-q4_K_M`
8b-q4_K_S	Typelocal	Inputstext	Digest7e8d75f07310	Download4.7 GB	Parameters8b	QuantizationQ4_K_S	Context128K	Est. memory≈ 6.5 GB	`ollama run llama-guard3:8b-q4_K_S`
8b-q5_0	Typelocal	Inputstext	Digestd3622397e2ce	Download5.6 GB	Parameters8b	QuantizationQ5_0	Context128K	Est. memory≈ 7.5 GB	`ollama run llama-guard3:8b-q5_0`
8b-q5_1	Typelocal	Inputstext	Digestf32c583fc2dd	Download6.1 GB	Parameters8b	QuantizationQ5_1	Context128K	Est. memory≈ 8 GB	`ollama run llama-guard3:8b-q5_1`
8b-q5_K_M	Typelocal	Inputstext	Digest38e0f1d13795	Download5.7 GB	Parameters8b	QuantizationQ5_K_M	Context128K	Est. memory≈ 7.5 GB	`ollama run llama-guard3:8b-q5_K_M`
8b-q5_K_S	Typelocal	Inputstext	Digestadfedf090c4a	Download5.6 GB	Parameters8b	QuantizationQ5_K_S	Context128K	Est. memory≈ 7.5 GB	`ollama run llama-guard3:8b-q5_K_S`
8b-q6_K	Typelocal	Inputstext	Digestca512b2c0abf	Download6.6 GB	Parameters8b	QuantizationQ6_K	Context128K	Est. memory≈ 8.5 GB	`ollama run llama-guard3:8b-q6_K`
8b-q8_0	Typelocal	Inputstext	Digest5cc118047fb2	Download8.5 GB	Parameters8b	QuantizationQ8_0	Context128K	Est. memory≈ 10.5 GB	`ollama run llama-guard3:8b-q8_0`
latestdefault	Typelocal	Inputstext	Digest46f211c3d866	Download4.9 GB	ParametersUnknown	QuantizationUnknown	Context128K	Est. memory≈ 6.5 GB	`ollama run llama-guard3:latest`

Related models

mxbai-embed-largelocal

State-of-the-art large embedding model from mixedbread.ai

bge-largelocal

Embedding model from BAAI mapping texts to vectors.

qwen2-mathlocal

Qwen2 Math is a series of specialized math language models built upon the Qwen2 LLMs, which significantly outperforms the mathematical capabilities of open-source models and even closed-source models (e.g., GPT4o).

layalocal

Laya is a 421M decision model from Convai Innovations, fine-tuned from ModernBERT-large.