Skip to main content
Ollama ExplorerBeta
Back to models
local

granite3-guardian

The IBM Granite Guardian 3.0 2B and 8B models are designed to detect risks in prompts and/or responses.

347K pulls10 tagsSource updated Nov 19, 20248K max context

Quick start

ollama run granite3-guardian:latest

Runnable variants

Memory is a rough file-size estimate; context length, runtime and GPU offload change it.

10 of 10 matching variants shown.

2bTypelocalInputstextDigestba81a177bd23Download2.7 GBParameters2bQuantizationUnknownContext8KEst. memory≈ 4.5 GB
ollama run granite3-guardian:2b
2b-fp16TypelocalInputstextDigest2bf55927dd85Download5.1 GBParameters2bQuantizationFP16Context8KEst. memory≈ 7 GB
ollama run granite3-guardian:2b-fp16
2b-q8_0TypelocalInputstextDigestba81a177bd23Download2.7 GBParameters2bQuantizationQ8_0Context8KEst. memory≈ 4.5 GB
ollama run granite3-guardian:2b-q8_0
8bTypelocalInputstextDigestc8d7d5c76685Download5.8 GBParameters8bQuantizationUnknownContext8KEst. memory≈ 7.5 GB
ollama run granite3-guardian:8b
8b-fp16TypelocalInputstextDigestd9ecead6310dDownload16 GBParameters8bQuantizationFP16Context8KEst. memory≈ 19 GB
ollama run granite3-guardian:8b-fp16
8b-q5_K_MTypelocalInputstextDigestc8d7d5c76685Download5.8 GBParameters8bQuantizationQ5_K_MContext8KEst. memory≈ 7.5 GB
ollama run granite3-guardian:8b-q5_K_M
8b-q5_K_STypelocalInputstextDigestedeec72aa741Download5.6 GBParameters8bQuantizationQ5_K_SContext8KEst. memory≈ 7.5 GB
ollama run granite3-guardian:8b-q5_K_S
8b-q6_KTypelocalInputstextDigest200f63c67d98Download6.7 GBParameters8bQuantizationQ6_KContext8KEst. memory≈ 8.5 GB
ollama run granite3-guardian:8b-q6_K
8b-q8_0TypelocalInputstextDigesta91578a591d2Download8.7 GBParameters8bQuantizationQ8_0Context8KEst. memory≈ 11 GB
ollama run granite3-guardian:8b-q8_0
latestdefaultTypelocalInputstextDigestba81a177bd23Download2.7 GBParametersUnknownQuantizationUnknownContext8KEst. memory≈ 4.5 GB
ollama run granite3-guardian:latest

Related models

mistrallocal

The 7B model released by Mistral AI, updated to version 0.3.

dolphin-mistrallocal

The uncensored Dolphin model based on Mistral that excels at coding tasks. Updated to version 2.8.

wizardlm2local

State of the art large language model from Microsoft AI with improved performance on complex chat, multilingual, reasoning and agent use cases.

starling-lmlocal

Starling is a large language model trained by reinforcement learning from AI feedback focused on improving chatbot helpfulness.