Quick start

ollama run falcon3:latest

Runnable variants

Memory is a rough file-size estimate; context length, runtime and GPU offload change it.

12 of 17 matching variants shown.17 of 17 variants shown.

Tag	Type	Inputs	Digest	Download	Parameters	Quantization	Context	Est. memory	Run
10b	Typelocal	Inputstext	Digest1653ff122acd	Download6.3 GB	Parameters10b	QuantizationUnknown	Context32K	Est. memory≈ 8.5 GB	`ollama run falcon3:10b`
10b-instruct-fp16	Typelocal	Inputstext	Digestbbe05566f48a	Download21 GB	Parameters10b	QuantizationFP16	Context32K	Est. memory≈ 24.5 GB	`ollama run falcon3:10b-instruct-fp16`
10b-instruct-q4_K_M	Typelocal	Inputstext	Digest1653ff122acd	Download6.3 GB	Parameters10b	QuantizationQ4_K_M	Context32K	Est. memory≈ 8.5 GB	`ollama run falcon3:10b-instruct-q4_K_M`
10b-instruct-q8_0	Typelocal	Inputstext	Digestd56712f1783f	Download11 GB	Parameters10b	QuantizationQ8_0	Context32K	Est. memory≈ 13.5 GB	`ollama run falcon3:10b-instruct-q8_0`
1b	Typelocal	Inputstext	Digest5449d006a9c7	Download1.8 GB	Parameters1b	QuantizationUnknown	Context8K	Est. memory≈ 3.5 GB	`ollama run falcon3:1b`
1b-instruct-fp16	Typelocal	Inputstext	Digest60ee05ac8fa7	Download3.3 GB	Parameters1b	QuantizationFP16	Context8K	Est. memory≈ 5 GB	`ollama run falcon3:1b-instruct-fp16`
1b-instruct-q4_K_M	Typelocal	Inputstext	Digest13a315879c51	Download1.1 GB	Parameters1b	QuantizationQ4_K_M	Context8K	Est. memory≈ 2.5 GB	`ollama run falcon3:1b-instruct-q4_K_M`
1b-instruct-q8_0	Typelocal	Inputstext	Digest5449d006a9c7	Download1.8 GB	Parameters1b	QuantizationQ8_0	Context8K	Est. memory≈ 3.5 GB	`ollama run falcon3:1b-instruct-q8_0`
3b	Typelocal	Inputstext	Digest784a7eab5b89	Download2.0 GB	Parameters3b	QuantizationUnknown	Context32K	Est. memory≈ 3.5 GB	`ollama run falcon3:3b`
3b-instruct-fp16	Typelocal	Inputstext	Digesta45a32ae0c91	Download6.5 GB	Parameters3b	QuantizationFP16	Context32K	Est. memory≈ 8.5 GB	`ollama run falcon3:3b-instruct-fp16`
3b-instruct-q4_K_M	Typelocal	Inputstext	Digest784a7eab5b89	Download2.0 GB	Parameters3b	QuantizationQ4_K_M	Context32K	Est. memory≈ 3.5 GB	`ollama run falcon3:3b-instruct-q4_K_M`
3b-instruct-q8_0	Typelocal	Inputstext	Digest05a32e830399	Download3.4 GB	Parameters3b	QuantizationQ8_0	Context32K	Est. memory≈ 5 GB	`ollama run falcon3:3b-instruct-q8_0`
7b	Typelocal	Inputstext	Digest472ea1c89f64	Download4.6 GB	Parameters7b	QuantizationUnknown	Context32K	Est. memory≈ 6.5 GB	`ollama run falcon3:7b`
7b-instruct-fp16	Typelocal	Inputstext	Digest770fc0679654	Download15 GB	Parameters7b	QuantizationFP16	Context32K	Est. memory≈ 18 GB	`ollama run falcon3:7b-instruct-fp16`
7b-instruct-q4_K_M	Typelocal	Inputstext	Digest472ea1c89f64	Download4.6 GB	Parameters7b	QuantizationQ4_K_M	Context32K	Est. memory≈ 6.5 GB	`ollama run falcon3:7b-instruct-q4_K_M`
7b-instruct-q8_0	Typelocal	Inputstext	Digest49ffc7915656	Download7.9 GB	Parameters7b	QuantizationQ8_0	Context32K	Est. memory≈ 10 GB	`ollama run falcon3:7b-instruct-q8_0`
latestdefault	Typelocal	Inputstext	Digest472ea1c89f64	Download4.6 GB	ParametersUnknown	QuantizationUnknown	Context32K	Est. memory≈ 6.5 GB	`ollama run falcon3:latest`

Related models

deepseek-r1local

DeepSeek-R1 is a family of open reasoning models with performance approaching that of leading models, such as O3 and Gemini 2.5 Pro.

starcoder2local

StarCoder2 is the next generation of transparently trained open code LLMs that comes in three sizes: 3B, 7B and 15B parameters.

deepscalerlocal

A fine-tuned version of Deepseek-R1-Distilled-Qwen-1.5B that surpasses the performance of OpenAI’s o1-preview with just 1.5B parameters on popular math evaluations.

stable-codelocal

Stable Code 3B is a coding model with instruct and code completion variants on par with models such as Code Llama 7B that are 2.5x larger.