Quick start

ollama run falcon:latest

Runnable variants

Memory is a rough file-size estimate; context length, runtime and GPU offload change it.

12 of 38 matching variants shown.38 of 38 variants shown.

Tag	Type	Inputs	Digest	Download	Parameters	Quantization	Context	Est. memory	Run
180b	Typelocal	Inputstext	Digeste2bc879d7cee	Download101 GB	Parameters180b	QuantizationUnknown	Context2K	Est. memory≈ 114 GB	`ollama run falcon:180b`
180b-chat	Typelocal	Inputstext	Digeste2bc879d7cee	Download101 GB	Parameters180b	QuantizationUnknown	Context2K	Est. memory≈ 114 GB	`ollama run falcon:180b-chat`
180b-chat-q4_0	Typelocal	Inputstext	Digeste2bc879d7cee	Download101 GB	Parameters180b	QuantizationQ4_0	Context2K	Est. memory≈ 114 GB	`ollama run falcon:180b-chat-q4_0`
180b-text	Typelocal	Inputstext	Digestf5905a53ed4b	Download101 GB	Parameters180b	QuantizationUnknown	Context2K	Est. memory≈ 114 GB	`ollama run falcon:180b-text`
180b-text-q4_0	Typelocal	Inputstext	Digestf5905a53ed4b	Download101 GB	Parameters180b	QuantizationQ4_0	Context2K	Est. memory≈ 114 GB	`ollama run falcon:180b-text-q4_0`
40b	Typelocal	Inputstext	Digestbc9368437a24	Download24 GB	Parameters40b	QuantizationUnknown	Context2K	Est. memory≈ 28 GB	`ollama run falcon:40b`
40b-instruct	Typelocal	Inputstext	Digestbc9368437a24	Download24 GB	Parameters40b	QuantizationUnknown	Context2K	Est. memory≈ 28 GB	`ollama run falcon:40b-instruct`
40b-instruct-fp16	Typelocal	Inputstext	Digest7cbd92dfea70	Download84 GB	Parameters40b	QuantizationFP16	Context2K	Est. memory≈ 95 GB	`ollama run falcon:40b-instruct-fp16`
40b-instruct-q4_0	Typelocal	Inputstext	Digestbc9368437a24	Download24 GB	Parameters40b	QuantizationQ4_0	Context2K	Est. memory≈ 28 GB	`ollama run falcon:40b-instruct-q4_0`
40b-instruct-q4_1	Typelocal	Inputstext	Digest9ec7eaf6cd59	Download26 GB	Parameters40b	QuantizationQ4_1	Context2K	Est. memory≈ 30.5 GB	`ollama run falcon:40b-instruct-q4_1`
40b-instruct-q5_0	Typelocal	Inputstext	Digestca8da6223021	Download29 GB	Parameters40b	QuantizationQ5_0	Context2K	Est. memory≈ 33.5 GB	`ollama run falcon:40b-instruct-q5_0`
40b-instruct-q5_1	Typelocal	Inputstext	Digest9e4a62b9534b	Download32 GB	Parameters40b	QuantizationQ5_1	Context2K	Est. memory≈ 37 GB	`ollama run falcon:40b-instruct-q5_1`
40b-instruct-q8_0	Typelocal	Inputstext	Digest6f9c09b99fc6	Download44 GB	Parameters40b	QuantizationQ8_0	Context2K	Est. memory≈ 50.5 GB	`ollama run falcon:40b-instruct-q8_0`
40b-text	Typelocal	Inputstext	Digestb4137657e4e9	Download24 GB	Parameters40b	QuantizationUnknown	Context2K	Est. memory≈ 28 GB	`ollama run falcon:40b-text`
40b-text-fp16	Typelocal	Inputstext	Digestbc0d50593221	Download84 GB	Parameters40b	QuantizationFP16	Context2K	Est. memory≈ 95 GB	`ollama run falcon:40b-text-fp16`
40b-text-q4_0	Typelocal	Inputstext	Digestb4137657e4e9	Download24 GB	Parameters40b	QuantizationQ4_0	Context2K	Est. memory≈ 28 GB	`ollama run falcon:40b-text-q4_0`
40b-text-q4_1	Typelocal	Inputstext	Digestd9b1df212f90	Download26 GB	Parameters40b	QuantizationQ4_1	Context2K	Est. memory≈ 30.5 GB	`ollama run falcon:40b-text-q4_1`
40b-text-q5_0	Typelocal	Inputstext	Digest753deb72fbcd	Download29 GB	Parameters40b	QuantizationQ5_0	Context2K	Est. memory≈ 33.5 GB	`ollama run falcon:40b-text-q5_0`
40b-text-q5_1	Typelocal	Inputstext	Digest10c176bb433f	Download32 GB	Parameters40b	QuantizationQ5_1	Context2K	Est. memory≈ 37 GB	`ollama run falcon:40b-text-q5_1`
40b-text-q8_0	Typelocal	Inputstext	Digest3573ccb06045	Download44 GB	Parameters40b	QuantizationQ8_0	Context2K	Est. memory≈ 50.5 GB	`ollama run falcon:40b-text-q8_0`
7b	Typelocal	Inputstext	Digest4280f7257e73	Download4.2 GB	Parameters7b	QuantizationUnknown	Context2K	Est. memory≈ 6 GB	`ollama run falcon:7b`
7b-instruct	Typelocal	Inputstext	Digest4280f7257e73	Download4.2 GB	Parameters7b	QuantizationUnknown	Context2K	Est. memory≈ 6 GB	`ollama run falcon:7b-instruct`
7b-instruct-fp16	Typelocal	Inputstext	Digest696dae724ad2	Download14 GB	Parameters7b	QuantizationFP16	Context2K	Est. memory≈ 17 GB	`ollama run falcon:7b-instruct-fp16`
7b-instruct-q4_0	Typelocal	Inputstext	Digest4280f7257e73	Download4.2 GB	Parameters7b	QuantizationQ4_0	Context2K	Est. memory≈ 6 GB	`ollama run falcon:7b-instruct-q4_0`
7b-instruct-q4_1	Typelocal	Inputstext	Digestf06a70f0b7d2	Download4.6 GB	Parameters7b	QuantizationQ4_1	Context2K	Est. memory≈ 6.5 GB	`ollama run falcon:7b-instruct-q4_1`
7b-instruct-q5_0	Typelocal	Inputstext	Digestef910bf6af84	Download5.1 GB	Parameters7b	QuantizationQ5_0	Context2K	Est. memory≈ 7 GB	`ollama run falcon:7b-instruct-q5_0`
7b-instruct-q5_1	Typelocal	Inputstext	Digest878a7290ef26	Download5.5 GB	Parameters7b	QuantizationQ5_1	Context2K	Est. memory≈ 7.5 GB	`ollama run falcon:7b-instruct-q5_1`
7b-instruct-q8_0	Typelocal	Inputstext	Digest836fb3b71733	Download7.7 GB	Parameters7b	QuantizationQ8_0	Context2K	Est. memory≈ 10 GB	`ollama run falcon:7b-instruct-q8_0`
7b-text	Typelocal	Inputstext	Digeste449cf4ba505	Download4.2 GB	Parameters7b	QuantizationUnknown	Context2K	Est. memory≈ 6 GB	`ollama run falcon:7b-text`
7b-text-fp16	Typelocal	Inputstext	Digestc2de45e2ed45	Download14 GB	Parameters7b	QuantizationFP16	Context2K	Est. memory≈ 17 GB	`ollama run falcon:7b-text-fp16`
7b-text-q4_0	Typelocal	Inputstext	Digeste449cf4ba505	Download4.2 GB	Parameters7b	QuantizationQ4_0	Context2K	Est. memory≈ 6 GB	`ollama run falcon:7b-text-q4_0`
7b-text-q4_1	Typelocal	Inputstext	Digest51498c22efa8	Download4.6 GB	Parameters7b	QuantizationQ4_1	Context2K	Est. memory≈ 6.5 GB	`ollama run falcon:7b-text-q4_1`
7b-text-q5_0	Typelocal	Inputstext	Digest539880f876a8	Download5.1 GB	Parameters7b	QuantizationQ5_0	Context2K	Est. memory≈ 7 GB	`ollama run falcon:7b-text-q5_0`
7b-text-q5_1	Typelocal	Inputstext	Digest3a4e772d215e	Download5.5 GB	Parameters7b	QuantizationQ5_1	Context2K	Est. memory≈ 7.5 GB	`ollama run falcon:7b-text-q5_1`
7b-text-q8_0	Typelocal	Inputstext	Digest9e4ddb71d35d	Download7.7 GB	Parameters7b	QuantizationQ8_0	Context2K	Est. memory≈ 10 GB	`ollama run falcon:7b-text-q8_0`
instruct	Typelocal	Inputstext	Digest4280f7257e73	Download4.2 GB	ParametersUnknown	QuantizationUnknown	Context2K	Est. memory≈ 6 GB	`ollama run falcon:instruct`
latestdefault	Typelocal	Inputstext	Digest4280f7257e73	Download4.2 GB	ParametersUnknown	QuantizationUnknown	Context2K	Est. memory≈ 6 GB	`ollama run falcon:latest`
text	Typelocal	Inputstext	Digeste449cf4ba505	Download4.2 GB	ParametersUnknown	QuantizationUnknown	Context2K	Est. memory≈ 6 GB	`ollama run falcon:text`

Related models

falcon2local

Falcon2 is an 11B parameters causal decoder-only model built by TII and trained over 5T tokens.

minicpm-vlocal

A series of multimodal LLMs (MLLMs) designed for vision-language understanding.

glm4local

A strong multi-lingual general language model with competitive performance to Llama 3.

codegeex4local

A versatile model for AI software development scenarios, including code completion.