Quick start

ollama run falcon2:latest

Runnable variants

Memory is a rough file-size estimate; context length, runtime and GPU offload change it.

12 of 17 matching variants shown.17 of 17 variants shown.

Tag	Type	Inputs	Digest	Download	Parameters	Quantization	Context	Est. memory	Run
11b	Typelocal	Inputstext	Digestd8c09dbc67c3	Download6.4 GB	Parameters11b	QuantizationUnknown	Context2K	Est. memory≈ 8.5 GB	`ollama run falcon2:11b`
11b-fp16	Typelocal	Inputstext	Digest1f71755ad500	Download22 GB	Parameters11b	QuantizationFP16	Context2K	Est. memory≈ 26 GB	`ollama run falcon2:11b-fp16`
11b-q2_K	Typelocal	Inputstext	Digest4051a7ef69a1	Download4.3 GB	Parameters11b	QuantizationQ2_K	Context2K	Est. memory≈ 6 GB	`ollama run falcon2:11b-q2_K`
11b-q3_K_L	Typelocal	Inputstext	Digest63a1a26d3ddc	Download5.8 GB	Parameters11b	QuantizationQ3_K_L	Context2K	Est. memory≈ 7.5 GB	`ollama run falcon2:11b-q3_K_L`
11b-q3_K_M	Typelocal	Inputstext	Digest6650bb4b1a0e	Download5.4 GB	Parameters11b	QuantizationQ3_K_M	Context2K	Est. memory≈ 7.5 GB	`ollama run falcon2:11b-q3_K_M`
11b-q3_K_S	Typelocal	Inputstext	Digest7e025ac717fb	Download4.9 GB	Parameters11b	QuantizationQ3_K_S	Context2K	Est. memory≈ 6.5 GB	`ollama run falcon2:11b-q3_K_S`
11b-q4_0	Typelocal	Inputstext	Digestd8c09dbc67c3	Download6.4 GB	Parameters11b	QuantizationQ4_0	Context2K	Est. memory≈ 8.5 GB	`ollama run falcon2:11b-q4_0`
11b-q4_1	Typelocal	Inputstext	Digest8e785c2d36e0	Download7.1 GB	Parameters11b	QuantizationQ4_1	Context2K	Est. memory≈ 9 GB	`ollama run falcon2:11b-q4_1`
11b-q4_K_M	Typelocal	Inputstext	Digest6aadb586b79f	Download6.8 GB	Parameters11b	QuantizationQ4_K_M	Context2K	Est. memory≈ 9 GB	`ollama run falcon2:11b-q4_K_M`
11b-q4_K_S	Typelocal	Inputstext	Digest57c340e36421	Download6.4 GB	Parameters11b	QuantizationQ4_K_S	Context2K	Est. memory≈ 8.5 GB	`ollama run falcon2:11b-q4_K_S`
11b-q5_0	Typelocal	Inputstext	Digest634fd8a33a16	Download7.7 GB	Parameters11b	QuantizationQ5_0	Context2K	Est. memory≈ 10 GB	`ollama run falcon2:11b-q5_0`
11b-q5_1	Typelocal	Inputstext	Digest227312808fcc	Download8.4 GB	Parameters11b	QuantizationQ5_1	Context2K	Est. memory≈ 10.5 GB	`ollama run falcon2:11b-q5_1`
11b-q5_K_M	Typelocal	Inputstext	Digestd47cbd539ec7	Download8.2 GB	Parameters11b	QuantizationQ5_K_M	Context2K	Est. memory≈ 10.5 GB	`ollama run falcon2:11b-q5_K_M`
11b-q5_K_S	Typelocal	Inputstext	Digestc29ab1d2a69a	Download7.7 GB	Parameters11b	QuantizationQ5_K_S	Context2K	Est. memory≈ 10 GB	`ollama run falcon2:11b-q5_K_S`
11b-q6_K	Typelocal	Inputstext	Digest326a76087a5d	Download9.2 GB	Parameters11b	QuantizationQ6_K	Context2K	Est. memory≈ 11.5 GB	`ollama run falcon2:11b-q6_K`
11b-q8_0	Typelocal	Inputstext	Digest2d49820d6bb5	Download12 GB	Parameters11b	QuantizationQ8_0	Context2K	Est. memory≈ 14.5 GB	`ollama run falcon2:11b-q8_0`
latestdefault	Typelocal	Inputstext	Digestd8c09dbc67c3	Download6.4 GB	ParametersUnknown	QuantizationUnknown	Context2K	Est. memory≈ 8.5 GB	`ollama run falcon2:latest`

Related models

falconlocal

A large language model built by the Technology Innovation Institute (TII) for use in summarization, text generation, and chat bots.

olmo2local

OLMo 2 is a new family of 7B and 13B models trained on up to 5T tokens. These models are on par with or better than equivalently sized fully open models, and competitive with open-weight models such as Llama 3.1 on English academic benchmarks.

nous-hermes2local

The powerful family of models by Nous Research that excels at scientific discussion and coding tasks.

solarlocal

A compact, yet powerful 10.7B large language model designed for single-turn conversation.