Quick start

ollama run firefunction-v2:latest

Runnable variants

Memory is a rough file-size estimate; context length, runtime and GPU offload change it.

12 of 17 matching variants shown.17 of 17 variants shown.

Tag	Type	Inputs	Digest	Download	Parameters	Quantization	Context	Est. memory	Run
70b	Typelocal	Inputstext	Digestb1ed6b22fb67	Download40 GB	Parameters70b	QuantizationUnknown	Context8K	Est. memory≈ 46 GB	`ollama run firefunction-v2:70b`
70b-fp16	Typelocal	Inputstext	Digest060676f6564d	Download141 GB	Parameters70b	QuantizationFP16	Context8K	Est. memory≈ 159 GB	`ollama run firefunction-v2:70b-fp16`
70b-q2_K	Typelocal	Inputstext	Digest3f7fd585d60c	Download26 GB	Parameters70b	QuantizationQ2_K	Context8K	Est. memory≈ 30.5 GB	`ollama run firefunction-v2:70b-q2_K`
70b-q3_K_L	Typelocal	Inputstext	Digest3e634098cae4	Download37 GB	Parameters70b	QuantizationQ3_K_L	Context8K	Est. memory≈ 42.5 GB	`ollama run firefunction-v2:70b-q3_K_L`
70b-q3_K_M	Typelocal	Inputstext	Digest80e79abf27be	Download34 GB	Parameters70b	QuantizationQ3_K_M	Context8K	Est. memory≈ 39 GB	`ollama run firefunction-v2:70b-q3_K_M`
70b-q3_K_S	Typelocal	Inputstext	Digest474005ee9e26	Download31 GB	Parameters70b	QuantizationQ3_K_S	Context8K	Est. memory≈ 36 GB	`ollama run firefunction-v2:70b-q3_K_S`
70b-q4_0	Typelocal	Inputstext	Digestb1ed6b22fb67	Download40 GB	Parameters70b	QuantizationQ4_0	Context8K	Est. memory≈ 46 GB	`ollama run firefunction-v2:70b-q4_0`
70b-q4_1	Typelocal	Inputstext	Digest15defaa47be1	Download44 GB	Parameters70b	QuantizationQ4_1	Context8K	Est. memory≈ 50.5 GB	`ollama run firefunction-v2:70b-q4_1`
70b-q4_K_M	Typelocal	Inputstext	Digestea3039802f87	Download43 GB	Parameters70b	QuantizationQ4_K_M	Context8K	Est. memory≈ 49.5 GB	`ollama run firefunction-v2:70b-q4_K_M`
70b-q4_K_S	Typelocal	Inputstext	Digest3bcbd6acb54d	Download40 GB	Parameters70b	QuantizationQ4_K_S	Context8K	Est. memory≈ 46 GB	`ollama run firefunction-v2:70b-q4_K_S`
70b-q5_0	Typelocal	Inputstext	Digest13b58ce67970	Download49 GB	Parameters70b	QuantizationQ5_0	Context8K	Est. memory≈ 56 GB	`ollama run firefunction-v2:70b-q5_0`
70b-q5_1	Typelocal	Inputstext	Digest669afb8bd416	Download53 GB	Parameters70b	QuantizationQ5_1	Context8K	Est. memory≈ 60.5 GB	`ollama run firefunction-v2:70b-q5_1`
70b-q5_K_M	Typelocal	Inputstext	Digeste74b3ca1941f	Download50 GB	Parameters70b	QuantizationQ5_K_M	Context8K	Est. memory≈ 57 GB	`ollama run firefunction-v2:70b-q5_K_M`
70b-q5_K_S	Typelocal	Inputstext	Digestfd0487aef428	Download49 GB	Parameters70b	QuantizationQ5_K_S	Context8K	Est. memory≈ 56 GB	`ollama run firefunction-v2:70b-q5_K_S`
70b-q6_K	Typelocal	Inputstext	Digest918017f6fcca	Download58 GB	Parameters70b	QuantizationQ6_K	Context8K	Est. memory≈ 66 GB	`ollama run firefunction-v2:70b-q6_K`
70b-q8_0	Typelocal	Inputstext	Digestb260af5d90a5	Download75 GB	Parameters70b	QuantizationQ8_0	Context8K	Est. memory≈ 85 GB	`ollama run firefunction-v2:70b-q8_0`
latestdefault	Typelocal	Inputstext	Digestb1ed6b22fb67	Download40 GB	ParametersUnknown	QuantizationUnknown	Context8K	Est. memory≈ 46 GB	`ollama run firefunction-v2:latest`

Source-listed applications

Claude CodeHermes AgentOpenClawOpenCode

Related models

llama3.3local

New state of the art 70B model. Llama 3.3 70B offers similar performance compared to the Llama 3.1 405B model.

nemotronlocal

Llama-3.1-Nemotron-70B-Instruct is a large language model customized by NVIDIA to improve the helpfulness of LLM generated responses to user queries.

nemotron-3.5-boltlocal

Nemotron 3.5 Bolt is NVIDIA’s compact vision-language model for local coding, reasoning, and tool use.

nemotron3local

NVIDIA Nemotron 3 Nano Omni is a multimodal large language model that unifies video, audio, image, and text understanding to support enterprise-grade Q&A, summarization, transcription, and document intelligence workflows.