Quick start

ollama run bakllava:latest

Runnable variants

Memory is a rough file-size estimate; context length, runtime and GPU offload change it.

12 of 17 matching variants shown.17 of 17 variants shown.

Tag	Type	Inputs	Digest	Download	Parameters	Quantization	Context	Est. memory	Run
7b	Typelocal	Inputstext, image	Digest3dd68bd4447c	Download4.7 GB	Parameters7b	QuantizationUnknown	Context32K	Est. memory≈ 6.5 GB	`ollama run bakllava:7b`
7b-v1-fp16	Typelocal	Inputstext, image	Digestad44fb2047c1	Download15 GB	Parameters7b	QuantizationFP16	Context32K	Est. memory≈ 18 GB	`ollama run bakllava:7b-v1-fp16`
7b-v1-q2_K	Typelocal	Inputstext, image	Digest2b262088f95e	Download3.7 GB	Parameters7b	QuantizationQ2_K	Context32K	Est. memory≈ 5.5 GB	`ollama run bakllava:7b-v1-q2_K`
7b-v1-q3_K_L	Typelocal	Inputstext, image	Digest1c83e7ae2916	Download4.4 GB	Parameters7b	QuantizationQ3_K_L	Context32K	Est. memory≈ 6 GB	`ollama run bakllava:7b-v1-q3_K_L`
7b-v1-q3_K_M	Typelocal	Inputstext, image	Digest76ddbf1eee47	Download4.1 GB	Parameters7b	QuantizationQ3_K_M	Context32K	Est. memory≈ 6 GB	`ollama run bakllava:7b-v1-q3_K_M`
7b-v1-q3_K_S	Typelocal	Inputstext, image	Digest58c3c55e353b	Download3.8 GB	Parameters7b	QuantizationQ3_K_S	Context32K	Est. memory≈ 5.5 GB	`ollama run bakllava:7b-v1-q3_K_S`
7b-v1-q4_0	Typelocal	Inputstext, image	Digest3dd68bd4447c	Download4.7 GB	Parameters7b	QuantizationQ4_0	Context32K	Est. memory≈ 6.5 GB	`ollama run bakllava:7b-v1-q4_0`
7b-v1-q4_1	Typelocal	Inputstext, image	Digest5661864b39bf	Download5.2 GB	Parameters7b	QuantizationQ4_1	Context32K	Est. memory≈ 7 GB	`ollama run bakllava:7b-v1-q4_1`
7b-v1-q4_K_M	Typelocal	Inputstext, image	Digest18f34660c11c	Download5.0 GB	Parameters7b	QuantizationQ4_K_M	Context32K	Est. memory≈ 7 GB	`ollama run bakllava:7b-v1-q4_K_M`
7b-v1-q4_K_S	Typelocal	Inputstext, image	Digest7bde2065bef9	Download4.8 GB	Parameters7b	QuantizationQ4_K_S	Context32K	Est. memory≈ 6.5 GB	`ollama run bakllava:7b-v1-q4_K_S`
7b-v1-q5_0	Typelocal	Inputstext, image	Digeste1ec8078f994	Download5.6 GB	Parameters7b	QuantizationQ5_0	Context32K	Est. memory≈ 7.5 GB	`ollama run bakllava:7b-v1-q5_0`
7b-v1-q5_1	Typelocal	Inputstext, image	Digest2ecc0da390e6	Download6.1 GB	Parameters7b	QuantizationQ5_1	Context32K	Est. memory≈ 8 GB	`ollama run bakllava:7b-v1-q5_1`
7b-v1-q5_K_M	Typelocal	Inputstext, image	Digest701ad599d4e8	Download5.8 GB	Parameters7b	QuantizationQ5_K_M	Context32K	Est. memory≈ 7.5 GB	`ollama run bakllava:7b-v1-q5_K_M`
7b-v1-q5_K_S	Typelocal	Inputstext, image	Digestb3495a4598af	Download5.6 GB	Parameters7b	QuantizationQ5_K_S	Context32K	Est. memory≈ 7.5 GB	`ollama run bakllava:7b-v1-q5_K_S`
7b-v1-q6_K	Typelocal	Inputstext, image	Digestc338a33fa0f7	Download6.6 GB	Parameters7b	QuantizationQ6_K	Context32K	Est. memory≈ 8.5 GB	`ollama run bakllava:7b-v1-q6_K`
7b-v1-q8_0	Typelocal	Inputstext, image	Digest52bc26311d1a	Download8.3 GB	Parameters7b	QuantizationQ8_0	Context32K	Est. memory≈ 10.5 GB	`ollama run bakllava:7b-v1-q8_0`
latestdefault	Typelocal	Inputstext, image	Digest3dd68bd4447c	Download4.7 GB	ParametersUnknown	QuantizationUnknown	Context32K	Est. memory≈ 6.5 GB	`ollama run bakllava:latest`

Related models

d1local

d1 is a 3B decision model from Liquid AI, built on LFM2.5-VL-3B

minicpm-vlocal

A series of multimodal LLMs (MLLMs) designed for vision-language understanding.

translategemmalocal

A new collection of open translation models built on Gemma 3, helping people communicate across 55 languages.

medgemmalocal

MedGemma is a collection of Gemma 3 variants that are trained for performance on medical text and image comprehension.