Quick start

ollama run gemma2:latest

Runnable variants

Memory is a rough file-size estimate; context length, runtime and GPU offload change it.

12 of 94 matching variants shown.94 of 94 variants shown.

Tag	Type	Inputs	Digest	Download	Parameters	Quantization	Context	Est. memory	Run
27b	Typelocal	Inputstext	Digest53261bc9c192	Download16 GB	Parameters27b	QuantizationUnknown	Context8K	Est. memory≈ 19 GB	`ollama run gemma2:27b`
27b-instruct-fp16	Typelocal	Inputstext	Digest4a8f851205c5	Download54 GB	Parameters27b	QuantizationFP16	Context8K	Est. memory≈ 61.5 GB	`ollama run gemma2:27b-instruct-fp16`
27b-instruct-q2_K	Typelocal	Inputstext	Digest76893265b678	Download10 GB	Parameters27b	QuantizationQ2_K	Context8K	Est. memory≈ 12.5 GB	`ollama run gemma2:27b-instruct-q2_K`
27b-instruct-q3_K_L	Typelocal	Inputstext	Digestb4373ced0518	Download15 GB	Parameters27b	QuantizationQ3_K_L	Context8K	Est. memory≈ 18 GB	`ollama run gemma2:27b-instruct-q3_K_L`
27b-instruct-q3_K_M	Typelocal	Inputstext	Digest6a5f9669ec46	Download13 GB	Parameters27b	QuantizationQ3_K_M	Context8K	Est. memory≈ 16 GB	`ollama run gemma2:27b-instruct-q3_K_M`
27b-instruct-q3_K_S	Typelocal	Inputstext	Digest69280a4e9328	Download12 GB	Parameters27b	QuantizationQ3_K_S	Context8K	Est. memory≈ 14.5 GB	`ollama run gemma2:27b-instruct-q3_K_S`
27b-instruct-q4_0	Typelocal	Inputstext	Digest53261bc9c192	Download16 GB	Parameters27b	QuantizationQ4_0	Context8K	Est. memory≈ 19 GB	`ollama run gemma2:27b-instruct-q4_0`
27b-instruct-q4_1	Typelocal	Inputstext	Digest00571b7df00d	Download17 GB	Parameters27b	QuantizationQ4_1	Context8K	Est. memory≈ 20 GB	`ollama run gemma2:27b-instruct-q4_1`
27b-instruct-q4_K_M	Typelocal	Inputstext	Digestcfd95e5696e9	Download17 GB	Parameters27b	QuantizationQ4_K_M	Context8K	Est. memory≈ 20 GB	`ollama run gemma2:27b-instruct-q4_K_M`
27b-instruct-q4_K_S	Typelocal	Inputstext	Digest04e31e399ce4	Download16 GB	Parameters27b	QuantizationQ4_K_S	Context8K	Est. memory≈ 19 GB	`ollama run gemma2:27b-instruct-q4_K_S`
27b-instruct-q5_0	Typelocal	Inputstext	Digest9a3c9159e872	Download19 GB	Parameters27b	QuantizationQ5_0	Context8K	Est. memory≈ 22.5 GB	`ollama run gemma2:27b-instruct-q5_0`
27b-instruct-q5_1	Typelocal	Inputstext	Digest2945f01919f8	Download21 GB	Parameters27b	QuantizationQ5_1	Context8K	Est. memory≈ 24.5 GB	`ollama run gemma2:27b-instruct-q5_1`
27b-instruct-q5_K_M	Typelocal	Inputstext	Digestfc62fd7d70c9	Download19 GB	Parameters27b	QuantizationQ5_K_M	Context8K	Est. memory≈ 22.5 GB	`ollama run gemma2:27b-instruct-q5_K_M`
27b-instruct-q5_K_S	Typelocal	Inputstext	Digest44414d6eeb99	Download19 GB	Parameters27b	QuantizationQ5_K_S	Context8K	Est. memory≈ 22.5 GB	`ollama run gemma2:27b-instruct-q5_K_S`
27b-instruct-q6_K	Typelocal	Inputstext	Digest42dd7dda6a9b	Download22 GB	Parameters27b	QuantizationQ6_K	Context8K	Est. memory≈ 26 GB	`ollama run gemma2:27b-instruct-q6_K`
27b-instruct-q8_0	Typelocal	Inputstext	Digestdab5dca674db	Download29 GB	Parameters27b	QuantizationQ8_0	Context8K	Est. memory≈ 33.5 GB	`ollama run gemma2:27b-instruct-q8_0`
27b-text-fp16	Typelocal	Inputstext	Digestf2bf7cf9592e	Download54 GB	Parameters27b	QuantizationFP16	Context8K	Est. memory≈ 61.5 GB	`ollama run gemma2:27b-text-fp16`
27b-text-q2_K	Typelocal	Inputstext	Digestb155db00c442	Download10 GB	Parameters27b	QuantizationQ2_K	Context8K	Est. memory≈ 12.5 GB	`ollama run gemma2:27b-text-q2_K`
27b-text-q3_K_L	Typelocal	Inputstext	Digest141000b954c5	Download15 GB	Parameters27b	QuantizationQ3_K_L	Context8K	Est. memory≈ 18 GB	`ollama run gemma2:27b-text-q3_K_L`
27b-text-q3_K_M	Typelocal	Inputstext	Digesta0339d8fbaca	Download13 GB	Parameters27b	QuantizationQ3_K_M	Context8K	Est. memory≈ 16 GB	`ollama run gemma2:27b-text-q3_K_M`
27b-text-q3_K_S	Typelocal	Inputstext	Digest5005188f3c9f	Download12 GB	Parameters27b	QuantizationQ3_K_S	Context8K	Est. memory≈ 14.5 GB	`ollama run gemma2:27b-text-q3_K_S`
27b-text-q4_0	Typelocal	Inputstext	Digest7fc57426afcc	Download16 GB	Parameters27b	QuantizationQ4_0	Context8K	Est. memory≈ 19 GB	`ollama run gemma2:27b-text-q4_0`
27b-text-q4_1	Typelocal	Inputstext	Digeste478a638db41	Download17 GB	Parameters27b	QuantizationQ4_1	Context8K	Est. memory≈ 20 GB	`ollama run gemma2:27b-text-q4_1`
27b-text-q4_K_M	Typelocal	Inputstext	Digest1cab10d40d57	Download17 GB	Parameters27b	QuantizationQ4_K_M	Context8K	Est. memory≈ 20 GB	`ollama run gemma2:27b-text-q4_K_M`
27b-text-q4_K_S	Typelocal	Inputstext	Digest3943c447b4cb	Download16 GB	Parameters27b	QuantizationQ4_K_S	Context8K	Est. memory≈ 19 GB	`ollama run gemma2:27b-text-q4_K_S`
27b-text-q5_0	Typelocal	Inputstext	Digestb14cd86ea97e	Download19 GB	Parameters27b	QuantizationQ5_0	Context8K	Est. memory≈ 22.5 GB	`ollama run gemma2:27b-text-q5_0`
27b-text-q5_1	Typelocal	Inputstext	Digest43e7a8f2c64b	Download21 GB	Parameters27b	QuantizationQ5_1	Context8K	Est. memory≈ 24.5 GB	`ollama run gemma2:27b-text-q5_1`
27b-text-q5_K_M	Typelocal	Inputstext	Digestbd157e89aea0	Download19 GB	Parameters27b	QuantizationQ5_K_M	Context8K	Est. memory≈ 22.5 GB	`ollama run gemma2:27b-text-q5_K_M`
27b-text-q5_K_S	Typelocal	Inputstext	Digest3cdf7604434b	Download19 GB	Parameters27b	QuantizationQ5_K_S	Context8K	Est. memory≈ 22.5 GB	`ollama run gemma2:27b-text-q5_K_S`
27b-text-q6_K	Typelocal	Inputstext	Digestc0d8f9013cd0	Download22 GB	Parameters27b	QuantizationQ6_K	Context8K	Est. memory≈ 26 GB	`ollama run gemma2:27b-text-q6_K`
27b-text-q8_0	Typelocal	Inputstext	Digest0f062e1aad57	Download29 GB	Parameters27b	QuantizationQ8_0	Context8K	Est. memory≈ 33.5 GB	`ollama run gemma2:27b-text-q8_0`
2b	Typelocal	Inputstext	Digest8ccf136fdd52	Download1.6 GB	Parameters2b	QuantizationUnknown	Context8K	Est. memory≈ 3 GB	`ollama run gemma2:2b`
2b-instruct-fp16	Typelocal	Inputstext	Digestca5f76641a2a	Download5.2 GB	Parameters2b	QuantizationFP16	Context8K	Est. memory≈ 7 GB	`ollama run gemma2:2b-instruct-fp16`
2b-instruct-q2_K	Typelocal	Inputstext	Digest470392386d3f	Download1.2 GB	Parameters2b	QuantizationQ2_K	Context8K	Est. memory≈ 2.5 GB	`ollama run gemma2:2b-instruct-q2_K`
2b-instruct-q3_K_L	Typelocal	Inputstext	Digest3f4d7eff5631	Download1.6 GB	Parameters2b	QuantizationQ3_K_L	Context8K	Est. memory≈ 3 GB	`ollama run gemma2:2b-instruct-q3_K_L`
2b-instruct-q3_K_M	Typelocal	Inputstext	Digestc9f6dc0ebba9	Download1.5 GB	Parameters2b	QuantizationQ3_K_M	Context8K	Est. memory≈ 3 GB	`ollama run gemma2:2b-instruct-q3_K_M`
2b-instruct-q3_K_S	Typelocal	Inputstext	Digest23e3c31b0102	Download1.4 GB	Parameters2b	QuantizationQ3_K_S	Context8K	Est. memory≈ 3 GB	`ollama run gemma2:2b-instruct-q3_K_S`
2b-instruct-q4_0	Typelocal	Inputstext	Digest8ccf136fdd52	Download1.6 GB	Parameters2b	QuantizationQ4_0	Context8K	Est. memory≈ 3 GB	`ollama run gemma2:2b-instruct-q4_0`
2b-instruct-q4_1	Typelocal	Inputstext	Digest147febd40666	Download1.8 GB	Parameters2b	QuantizationQ4_1	Context8K	Est. memory≈ 3.5 GB	`ollama run gemma2:2b-instruct-q4_1`
2b-instruct-q4_K_M	Typelocal	Inputstext	Digestcb2d06dce813	Download1.7 GB	Parameters2b	QuantizationQ4_K_M	Context8K	Est. memory≈ 3 GB	`ollama run gemma2:2b-instruct-q4_K_M`
2b-instruct-q4_K_S	Typelocal	Inputstext	Digest832970b742f1	Download1.6 GB	Parameters2b	QuantizationQ4_K_S	Context8K	Est. memory≈ 3 GB	`ollama run gemma2:2b-instruct-q4_K_S`
2b-instruct-q5_0	Typelocal	Inputstext	Digest33c77c94b6d9	Download1.9 GB	Parameters2b	QuantizationQ5_0	Context8K	Est. memory≈ 3.5 GB	`ollama run gemma2:2b-instruct-q5_0`
2b-instruct-q5_1	Typelocal	Inputstext	Digest3d4744db4971	Download2.0 GB	Parameters2b	QuantizationQ5_1	Context8K	Est. memory≈ 3.5 GB	`ollama run gemma2:2b-instruct-q5_1`
2b-instruct-q5_K_M	Typelocal	Inputstext	Digest44b731fe20db	Download1.9 GB	Parameters2b	QuantizationQ5_K_M	Context8K	Est. memory≈ 3.5 GB	`ollama run gemma2:2b-instruct-q5_K_M`
2b-instruct-q5_K_S	Typelocal	Inputstext	Digest6ced300e723a	Download1.9 GB	Parameters2b	QuantizationQ5_K_S	Context8K	Est. memory≈ 3.5 GB	`ollama run gemma2:2b-instruct-q5_K_S`
2b-instruct-q6_K	Typelocal	Inputstext	Digest6c5eedbb9189	Download2.2 GB	Parameters2b	QuantizationQ6_K	Context8K	Est. memory≈ 3.5 GB	`ollama run gemma2:2b-instruct-q6_K`
2b-instruct-q8_0	Typelocal	Inputstext	Digest9d27a8c2325c	Download2.8 GB	Parameters2b	QuantizationQ8_0	Context8K	Est. memory≈ 4.5 GB	`ollama run gemma2:2b-instruct-q8_0`
2b-text-fp16	Typelocal	Inputstext	Digest230266e59979	Download5.2 GB	Parameters2b	QuantizationFP16	Context8K	Est. memory≈ 7 GB	`ollama run gemma2:2b-text-fp16`
2b-text-q2_K	Typelocal	Inputstext	Digestdc8ae2e5288f	Download1.2 GB	Parameters2b	QuantizationQ2_K	Context8K	Est. memory≈ 2.5 GB	`ollama run gemma2:2b-text-q2_K`
2b-text-q3_K_L	Typelocal	Inputstext	Digest3bb5d7d90c92	Download1.6 GB	Parameters2b	QuantizationQ3_K_L	Context8K	Est. memory≈ 3 GB	`ollama run gemma2:2b-text-q3_K_L`
2b-text-q3_K_M	Typelocal	Inputstext	Digestd1fbc3646636	Download1.5 GB	Parameters2b	QuantizationQ3_K_M	Context8K	Est. memory≈ 3 GB	`ollama run gemma2:2b-text-q3_K_M`
2b-text-q3_K_S	Typelocal	Inputstext	Digest79e51c86c582	Download1.4 GB	Parameters2b	QuantizationQ3_K_S	Context8K	Est. memory≈ 3 GB	`ollama run gemma2:2b-text-q3_K_S`
2b-text-q4_0	Typelocal	Inputstext	Digest3e796d92bb34	Download1.6 GB	Parameters2b	QuantizationQ4_0	Context8K	Est. memory≈ 3 GB	`ollama run gemma2:2b-text-q4_0`
2b-text-q4_1	Typelocal	Inputstext	Digest47a5df96d4e0	Download1.8 GB	Parameters2b	QuantizationQ4_1	Context8K	Est. memory≈ 3.5 GB	`ollama run gemma2:2b-text-q4_1`
2b-text-q4_K_M	Typelocal	Inputstext	Digestc104b2dcf9cd	Download1.7 GB	Parameters2b	QuantizationQ4_K_M	Context8K	Est. memory≈ 3 GB	`ollama run gemma2:2b-text-q4_K_M`
2b-text-q4_K_S	Typelocal	Inputstext	Digestd86f9248222e	Download1.6 GB	Parameters2b	QuantizationQ4_K_S	Context8K	Est. memory≈ 3 GB	`ollama run gemma2:2b-text-q4_K_S`
2b-text-q5_0	Typelocal	Inputstext	Digest5584a807b8ba	Download1.9 GB	Parameters2b	QuantizationQ5_0	Context8K	Est. memory≈ 3.5 GB	`ollama run gemma2:2b-text-q5_0`
2b-text-q5_1	Typelocal	Inputstext	Digest6fb41a6313fd	Download2.0 GB	Parameters2b	QuantizationQ5_1	Context8K	Est. memory≈ 3.5 GB	`ollama run gemma2:2b-text-q5_1`
2b-text-q5_K_M	Typelocal	Inputstext	Digestd298863d20ab	Download1.9 GB	Parameters2b	QuantizationQ5_K_M	Context8K	Est. memory≈ 3.5 GB	`ollama run gemma2:2b-text-q5_K_M`
2b-text-q5_K_S	Typelocal	Inputstext	Digesta3cd2a717100	Download1.9 GB	Parameters2b	QuantizationQ5_K_S	Context8K	Est. memory≈ 3.5 GB	`ollama run gemma2:2b-text-q5_K_S`
2b-text-q6_K	Typelocal	Inputstext	Digest3b637a49f20f	Download2.2 GB	Parameters2b	QuantizationQ6_K	Context8K	Est. memory≈ 3.5 GB	`ollama run gemma2:2b-text-q6_K`
2b-text-q8_0	Typelocal	Inputstext	Digest302f408c0774	Download2.8 GB	Parameters2b	QuantizationQ8_0	Context8K	Est. memory≈ 4.5 GB	`ollama run gemma2:2b-text-q8_0`
9b	Typelocal	Inputstext	Digestff02c3702f32	Download5.4 GB	Parameters9b	QuantizationUnknown	Context8K	Est. memory≈ 7.5 GB	`ollama run gemma2:9b`
9b-instruct-fp16	Typelocal	Inputstext	Digest28e6684b0850	Download18 GB	Parameters9b	QuantizationFP16	Context8K	Est. memory≈ 21.5 GB	`ollama run gemma2:9b-instruct-fp16`
9b-instruct-q2_K	Typelocal	Inputstext	Digest592e44efb2df	Download3.8 GB	Parameters9b	QuantizationQ2_K	Context8K	Est. memory≈ 5.5 GB	`ollama run gemma2:9b-instruct-q2_K`
9b-instruct-q3_K_L	Typelocal	Inputstext	Digestd714823ae8ef	Download5.1 GB	Parameters9b	QuantizationQ3_K_L	Context8K	Est. memory≈ 7 GB	`ollama run gemma2:9b-instruct-q3_K_L`
9b-instruct-q3_K_M	Typelocal	Inputstext	Digest7461deaf5540	Download4.8 GB	Parameters9b	QuantizationQ3_K_M	Context8K	Est. memory≈ 6.5 GB	`ollama run gemma2:9b-instruct-q3_K_M`
9b-instruct-q3_K_S	Typelocal	Inputstext	Digest1c8775e10b1c	Download4.3 GB	Parameters9b	QuantizationQ3_K_S	Context8K	Est. memory≈ 6 GB	`ollama run gemma2:9b-instruct-q3_K_S`
9b-instruct-q4_0	Typelocal	Inputstext	Digestff02c3702f32	Download5.4 GB	Parameters9b	QuantizationQ4_0	Context8K	Est. memory≈ 7.5 GB	`ollama run gemma2:9b-instruct-q4_0`
9b-instruct-q4_1	Typelocal	Inputstext	Digest5bfc4cf059e2	Download6.0 GB	Parameters9b	QuantizationQ4_1	Context8K	Est. memory≈ 8 GB	`ollama run gemma2:9b-instruct-q4_1`
9b-instruct-q4_K_M	Typelocal	Inputstext	Digestc20bec88025f	Download5.8 GB	Parameters9b	QuantizationQ4_K_M	Context8K	Est. memory≈ 7.5 GB	`ollama run gemma2:9b-instruct-q4_K_M`
9b-instruct-q4_K_S	Typelocal	Inputstext	Digest3d812e007d80	Download5.5 GB	Parameters9b	QuantizationQ4_K_S	Context8K	Est. memory≈ 7.5 GB	`ollama run gemma2:9b-instruct-q4_K_S`
9b-instruct-q5_0	Typelocal	Inputstext	Digestad7303695a24	Download6.5 GB	Parameters9b	QuantizationQ5_0	Context8K	Est. memory≈ 8.5 GB	`ollama run gemma2:9b-instruct-q5_0`
9b-instruct-q5_1	Typelocal	Inputstext	Digest11404375df45	Download7.0 GB	Parameters9b	QuantizationQ5_1	Context8K	Est. memory≈ 9 GB	`ollama run gemma2:9b-instruct-q5_1`
9b-instruct-q5_K_M	Typelocal	Inputstext	Digest272e1f3a41a6	Download6.6 GB	Parameters9b	QuantizationQ5_K_M	Context8K	Est. memory≈ 8.5 GB	`ollama run gemma2:9b-instruct-q5_K_M`
9b-instruct-q5_K_S	Typelocal	Inputstext	Digest6995ad07422a	Download6.5 GB	Parameters9b	QuantizationQ5_K_S	Context8K	Est. memory≈ 8.5 GB	`ollama run gemma2:9b-instruct-q5_K_S`
9b-instruct-q6_K	Typelocal	Inputstext	Digest3827bab50424	Download7.6 GB	Parameters9b	QuantizationQ6_K	Context8K	Est. memory≈ 9.5 GB	`ollama run gemma2:9b-instruct-q6_K`
9b-instruct-q8_0	Typelocal	Inputstext	Digest54faa8324fdf	Download9.8 GB	Parameters9b	QuantizationQ8_0	Context8K	Est. memory≈ 12 GB	`ollama run gemma2:9b-instruct-q8_0`
9b-text-fp16	Typelocal	Inputstext	Digest71ccbb94da28	Download18 GB	Parameters9b	QuantizationFP16	Context8K	Est. memory≈ 21.5 GB	`ollama run gemma2:9b-text-fp16`
9b-text-q2_K	Typelocal	Inputstext	Digest81108b242383	Download3.8 GB	Parameters9b	QuantizationQ2_K	Context8K	Est. memory≈ 5.5 GB	`ollama run gemma2:9b-text-q2_K`
9b-text-q3_K_L	Typelocal	Inputstext	Digest5cb6a0b99634	Download5.1 GB	Parameters9b	QuantizationQ3_K_L	Context8K	Est. memory≈ 7 GB	`ollama run gemma2:9b-text-q3_K_L`
9b-text-q3_K_M	Typelocal	Inputstext	Digeste224c0ba8c7c	Download4.8 GB	Parameters9b	QuantizationQ3_K_M	Context8K	Est. memory≈ 6.5 GB	`ollama run gemma2:9b-text-q3_K_M`
9b-text-q3_K_S	Typelocal	Inputstext	Digest021fbe1dc58b	Download4.3 GB	Parameters9b	QuantizationQ3_K_S	Context8K	Est. memory≈ 6 GB	`ollama run gemma2:9b-text-q3_K_S`
9b-text-q4_0	Typelocal	Inputstext	Digestdedd536d2868	Download5.4 GB	Parameters9b	QuantizationQ4_0	Context8K	Est. memory≈ 7.5 GB	`ollama run gemma2:9b-text-q4_0`
9b-text-q4_1	Typelocal	Inputstext	Digest39d615163f3c	Download6.0 GB	Parameters9b	QuantizationQ4_1	Context8K	Est. memory≈ 8 GB	`ollama run gemma2:9b-text-q4_1`
9b-text-q4_K_M	Typelocal	Inputstext	Digestf4da9dd04c19	Download5.8 GB	Parameters9b	QuantizationQ4_K_M	Context8K	Est. memory≈ 7.5 GB	`ollama run gemma2:9b-text-q4_K_M`
9b-text-q4_K_S	Typelocal	Inputstext	Digest89a237d62c43	Download5.5 GB	Parameters9b	QuantizationQ4_K_S	Context8K	Est. memory≈ 7.5 GB	`ollama run gemma2:9b-text-q4_K_S`
9b-text-q5_0	Typelocal	Inputstext	Digest3d1c595d93ad	Download6.5 GB	Parameters9b	QuantizationQ5_0	Context8K	Est. memory≈ 8.5 GB	`ollama run gemma2:9b-text-q5_0`
9b-text-q5_1	Typelocal	Inputstext	Digest2c8271d50a2c	Download7.0 GB	Parameters9b	QuantizationQ5_1	Context8K	Est. memory≈ 9 GB	`ollama run gemma2:9b-text-q5_1`
9b-text-q5_K_M	Typelocal	Inputstext	Digestcb5cdf64cd6a	Download6.6 GB	Parameters9b	QuantizationQ5_K_M	Context8K	Est. memory≈ 8.5 GB	`ollama run gemma2:9b-text-q5_K_M`
9b-text-q5_K_S	Typelocal	Inputstext	Digestd569833b0000	Download6.5 GB	Parameters9b	QuantizationQ5_K_S	Context8K	Est. memory≈ 8.5 GB	`ollama run gemma2:9b-text-q5_K_S`
9b-text-q6_K	Typelocal	Inputstext	Digesteecb7df81861	Download7.6 GB	Parameters9b	QuantizationQ6_K	Context8K	Est. memory≈ 9.5 GB	`ollama run gemma2:9b-text-q6_K`
9b-text-q8_0	Typelocal	Inputstext	Digeste09381422c99	Download9.8 GB	Parameters9b	QuantizationQ8_0	Context8K	Est. memory≈ 12 GB	`ollama run gemma2:9b-text-q8_0`
latestdefault	Typelocal	Inputstext	Digestff02c3702f32	Download5.4 GB	ParametersUnknown	QuantizationUnknown	Context8K	Est. memory≈ 7.5 GB	`ollama run gemma2:latest`

Related models

gemmalocal

Gemma is a family of lightweight, state-of-the-art open models built by Google DeepMind. Updated to version 1.1

bge-m3local

BGE-M3 is a new model from BAAI distinguished for its versatility in Multi-Functionality, Multi-Linguality, and Multi-Granularity.

codegemmalocal

CodeGemma is a collection of powerful, lightweight models that can perform a variety of coding tasks like fill-in-the-middle code completion, code generation, natural language understanding, mathematical reasoning, and instruction following.

dolphin-philocal

2.7B uncensored Dolphin model by Eric Hartford, based on the Phi language model by Microsoft Research.