Quick start

ollama run glm4:latest

Runnable variants

Memory is a rough file-size estimate; context length, runtime and GPU offload change it.

12 of 32 matching variants shown.32 of 32 variants shown.

Tag	Type	Inputs	Digest	Download	Parameters	Quantization	Context	Est. memory	Run
9b	Typelocal	Inputstext	Digest5b699761eca5	Download5.5 GB	Parameters9b	QuantizationUnknown	Context128K	Est. memory≈ 7.5 GB	`ollama run glm4:9b`
9b-chat-fp16	Typelocal	Inputstext	Digestad156a261bc3	Download19 GB	Parameters9b	QuantizationFP16	Context128K	Est. memory≈ 22.5 GB	`ollama run glm4:9b-chat-fp16`
9b-chat-q2_K	Typelocal	Inputstext	Digestbbe0e76cf843	Download4.0 GB	Parameters9b	QuantizationQ2_K	Context128K	Est. memory≈ 5.5 GB	`ollama run glm4:9b-chat-q2_K`
9b-chat-q3_K_L	Typelocal	Inputstext	Digestd23a4b4fe901	Download5.3 GB	Parameters9b	QuantizationQ3_K_L	Context128K	Est. memory≈ 7 GB	`ollama run glm4:9b-chat-q3_K_L`
9b-chat-q3_K_M	Typelocal	Inputstext	Digestf61310a4c544	Download5.1 GB	Parameters9b	QuantizationQ3_K_M	Context128K	Est. memory≈ 7 GB	`ollama run glm4:9b-chat-q3_K_M`
9b-chat-q3_K_S	Typelocal	Inputstext	Digest66782e7923d1	Download4.6 GB	Parameters9b	QuantizationQ3_K_S	Context128K	Est. memory≈ 6.5 GB	`ollama run glm4:9b-chat-q3_K_S`
9b-chat-q4_0	Typelocal	Inputstext	Digest5b699761eca5	Download5.5 GB	Parameters9b	QuantizationQ4_0	Context128K	Est. memory≈ 7.5 GB	`ollama run glm4:9b-chat-q4_0`
9b-chat-q4_1	Typelocal	Inputstext	Digest967152b38bf8	Download6.0 GB	Parameters9b	QuantizationQ4_1	Context128K	Est. memory≈ 8 GB	`ollama run glm4:9b-chat-q4_1`
9b-chat-q4_K_M	Typelocal	Inputstext	Digestf17dc1ac3c7c	Download6.3 GB	Parameters9b	QuantizationQ4_K_M	Context128K	Est. memory≈ 8.5 GB	`ollama run glm4:9b-chat-q4_K_M`
9b-chat-q4_K_S	Typelocal	Inputstext	Digest79891546fa17	Download5.8 GB	Parameters9b	QuantizationQ4_K_S	Context128K	Est. memory≈ 7.5 GB	`ollama run glm4:9b-chat-q4_K_S`
9b-chat-q5_0	Typelocal	Inputstext	Digest4dcb586331cf	Download6.6 GB	Parameters9b	QuantizationQ5_0	Context128K	Est. memory≈ 8.5 GB	`ollama run glm4:9b-chat-q5_0`
9b-chat-q5_1	Typelocal	Inputstext	Digest54371ffa93d0	Download7.1 GB	Parameters9b	QuantizationQ5_1	Context128K	Est. memory≈ 9 GB	`ollama run glm4:9b-chat-q5_1`
9b-chat-q5_K_M	Typelocal	Inputstext	Digest5941ffc5bb51	Download7.1 GB	Parameters9b	QuantizationQ5_K_M	Context128K	Est. memory≈ 9 GB	`ollama run glm4:9b-chat-q5_K_M`
9b-chat-q5_K_S	Typelocal	Inputstext	Digestaabc884c70dc	Download6.7 GB	Parameters9b	QuantizationQ5_K_S	Context128K	Est. memory≈ 8.5 GB	`ollama run glm4:9b-chat-q5_K_S`
9b-chat-q6_K	Typelocal	Inputstext	Digestd07e84c2d2c0	Download8.3 GB	Parameters9b	QuantizationQ6_K	Context128K	Est. memory≈ 10.5 GB	`ollama run glm4:9b-chat-q6_K`
9b-chat-q8_0	Typelocal	Inputstext	Digestbaba010b3c85	Download10 GB	Parameters9b	QuantizationQ8_0	Context128K	Est. memory≈ 12.5 GB	`ollama run glm4:9b-chat-q8_0`
9b-text-fp16	Typelocal	Inputstext	Digestb13433ce1abf	Download19 GB	Parameters9b	QuantizationFP16	Context8K	Est. memory≈ 22.5 GB	`ollama run glm4:9b-text-fp16`
9b-text-q2_K	Typelocal	Inputstext	Digestb65ac9535530	Download4.0 GB	Parameters9b	QuantizationQ2_K	Context8K	Est. memory≈ 5.5 GB	`ollama run glm4:9b-text-q2_K`
9b-text-q3_K_L	Typelocal	Inputstext	Digest2afe10412d1b	Download5.3 GB	Parameters9b	QuantizationQ3_K_L	Context8K	Est. memory≈ 7 GB	`ollama run glm4:9b-text-q3_K_L`
9b-text-q3_K_M	Typelocal	Inputstext	Digest3b09bb5cbf2f	Download5.1 GB	Parameters9b	QuantizationQ3_K_M	Context8K	Est. memory≈ 7 GB	`ollama run glm4:9b-text-q3_K_M`
9b-text-q3_K_S	Typelocal	Inputstext	Digestcbec5dd85da6	Download4.6 GB	Parameters9b	QuantizationQ3_K_S	Context8K	Est. memory≈ 6.5 GB	`ollama run glm4:9b-text-q3_K_S`
9b-text-q4_0	Typelocal	Inputstext	Digeste3c1f63d31e9	Download5.5 GB	Parameters9b	QuantizationQ4_0	Context8K	Est. memory≈ 7.5 GB	`ollama run glm4:9b-text-q4_0`
9b-text-q4_1	Typelocal	Inputstext	Digest2e39b551484c	Download6.0 GB	Parameters9b	QuantizationQ4_1	Context8K	Est. memory≈ 8 GB	`ollama run glm4:9b-text-q4_1`
9b-text-q4_K_M	Typelocal	Inputstext	Digestace9d7a1ccd5	Download6.3 GB	Parameters9b	QuantizationQ4_K_M	Context8K	Est. memory≈ 8.5 GB	`ollama run glm4:9b-text-q4_K_M`
9b-text-q4_K_S	Typelocal	Inputstext	Digestfcde2d2e22d3	Download5.8 GB	Parameters9b	QuantizationQ4_K_S	Context8K	Est. memory≈ 7.5 GB	`ollama run glm4:9b-text-q4_K_S`
9b-text-q5_0	Typelocal	Inputstext	Digest0947f646d91e	Download6.6 GB	Parameters9b	QuantizationQ5_0	Context8K	Est. memory≈ 8.5 GB	`ollama run glm4:9b-text-q5_0`
9b-text-q5_1	Typelocal	Inputstext	Digeste25548487e3b	Download7.1 GB	Parameters9b	QuantizationQ5_1	Context8K	Est. memory≈ 9 GB	`ollama run glm4:9b-text-q5_1`
9b-text-q5_K_M	Typelocal	Inputstext	Digest37732fa96c34	Download7.1 GB	Parameters9b	QuantizationQ5_K_M	Context8K	Est. memory≈ 9 GB	`ollama run glm4:9b-text-q5_K_M`
9b-text-q5_K_S	Typelocal	Inputstext	Digest4e4e04bfbfab	Download6.7 GB	Parameters9b	QuantizationQ5_K_S	Context8K	Est. memory≈ 8.5 GB	`ollama run glm4:9b-text-q5_K_S`
9b-text-q6_K	Typelocal	Inputstext	Digest0bd4f59e5f72	Download8.3 GB	Parameters9b	QuantizationQ6_K	Context8K	Est. memory≈ 10.5 GB	`ollama run glm4:9b-text-q6_K`
9b-text-q8_0	Typelocal	Inputstext	Digestf3282b3b2ab9	Download10 GB	Parameters9b	QuantizationQ8_0	Context8K	Est. memory≈ 12.5 GB	`ollama run glm4:9b-text-q8_0`
latestdefault	Typelocal	Inputstext	Digest5b699761eca5	Download5.5 GB	ParametersUnknown	QuantizationUnknown	Context128K	Est. memory≈ 7.5 GB	`ollama run glm4:latest`

Related models

codegeex4local

A versatile model for AI software development scenarios, including code completion.

minicpm-vlocal

A series of multimodal LLMs (MLLMs) designed for vision-language understanding.

falconlocal

A large language model built by the Technology Innovation Institute (TII) for use in summarization, text generation, and chat bots.

falcon2local

Falcon2 is an 11B parameters causal decoder-only model built by TII and trained over 5T tokens.