Skip to main content
Ollama ExplorerBeta
local

tinyllama

The TinyLlama project is an open endeavor to train a compact 1.1B Llama model on 3 trillion tokens.

6.2M pulls36 tagsSource updated Jan 1, 20242K max context

Quick start

ollama run tinyllama:latest

Runnable variants

Memory is a rough file-size estimate; context length, runtime and GPU offload change it.

12 of 36 matching variants shown.

1.1bTypelocalInputstextDigest2644915ede35Download638 MBParameters1.1bQuantizationUnknownContext2KEst. memory≈ 2 GB
ollama run tinyllama:1.1b
1.1b-chatTypelocalInputstextDigest2644915ede35Download638 MBParameters1.1bQuantizationUnknownContext2KEst. memory≈ 2 GB
ollama run tinyllama:1.1b-chat
1.1b-chat-v0.6-fp16TypelocalInputstextDigesta40b38e0c72dDownload2.2 GBParameters1.1bQuantizationFP16Context2KEst. memory≈ 3.5 GB
ollama run tinyllama:1.1b-chat-v0.6-fp16
1.1b-chat-v0.6-q2_KTypelocalInputstextDigesta2aa7f9e13b4Download483 MBParameters1.1bQuantizationQ2_KContext2KEst. memory≈ 2 GB
ollama run tinyllama:1.1b-chat-v0.6-q2_K
1.1b-chat-v0.6-q3_K_LTypelocalInputstextDigest3dca23077eecDownload593 MBParameters1.1bQuantizationQ3_K_LContext2KEst. memory≈ 2 GB
ollama run tinyllama:1.1b-chat-v0.6-q3_K_L
1.1b-chat-v0.6-q3_K_MTypelocalInputstextDigestd36765ee7b2aDownload551 MBParameters1.1bQuantizationQ3_K_MContext2KEst. memory≈ 2 GB
ollama run tinyllama:1.1b-chat-v0.6-q3_K_M
1.1b-chat-v0.6-q3_K_STypelocalInputstextDigestf09e5b1786e1Download500 MBParameters1.1bQuantizationQ3_K_SContext2KEst. memory≈ 2 GB
ollama run tinyllama:1.1b-chat-v0.6-q3_K_S
1.1b-chat-v0.6-q4_0TypelocalInputstextDigestcb4df2e70049Download638 MBParameters1.1bQuantizationQ4_0Context2KEst. memory≈ 2 GB
ollama run tinyllama:1.1b-chat-v0.6-q4_0
1.1b-chat-v0.6-q4_1TypelocalInputstextDigestad5344d40d22Download702 MBParameters1.1bQuantizationQ4_1Context2KEst. memory≈ 2 GB
ollama run tinyllama:1.1b-chat-v0.6-q4_1
1.1b-chat-v0.6-q4_K_MTypelocalInputstextDigest078cb72856abDownload669 MBParameters1.1bQuantizationQ4_K_MContext2KEst. memory≈ 2 GB
ollama run tinyllama:1.1b-chat-v0.6-q4_K_M
1.1b-chat-v0.6-q4_K_STypelocalInputstextDigeste68e39e22c5cDownload644 MBParameters1.1bQuantizationQ4_K_SContext2KEst. memory≈ 2 GB
ollama run tinyllama:1.1b-chat-v0.6-q4_K_S
1.1b-chat-v0.6-q5_0TypelocalInputstextDigest8df5040f8c77Download767 MBParameters1.1bQuantizationQ5_0Context2KEst. memory≈ 2 GB
ollama run tinyllama:1.1b-chat-v0.6-q5_0

Related models