Quick start
ollama run smallthinker:latestRunnable variants
Memory is a rough file-size estimate; context length, runtime and GPU offload change it.
5 of 5 matching variants shown.5 of 5 variants shown.
| Tag | Type | Inputs | Digest | Download | Parameters | Quantization | Context | Est. memory | Run |
|---|---|---|---|---|---|---|---|---|---|
| 3b | Typelocal | Inputstext | Digest945eb1864589 | Download3.6 GB | Parameters3b | QuantizationUnknown | Context32K | Est. memory≈ 5.5 GB | ollama run smallthinker:3b |
| 3b-preview-fp16 | Typelocal | Inputstext | Digest71cf19d4f87a | Download6.8 GB | Parameters3b | QuantizationFP16 | Context32K | Est. memory≈ 9 GB | ollama run smallthinker:3b-preview-fp16 |
| 3b-preview-q4_K_M | Typelocal | Inputstext | Digestb136f0e0ef96 | Download2.1 GB | Parameters3b | QuantizationQ4_K_M | Context32K | Est. memory≈ 3.5 GB | ollama run smallthinker:3b-preview-q4_K_M |
| 3b-preview-q8_0 | Typelocal | Inputstext | Digest945eb1864589 | Download3.6 GB | Parameters3b | QuantizationQ8_0 | Context32K | Est. memory≈ 5.5 GB | ollama run smallthinker:3b-preview-q8_0 |
| latestdefault | Typelocal | Inputstext | Digest945eb1864589 | Download3.6 GB | ParametersUnknown | QuantizationUnknown | Context32K | Est. memory≈ 5.5 GB | ollama run smallthinker:latest |
Related models
cogitolocal
Cogito v1 Preview is a family of hybrid reasoning models by Deep Cogito that outperform the best available open models of the same size, including counterparts from LLaMA, DeepSeek, and Qwen across most standard benchmarks.
orca-minilocal
A general-purpose model ranging from 3 billion parameters to 70 billion, suitable for entry-level hardware.
yilocal
Yi 1.5 is a high-performing, bilingual language model.
qwen3-vllocal
The most powerful vision-language model in the Qwen model family to date.