Quick start
ollama run qwen3-embedding:0.6bRunnable variants
Memory is a rough file-size estimate; context length, runtime and GPU offload change it.
12 of 12 matching variants shown.12 of 12 variants shown.
| Tag | Type | Inputs | Digest | Download | Parameters | Quantization | Context | Est. memory | Run |
|---|---|---|---|---|---|---|---|---|---|
| 0.6b | Typelocal | Inputstext | Digestac6da0dfba84 | Download639 MB | Parameters0.6b | QuantizationUnknown | Context32K | Est. memory≈ 2 GB | ollama run qwen3-embedding:0.6b |
| 0.6b-fp16 | Typelocal | Inputstext | Digest67a7592a8852 | Download1.2 GB | Parameters0.6b | QuantizationFP16 | Context32K | Est. memory≈ 2.5 GB | ollama run qwen3-embedding:0.6b-fp16 |
| 0.6b-q8_0 | Typelocal | Inputstext | Digestac6da0dfba84 | Download639 MB | Parameters0.6b | QuantizationQ8_0 | Context32K | Est. memory≈ 2 GB | ollama run qwen3-embedding:0.6b-q8_0 |
| 4b | Typelocal | Inputstext | Digestdf5bd2e3c74c | Download2.5 GB | Parameters4b | QuantizationUnknown | Context40K | Est. memory≈ 4 GB | ollama run qwen3-embedding:4b |
| 4b-fp16 | Typelocal | Inputstext | Digest3c93b6415795 | Download8.0 GB | Parameters4b | QuantizationFP16 | Context40K | Est. memory≈ 10 GB | ollama run qwen3-embedding:4b-fp16 |
| 4b-q4_K_M | Typelocal | Inputstext | Digestdf5bd2e3c74c | Download2.5 GB | Parameters4b | QuantizationQ4_K_M | Context40K | Est. memory≈ 4 GB | ollama run qwen3-embedding:4b-q4_K_M |
| 4b-q8_0 | Typelocal | Inputstext | Digest357d756ba8e5 | Download4.3 GB | Parameters4b | QuantizationQ8_0 | Context40K | Est. memory≈ 6 GB | ollama run qwen3-embedding:4b-q8_0 |
| 8b | Typelocal | Inputstext | Digest64b933495768 | Download4.7 GB | Parameters8b | QuantizationUnknown | Context40K | Est. memory≈ 6.5 GB | ollama run qwen3-embedding:8b |
| 8b-fp16 | Typelocal | Inputstext | Digestaa924958585e | Download15 GB | Parameters8b | QuantizationFP16 | Context40K | Est. memory≈ 18 GB | ollama run qwen3-embedding:8b-fp16 |
| 8b-q4_K_M | Typelocal | Inputstext | Digest64b933495768 | Download4.7 GB | Parameters8b | QuantizationQ4_K_M | Context40K | Est. memory≈ 6.5 GB | ollama run qwen3-embedding:8b-q4_K_M |
| 8b-q8_0 | Typelocal | Inputstext | Digest9704fd987c12 | Download8.0 GB | Parameters8b | QuantizationQ8_0 | Context40K | Est. memory≈ 10 GB | ollama run qwen3-embedding:8b-q8_0 |
| latest | Typelocal | Inputstext | Digest64b933495768 | Download4.7 GB | ParametersUnknown | QuantizationUnknown | Context40K | Est. memory≈ 6.5 GB | ollama run qwen3-embedding:latest |
Related models
layalocal
Laya is a 421M decision model from Convai Innovations, fine-tuned from ModernBERT-large.
mxbai-embed-largelocal
State-of-the-art large embedding model from mixedbread.ai
bge-largelocal
Embedding model from BAAI mapping texts to vectors.
paraphrase-multilinguallocal
Sentence-transformers model that can be used for tasks like clustering or semantic search.