Quick start
ollama run duckdb-nsql:latestRunnable variants
Memory is a rough file-size estimate; context length, runtime and GPU offload change it.
12 of 17 matching variants shown.17 of 17 variants shown.
| Tag | Type | Inputs | Digest | Download | Parameters | Quantization | Context | Est. memory | Run |
|---|---|---|---|---|---|---|---|---|---|
| 7b | Typelocal | Inputstext | Digest3ed734989690 | Download3.8 GB | Parameters7b | QuantizationUnknown | Context16K | Est. memory≈ 5.5 GB | ollama run duckdb-nsql:7b |
| 7b-fp16 | Typelocal | Inputstext | Digest542d129a0ebd | Download13 GB | Parameters7b | QuantizationFP16 | Context16K | Est. memory≈ 16 GB | ollama run duckdb-nsql:7b-fp16 |
| 7b-q2_K | Typelocal | Inputstext | Digest1cbb7e381e0d | Download2.5 GB | Parameters7b | QuantizationQ2_K | Context16K | Est. memory≈ 4 GB | ollama run duckdb-nsql:7b-q2_K |
| 7b-q3_K_L | Typelocal | Inputstext | Digest2ad0663e4dc5 | Download3.6 GB | Parameters7b | QuantizationQ3_K_L | Context16K | Est. memory≈ 5.5 GB | ollama run duckdb-nsql:7b-q3_K_L |
| 7b-q3_K_M | Typelocal | Inputstext | Digestdf78bad24127 | Download3.3 GB | Parameters7b | QuantizationQ3_K_M | Context16K | Est. memory≈ 5 GB | ollama run duckdb-nsql:7b-q3_K_M |
| 7b-q3_K_S | Typelocal | Inputstext | Digest6e301c3680be | Download2.9 GB | Parameters7b | QuantizationQ3_K_S | Context16K | Est. memory≈ 4.5 GB | ollama run duckdb-nsql:7b-q3_K_S |
| 7b-q4_0 | Typelocal | Inputstext | Digest3ed734989690 | Download3.8 GB | Parameters7b | QuantizationQ4_0 | Context16K | Est. memory≈ 5.5 GB | ollama run duckdb-nsql:7b-q4_0 |
| 7b-q4_1 | Typelocal | Inputstext | Digestab2326ca8b79 | Download4.2 GB | Parameters7b | QuantizationQ4_1 | Context16K | Est. memory≈ 6 GB | ollama run duckdb-nsql:7b-q4_1 |
| 7b-q4_K_M | Typelocal | Inputstext | Digestd5214ab09cf5 | Download4.1 GB | Parameters7b | QuantizationQ4_K_M | Context16K | Est. memory≈ 6 GB | ollama run duckdb-nsql:7b-q4_K_M |
| 7b-q4_K_S | Typelocal | Inputstext | Digest2933e36bfa35 | Download3.9 GB | Parameters7b | QuantizationQ4_K_S | Context16K | Est. memory≈ 5.5 GB | ollama run duckdb-nsql:7b-q4_K_S |
| 7b-q5_0 | Typelocal | Inputstext | Digest3b9715ade8b6 | Download4.7 GB | Parameters7b | QuantizationQ5_0 | Context16K | Est. memory≈ 6.5 GB | ollama run duckdb-nsql:7b-q5_0 |
| 7b-q5_1 | Typelocal | Inputstext | Digest2ea8ccb73272 | Download5.1 GB | Parameters7b | QuantizationQ5_1 | Context16K | Est. memory≈ 7 GB | ollama run duckdb-nsql:7b-q5_1 |
| 7b-q5_K_M | Typelocal | Inputstext | Digest084b49941207 | Download4.8 GB | Parameters7b | QuantizationQ5_K_M | Context16K | Est. memory≈ 6.5 GB | ollama run duckdb-nsql:7b-q5_K_M |
| 7b-q5_K_S | Typelocal | Inputstext | Digest49c1d3c130d2 | Download4.7 GB | Parameters7b | QuantizationQ5_K_S | Context16K | Est. memory≈ 6.5 GB | ollama run duckdb-nsql:7b-q5_K_S |
| 7b-q6_K | Typelocal | Inputstext | Digest4ac244b368af | Download5.5 GB | Parameters7b | QuantizationQ6_K | Context16K | Est. memory≈ 7.5 GB | ollama run duckdb-nsql:7b-q6_K |
| 7b-q8_0 | Typelocal | Inputstext | Digesta63220880981 | Download7.2 GB | Parameters7b | QuantizationQ8_0 | Context16K | Est. memory≈ 9.5 GB | ollama run duckdb-nsql:7b-q8_0 |
| latestdefault | Typelocal | Inputstext | Digest3ed734989690 | Download3.8 GB | ParametersUnknown | QuantizationUnknown | Context16K | Est. memory≈ 5.5 GB | ollama run duckdb-nsql:latest |
Related models
phi4-minilocal
Phi-4-mini brings significant enhancements in multilingual support, reasoning, and mathematics, and now, the long-awaited function calling feature is finally supported.
granite3.2-visionlocal
A compact and efficient vision-language model, specifically designed for visual document understanding, enabling automated content extraction from tables, charts, infographics, plots, diagrams, and more.
mistrallocal
The 7B model released by Mistral AI, updated to version 0.3.
dolphin-mistrallocal
The uncensored Dolphin model based on Mistral that excels at coding tasks. Updated to version 2.8.