Quick start
ollama run bespoke-minicheck:latestRunnable variants
Memory is a rough file-size estimate; context length, runtime and GPU offload change it.
12 of 17 matching variants shown.17 of 17 variants shown.
| Tag | Type | Inputs | Digest | Download | Parameters | Quantization | Context | Est. memory | Run |
|---|---|---|---|---|---|---|---|---|---|
| 7b | Typelocal | Inputstext | Digest66607904c165 | Download4.7 GB | Parameters7b | QuantizationUnknown | Context32K | Est. memory≈ 6.5 GB | ollama run bespoke-minicheck:7b |
| 7b-fp16 | Typelocal | Inputstext | Digest3fa94947d3bb | Download15 GB | Parameters7b | QuantizationFP16 | Context32K | Est. memory≈ 18 GB | ollama run bespoke-minicheck:7b-fp16 |
| 7b-q2_K | Typelocal | Inputstext | Digest98385f12a848 | Download3.0 GB | Parameters7b | QuantizationQ2_K | Context32K | Est. memory≈ 4.5 GB | ollama run bespoke-minicheck:7b-q2_K |
| 7b-q3_K_L | Typelocal | Inputstext | Digest74690ad307cb | Download4.1 GB | Parameters7b | QuantizationQ3_K_L | Context32K | Est. memory≈ 6 GB | ollama run bespoke-minicheck:7b-q3_K_L |
| 7b-q3_K_M | Typelocal | Inputstext | Digest560cfbea53dd | Download3.8 GB | Parameters7b | QuantizationQ3_K_M | Context32K | Est. memory≈ 5.5 GB | ollama run bespoke-minicheck:7b-q3_K_M |
| 7b-q3_K_S | Typelocal | Inputstext | Digesta68a5fb19b12 | Download3.5 GB | Parameters7b | QuantizationQ3_K_S | Context32K | Est. memory≈ 5 GB | ollama run bespoke-minicheck:7b-q3_K_S |
| 7b-q4_0 | Typelocal | Inputstext | Digest7fc72b12130d | Download4.5 GB | Parameters7b | QuantizationQ4_0 | Context32K | Est. memory≈ 6.5 GB | ollama run bespoke-minicheck:7b-q4_0 |
| 7b-q4_1 | Typelocal | Inputstext | Digestc796eb693160 | Download4.9 GB | Parameters7b | QuantizationQ4_1 | Context32K | Est. memory≈ 6.5 GB | ollama run bespoke-minicheck:7b-q4_1 |
| 7b-q4_K_M | Typelocal | Inputstext | Digest66607904c165 | Download4.7 GB | Parameters7b | QuantizationQ4_K_M | Context32K | Est. memory≈ 6.5 GB | ollama run bespoke-minicheck:7b-q4_K_M |
| 7b-q4_K_S | Typelocal | Inputstext | Digestf0921a474a27 | Download4.5 GB | Parameters7b | QuantizationQ4_K_S | Context32K | Est. memory≈ 6.5 GB | ollama run bespoke-minicheck:7b-q4_K_S |
| 7b-q5_0 | Typelocal | Inputstext | Digestfb6f4f1a6545 | Download5.4 GB | Parameters7b | QuantizationQ5_0 | Context32K | Est. memory≈ 7.5 GB | ollama run bespoke-minicheck:7b-q5_0 |
| 7b-q5_1 | Typelocal | Inputstext | Digest5cb78318e18c | Download5.8 GB | Parameters7b | QuantizationQ5_1 | Context32K | Est. memory≈ 7.5 GB | ollama run bespoke-minicheck:7b-q5_1 |
| 7b-q5_K_M | Typelocal | Inputstext | Digestd14295ca6cda | Download5.5 GB | Parameters7b | QuantizationQ5_K_M | Context32K | Est. memory≈ 7.5 GB | ollama run bespoke-minicheck:7b-q5_K_M |
| 7b-q5_K_S | Typelocal | Inputstext | Digest136d527fe4a4 | Download5.4 GB | Parameters7b | QuantizationQ5_K_S | Context32K | Est. memory≈ 7.5 GB | ollama run bespoke-minicheck:7b-q5_K_S |
| 7b-q6_K | Typelocal | Inputstext | Digest938ab53c88c7 | Download6.4 GB | Parameters7b | QuantizationQ6_K | Context32K | Est. memory≈ 8.5 GB | ollama run bespoke-minicheck:7b-q6_K |
| 7b-q8_0 | Typelocal | Inputstext | Digesta7b1d189f707 | Download8.2 GB | Parameters7b | QuantizationQ8_0 | Context32K | Est. memory≈ 10.5 GB | ollama run bespoke-minicheck:7b-q8_0 |
| latestdefault | Typelocal | Inputstext | Digest66607904c165 | Download4.7 GB | ParametersUnknown | QuantizationUnknown | Context32K | Est. memory≈ 6.5 GB | ollama run bespoke-minicheck:latest |
Related models
ministral-3local
The Ministral 3 family is designed for edge deployment, capable of running on a wide range of hardware.
deepseek-llmlocal
An advanced language model crafted with 2 trillion bilingual tokens.
sqlcoderlocal
SQLCoder is a code completion model fined-tuned on StarCoder for SQL generation tasks
openchatlocal
A family of open-source models trained on a wide variety of data, surpassing ChatGPT on various benchmarks. Updated to version 3.5-0106.