Quick start
ollama run goliathAvailable sizes
| Tag | Size | Quantization | Context | Min RAM |
|---|---|---|---|---|
| goliath:120b-q2_K | 50GB | q2_k | 4K context | 62.5 GB |
| goliath:120b-q3_K_S | 51GB | q3_k_s | 4K context | 63.8 GB |
| goliath:120b-q3_K_M | 56GB | q3_k_m | 4K context | 70 GB |
| goliath:120b-q3_K_L | 62GB | q3_k_l | 4K context | 77.5 GB |
| goliath:latest | 66GB | q4_k_m | 4K context | 82.5 GB |
| goliath:120b-q4_0 | 66GB | q4_0 | 4K | 82.5 GB |
| goliath:120b-q4_K_M | 71GB | q4_k_m | 4K context | 88.8 GB |
| goliath:120b-q4_1 | 74GB | q4_1 | 4K context | 92.5 GB |
| goliath:120b-q5_0 | 81GB | q5_0 | 4K context | 101.2 GB |
| goliath:120b-q5_K_S | 81GB | q5_k_s | 4K | 101.2 GB |
| goliath:120b-q5_K_M | 83GB | q5_k_m | 4K context | 103.8 GB |
| goliath:120b-q5_1 | 88GB | q5_1 | 4K context | 110 GB |
| goliath:120b-q6_K | 97GB | q6_k | 4K context | 121.2 GB |
| goliath:120b-q8_0 | 125GB | q8_0 | 4K context | 156.2 GB |
| goliath:120b-fp16 | 236GB | fp16 | 4K context | 295 GB |
Strengths & Limitations
Strengths
- Combines strengths of two Llama 2 70B models
- High performance language modeling
- Strong reasoning capabilities
Related models
llama3.1Language
Llama 3.1 is a new state-of-the-art model from Meta available in 8B, 70B and 405B parameter sizes.
110.5M pullsllama3.2Language
Meta's Llama 3.2 goes small with 1B and 3B models.
58.0M pullsmistralLanguage
The 7B model released by Mistral AI, updated to version 0.3.
25.6M pullsqwen2.5Language
Qwen2.5 models are pretrained on Alibaba's latest large-scale dataset, encompassing up to 18 trillion tokens. The model supports up to 128K tokens and has multilingual support.
22.0M pulls