πŸ“‹ Model Description

Quantization made by Richard Erkhov.

Github

Discord

Request more models

dolphin-2.9-llama3-8b-256k - GGUF

  • Model creator: https://huggingface.co/cognitivecomputations/
  • Original model: https://huggingface.co/cognitivecomputations/dolphin-2.9-llama3-8b-256k/

NameQuant methodSize
dolphin-2.9-llama3-8b-256k.Q2K.ggufQ2K2.96GB
dolphin-2.9-llama3-8b-256k.IQ3XS.ggufIQ3XS3.28GB
dolphin-2.9-llama3-8b-256k.IQ3S.ggufIQ3S3.43GB
dolphin-2.9-llama3-8b-256k.Q3KS.ggufQ3K_S3.41GB
dolphin-2.9-llama3-8b-256k.IQ3M.ggufIQ3M3.52GB
dolphin-2.9-llama3-8b-256k.Q3K.ggufQ3K3.74GB
dolphin-2.9-llama3-8b-256k.Q3KM.ggufQ3K_M3.74GB
dolphin-2.9-llama3-8b-256k.Q3KL.ggufQ3K_L4.03GB
dolphin-2.9-llama3-8b-256k.IQ4XS.ggufIQ4XS4.18GB
dolphin-2.9-llama3-8b-256k.Q40.ggufQ404.34GB
dolphin-2.9-llama3-8b-256k.IQ4NL.ggufIQ4NL4.38GB
dolphin-2.9-llama3-8b-256k.Q4KS.ggufQ4K_S4.37GB
dolphin-2.9-llama3-8b-256k.Q4K.ggufQ4K4.58GB
dolphin-2.9-llama3-8b-256k.Q4KM.ggufQ4K_M4.58GB
dolphin-2.9-llama3-8b-256k.Q41.ggufQ414.78GB
dolphin-2.9-llama3-8b-256k.Q50.ggufQ505.21GB
dolphin-2.9-llama3-8b-256k.Q5KS.ggufQ5K_S5.21GB
dolphin-2.9-llama3-8b-256k.Q5K.ggufQ5K5.34GB
dolphin-2.9-llama3-8b-256k.Q5KM.ggufQ5K_M5.34GB
dolphin-2.9-llama3-8b-256k.Q51.ggufQ515.65GB
dolphin-2.9-llama3-8b-256k.Q6K.ggufQ6K6.14GB
dolphin-2.9-llama3-8b-256k.Q80.ggufQ807.95GB

Original model description:


license: llama3

πŸ“‚ GGUF File List

πŸ“ Filename πŸ“¦ Size ⚑ Download
dolphin-2.9-llama3-8b-256k.IQ3_M.gguf
LFS Q3
3.52 GB Download
dolphin-2.9-llama3-8b-256k.IQ3_S.gguf
LFS Q3
3.43 GB Download
dolphin-2.9-llama3-8b-256k.IQ3_XS.gguf
LFS Q3
3.28 GB Download
dolphin-2.9-llama3-8b-256k.IQ4_NL.gguf
LFS Q4
4.38 GB Download
dolphin-2.9-llama3-8b-256k.IQ4_XS.gguf
LFS Q4
4.18 GB Download
dolphin-2.9-llama3-8b-256k.Q2_K.gguf
LFS Q2
2.96 GB Download
dolphin-2.9-llama3-8b-256k.Q3_K.gguf
LFS Q3
3.74 GB Download
dolphin-2.9-llama3-8b-256k.Q3_K_L.gguf
LFS Q3
4.03 GB Download
dolphin-2.9-llama3-8b-256k.Q3_K_M.gguf
LFS Q3
3.74 GB Download
dolphin-2.9-llama3-8b-256k.Q3_K_S.gguf
LFS Q3
3.41 GB Download
dolphin-2.9-llama3-8b-256k.Q4_0.gguf
Recommended LFS Q4
4.34 GB Download
dolphin-2.9-llama3-8b-256k.Q4_1.gguf
LFS Q4
4.78 GB Download
dolphin-2.9-llama3-8b-256k.Q4_K.gguf
LFS Q4
4.58 GB Download
dolphin-2.9-llama3-8b-256k.Q4_K_M.gguf
LFS Q4
4.58 GB Download
dolphin-2.9-llama3-8b-256k.Q4_K_S.gguf
LFS Q4
4.37 GB Download
dolphin-2.9-llama3-8b-256k.Q5_0.gguf
LFS Q5
5.21 GB Download
dolphin-2.9-llama3-8b-256k.Q5_1.gguf
LFS Q5
5.65 GB Download
dolphin-2.9-llama3-8b-256k.Q5_K.gguf
LFS Q5
5.34 GB Download
dolphin-2.9-llama3-8b-256k.Q5_K_M.gguf
LFS Q5
5.34 GB Download
dolphin-2.9-llama3-8b-256k.Q5_K_S.gguf
LFS Q5
5.21 GB Download
dolphin-2.9-llama3-8b-256k.Q6_K.gguf
LFS Q6
6.14 GB Download
dolphin-2.9-llama3-8b-256k.Q8_0.gguf
LFS Q8
7.95 GB Download