πŸ“‹ Model Description

Quantization made by Richard Erkhov.

Github

Discord

Request more models

LDCC-Instruct-Llama-2-ko-13B-v7 - GGUF

  • Model creator: https://huggingface.co/krevas/
  • Original model: https://huggingface.co/krevas/LDCC-Instruct-Llama-2-ko-13B-v7/

NameQuant methodSize
LDCC-Instruct-Llama-2-ko-13B-v7.Q2K.ggufQ2K4.52GB
LDCC-Instruct-Llama-2-ko-13B-v7.IQ3XS.ggufIQ3XS4.99GB
LDCC-Instruct-Llama-2-ko-13B-v7.IQ3S.ggufIQ3S5.27GB
LDCC-Instruct-Llama-2-ko-13B-v7.Q3KS.ggufQ3K_S5.27GB
LDCC-Instruct-Llama-2-ko-13B-v7.IQ3M.ggufIQ3M5.57GB
LDCC-Instruct-Llama-2-ko-13B-v7.Q3K.ggufQ3K5.9GB
LDCC-Instruct-Llama-2-ko-13B-v7.Q3KM.ggufQ3K_M5.9GB
LDCC-Instruct-Llama-2-ko-13B-v7.Q3KL.ggufQ3K_L6.45GB
LDCC-Instruct-Llama-2-ko-13B-v7.IQ4XS.ggufIQ4XS6.54GB
LDCC-Instruct-Llama-2-ko-13B-v7.Q40.ggufQ406.86GB
LDCC-Instruct-Llama-2-ko-13B-v7.IQ4NL.ggufIQ4NL6.9GB
LDCC-Instruct-Llama-2-ko-13B-v7.Q4KS.ggufQ4K_S6.91GB
LDCC-Instruct-Llama-2-ko-13B-v7.Q4K.ggufQ4K7.33GB
LDCC-Instruct-Llama-2-ko-13B-v7.Q4KM.ggufQ4K_M7.33GB
LDCC-Instruct-Llama-2-ko-13B-v7.Q41.ggufQ417.61GB
LDCC-Instruct-Llama-2-ko-13B-v7.Q50.ggufQ508.36GB
LDCC-Instruct-Llama-2-ko-13B-v7.Q5KS.ggufQ5K_S8.36GB
LDCC-Instruct-Llama-2-ko-13B-v7.Q5K.ggufQ5K8.6GB
LDCC-Instruct-Llama-2-ko-13B-v7.Q5KM.ggufQ5K_M8.6GB
LDCC-Instruct-Llama-2-ko-13B-v7.Q51.ggufQ519.1GB
LDCC-Instruct-Llama-2-ko-13B-v7.Q6K.ggufQ6K9.95GB
LDCC-Instruct-Llama-2-ko-13B-v7.Q80.ggufQ8012.88GB

Original model description:


license: cc-by-nc-4.0

πŸ“‚ GGUF File List

πŸ“ Filename πŸ“¦ Size ⚑ Download
LDCC-Instruct-Llama-2-ko-13B-v7.IQ3_M.gguf
LFS Q3
5.57 GB Download
LDCC-Instruct-Llama-2-ko-13B-v7.IQ3_S.gguf
LFS Q3
5.27 GB Download
LDCC-Instruct-Llama-2-ko-13B-v7.IQ3_XS.gguf
LFS Q3
4.99 GB Download
LDCC-Instruct-Llama-2-ko-13B-v7.IQ4_NL.gguf
LFS Q4
6.9 GB Download
LDCC-Instruct-Llama-2-ko-13B-v7.IQ4_XS.gguf
LFS Q4
6.54 GB Download
LDCC-Instruct-Llama-2-ko-13B-v7.Q2_K.gguf
LFS Q2
4.52 GB Download
LDCC-Instruct-Llama-2-ko-13B-v7.Q3_K.gguf
LFS Q3
5.9 GB Download
LDCC-Instruct-Llama-2-ko-13B-v7.Q3_K_L.gguf
LFS Q3
6.45 GB Download
LDCC-Instruct-Llama-2-ko-13B-v7.Q3_K_M.gguf
LFS Q3
5.9 GB Download
LDCC-Instruct-Llama-2-ko-13B-v7.Q3_K_S.gguf
LFS Q3
5.27 GB Download
LDCC-Instruct-Llama-2-ko-13B-v7.Q4_0.gguf
Recommended LFS Q4
6.86 GB Download
LDCC-Instruct-Llama-2-ko-13B-v7.Q4_1.gguf
LFS Q4
7.61 GB Download
LDCC-Instruct-Llama-2-ko-13B-v7.Q4_K.gguf
LFS Q4
7.33 GB Download
LDCC-Instruct-Llama-2-ko-13B-v7.Q4_K_M.gguf
LFS Q4
7.33 GB Download
LDCC-Instruct-Llama-2-ko-13B-v7.Q4_K_S.gguf
LFS Q4
6.91 GB Download
LDCC-Instruct-Llama-2-ko-13B-v7.Q5_0.gguf
LFS Q5
8.36 GB Download
LDCC-Instruct-Llama-2-ko-13B-v7.Q5_1.gguf
LFS Q5
9.1 GB Download
LDCC-Instruct-Llama-2-ko-13B-v7.Q5_K.gguf
LFS Q5
8.6 GB Download
LDCC-Instruct-Llama-2-ko-13B-v7.Q5_K_M.gguf
LFS Q5
8.6 GB Download
LDCC-Instruct-Llama-2-ko-13B-v7.Q5_K_S.gguf
LFS Q5
8.36 GB Download
LDCC-Instruct-Llama-2-ko-13B-v7.Q6_K.gguf
LFS Q6
9.95 GB Download
LDCC-Instruct-Llama-2-ko-13B-v7.Q8_0.gguf
LFS Q8
12.88 GB Download