πŸ“‹ Model Description

Quantization made by Richard Erkhov.

Github

Discord

Request more models

mala-500-10b-v1-merged - GGUF

  • Model creator: https://huggingface.co/Zihao-Li/
  • Original model: https://huggingface.co/Zihao-Li/mala-500-10b-v1-merged/

NameQuant methodSize
mala-500-10b-v1-merged.Q2K.ggufQ2K3.36GB
mala-500-10b-v1-merged.IQ3XS.ggufIQ3XS3.7GB
mala-500-10b-v1-merged.IQ3S.ggufIQ3S3.84GB
mala-500-10b-v1-merged.Q3KS.ggufQ3K_S3.84GB
mala-500-10b-v1-merged.IQ3M.ggufIQ3M3.99GB
mala-500-10b-v1-merged.Q3K.ggufQ3K4.16GB
mala-500-10b-v1-merged.Q3KM.ggufQ3K_M4.16GB
mala-500-10b-v1-merged.Q3KL.ggufQ3K_L4.44GB
mala-500-10b-v1-merged.IQ4XS.ggufIQ4XS4.58GB
mala-500-10b-v1-merged.Q40.ggufQ404.77GB
mala-500-10b-v1-merged.IQ4NL.ggufIQ4NL4.79GB
mala-500-10b-v1-merged.Q4KS.ggufQ4K_S4.8GB
mala-500-10b-v1-merged.Q4K.ggufQ4K5.01GB
mala-500-10b-v1-merged.Q4KM.ggufQ4K_M5.01GB
mala-500-10b-v1-merged.Q41.ggufQ415.21GB
mala-500-10b-v1-merged.Q50.ggufQ505.65GB
mala-500-10b-v1-merged.Q5KS.ggufQ5K_S5.65GB
mala-500-10b-v1-merged.Q5K.ggufQ5K5.77GB
mala-500-10b-v1-merged.Q5KM.ggufQ5K_M5.77GB
mala-500-10b-v1-merged.Q51.ggufQ516.09GB
mala-500-10b-v1-merged.Q6K.ggufQ6K6.58GB
mala-500-10b-v1-merged.Q80.ggufQ808.52GB

Original model description:


license: llama2
datasets:
  • cis-lmu/Glot500

language:
  • multilingual

base_model: meta-llama/Llama-2-7b-hf
pipeline_tag: text-generation

The model is the LoRA adaptation merged vision of MaLA-LM/mala-500-10b-v1.

πŸ“‚ GGUF File List

πŸ“ Filename πŸ“¦ Size ⚑ Download
mala-500-10b-v1-merged.IQ3_M.gguf
LFS Q3
3.99 GB Download
mala-500-10b-v1-merged.IQ3_S.gguf
LFS Q3
3.84 GB Download
mala-500-10b-v1-merged.IQ3_XS.gguf
LFS Q3
3.7 GB Download
mala-500-10b-v1-merged.IQ4_NL.gguf
LFS Q4
4.79 GB Download
mala-500-10b-v1-merged.IQ4_XS.gguf
LFS Q4
4.58 GB Download
mala-500-10b-v1-merged.Q2_K.gguf
LFS Q2
3.36 GB Download
mala-500-10b-v1-merged.Q3_K.gguf
LFS Q3
4.16 GB Download
mala-500-10b-v1-merged.Q3_K_L.gguf
LFS Q3
4.44 GB Download
mala-500-10b-v1-merged.Q3_K_M.gguf
LFS Q3
4.16 GB Download
mala-500-10b-v1-merged.Q3_K_S.gguf
LFS Q3
3.84 GB Download
mala-500-10b-v1-merged.Q4_0.gguf
Recommended LFS Q4
4.77 GB Download
mala-500-10b-v1-merged.Q4_1.gguf
LFS Q4
5.21 GB Download
mala-500-10b-v1-merged.Q4_K.gguf
LFS Q4
5.01 GB Download
mala-500-10b-v1-merged.Q4_K_M.gguf
LFS Q4
5.01 GB Download
mala-500-10b-v1-merged.Q4_K_S.gguf
LFS Q4
4.8 GB Download
mala-500-10b-v1-merged.Q5_0.gguf
LFS Q5
5.65 GB Download
mala-500-10b-v1-merged.Q5_1.gguf
LFS Q5
6.09 GB Download
mala-500-10b-v1-merged.Q5_K.gguf
LFS Q5
5.77 GB Download
mala-500-10b-v1-merged.Q5_K_M.gguf
LFS Q5
5.77 GB Download
mala-500-10b-v1-merged.Q5_K_S.gguf
LFS Q5
5.65 GB Download
mala-500-10b-v1-merged.Q6_K.gguf
LFS Q6
6.58 GB Download
mala-500-10b-v1-merged.Q8_0.gguf
LFS Q8
8.52 GB Download