π Model Description
No documentation available
π GGUF File List
| π Filename | π¦ Size | β‘ Download |
|---|---|---|
|
Quant_IQ1_M_512.gguf
LFS
|
84 MB | Download |
|
Quant_IQ1_S_512.gguf
LFS
|
75 MB | Download |
|
Quant_IQ2_S_512.gguf
LFS
Q2
|
123 MB | Download |
|
Quant_IQ2_XS_512.gguf
LFS
Q2
|
111 MB | Download |
|
Quant_IQ2_XXS_512.gguf
LFS
Q2
|
99 MB | Download |
|
Quant_IQ3_S_512.gguf
LFS
Q3
|
165 MB | Download |
|
Quant_IQ3_XXS_512.gguf
LFS
Q3
|
147 MB | Download |
|
Quant_IQ4_NL_512.gguf
LFS
Q4
|
216 MB | Download |
|
Quant_IQ4_XS_512.gguf
LFS
Q4
|
204 MB | Download |
|
Quant_Q2_K_512.gguf
LFS
Q2
|
126 MB | Download |
|
Quant_Q3_K_512.gguf
LFS
Q3
|
165 MB | Download |
|
Quant_Q4_0_512.gguf
Recommended
LFS
Q4
|
216 MB | Download |
|
Quant_Q4_K_512.gguf
LFS
Q4
|
216 MB | Download |
|
Quant_Q5_0_512.gguf
LFS
Q5
|
264 MB | Download |
|
Quant_Q5_K_512.gguf
LFS
Q5
|
264 MB | Download |
|
Quant_Q6_K_512.gguf
LFS
Q6
|
315 MB | Download |
|
Quant_Q8_0_512.gguf
LFS
Q8
|
408 MB | Download |