π Model Description
No documentation available
π GGUF File List
| π Filename | π¦ Size | β‘ Download |
|---|---|---|
|
Quant_IQ1_M_1024.gguf
LFS
|
5.96 MB | Download |
|
Quant_IQ1_M_256.gguf
LFS
|
1.49 MB | Download |
|
Quant_IQ1_S_1024.gguf
LFS
|
5.32 MB | Download |
|
Quant_IQ1_S_256.gguf
LFS
|
1.33 MB | Download |
|
Quant_IQ2_S_1024.gguf
LFS
Q2
|
8.73 MB | Download |
|
Quant_IQ2_S_256.gguf
LFS
Q2
|
2.18 MB | Download |
|
Quant_IQ2_XS_1024.gguf
LFS
Q2
|
7.88 MB | Download |
|
Quant_IQ2_XS_256.gguf
LFS
Q2
|
1.97 MB | Download |
|
Quant_IQ2_XXS_1024.gguf
LFS
Q2
|
7.03 MB | Download |
|
Quant_IQ2_XXS_256.gguf
LFS
Q2
|
1.76 MB | Download |
|
Quant_IQ3_S_1024.gguf
LFS
Q3
|
11.71 MB | Download |
|
Quant_IQ3_S_256.gguf
LFS
Q3
|
2.93 MB | Download |
|
Quant_IQ3_XXS_1024.gguf
LFS
Q3
|
10.43 MB | Download |
|
Quant_IQ3_XXS_256.gguf
LFS
Q3
|
2.61 MB | Download |
|
Quant_IQ4_NL_1024.gguf
LFS
Q4
|
15.33 MB | Download |
|
Quant_IQ4_NL_256.gguf
LFS
Q4
|
3.83 MB | Download |
|
Quant_IQ4_XS_1024.gguf
LFS
Q4
|
14.48 MB | Download |
|
Quant_IQ4_XS_256.gguf
LFS
Q4
|
3.62 MB | Download |
|
Quant_Q2_K_1024.gguf
LFS
Q2
|
8.94 MB | Download |
|
Quant_Q2_K_256.gguf
LFS
Q2
|
2.24 MB | Download |
|
Quant_Q3_K_1024.gguf
LFS
Q3
|
11.71 MB | Download |
|
Quant_Q3_K_256.gguf
LFS
Q3
|
2.93 MB | Download |
|
Quant_Q4_0_1024.gguf
Recommended
LFS
Q4
|
15.33 MB | Download |
|
Quant_Q4_0_256.gguf
LFS
Q4
|
3.83 MB | Download |
|
Quant_Q4_K_1024.gguf
LFS
Q4
|
15.33 MB | Download |
|
Quant_Q4_K_256.gguf
LFS
Q4
|
3.83 MB | Download |
|
Quant_Q5_0_1024.gguf
LFS
Q5
|
18.73 MB | Download |
|
Quant_Q5_0_256.gguf
LFS
Q5
|
4.68 MB | Download |
|
Quant_Q5_K_1024.gguf
LFS
Q5
|
18.73 MB | Download |
|
Quant_Q5_K_256.gguf
LFS
Q5
|
4.68 MB | Download |
|
Quant_Q6_K_1024.gguf
LFS
Q6
|
22.35 MB | Download |
|
Quant_Q6_K_256.gguf
LFS
Q6
|
5.59 MB | Download |
|
Quant_Q8_0_1024.gguf
LFS
Q8
|
28.95 MB | Download |
|
Quant_Q8_0_256.gguf
LFS
Q8
|
7.24 MB | Download |