π Model Description
No documentation available
π GGUF File List
π Filename | π¦ Size | β‘ Download |
---|---|---|
Qwen1.5-1.8B-Chat-Q2_K.gguf
LFS
Q2
|
823.48 MB | Download |
Qwen1.5-1.8B-Chat-Q3_K_L.gguf
LFS
Q3
|
1007.27 MB | Download |
Qwen1.5-1.8B-Chat-Q3_K_M.gguf
LFS
Q3
|
968.82 MB | Download |
Qwen1.5-1.8B-Chat-Q3_K_S.gguf
LFS
Q3
|
925.52 MB | Download |
Qwen1.5-1.8B-Chat-Q4_0.gguf
Recommended
LFS
Q4
|
1.04 GB | Download |
Qwen1.5-1.8B-Chat-Q4_K_M.gguf
LFS
Q4
|
1.13 GB | Download |
Qwen1.5-1.8B-Chat-Q4_K_S.gguf
LFS
Q4
|
1.08 GB | Download |
Qwen1.5-1.8B-Chat-Q5_0.gguf
LFS
Q5
|
1.22 GB | Download |
Qwen1.5-1.8B-Chat-Q5_K_M.gguf
LFS
Q5
|
1.28 GB | Download |
Qwen1.5-1.8B-Chat-Q5_K_S.gguf
LFS
Q5
|
1.24 GB | Download |
Qwen1.5-1.8B-Chat-Q6_K.gguf
LFS
Q6
|
1.47 GB | Download |
Qwen1.5-1.8B-Chat-Q8_0.gguf
LFS
Q8
|
1.82 GB | Download |