π Model Description
No documentation available
π GGUF File List
| π Filename | π¦ Size | β‘ Download |
|---|---|---|
|
qwen1_5-1_8b-chat-q2_k.gguf
LFS
Q2
|
823.48 MB | Download |
|
qwen1_5-1_8b-chat-q3_k_m.gguf
LFS
Q3
|
968.82 MB | Download |
|
qwen1_5-1_8b-chat-q4_0.gguf
Recommended
LFS
Q4
|
1.04 GB | Download |
|
qwen1_5-1_8b-chat-q4_k_m.gguf
LFS
Q4
|
1.13 GB | Download |
|
qwen1_5-1_8b-chat-q5_0.gguf
LFS
Q5
|
1.22 GB | Download |
|
qwen1_5-1_8b-chat-q5_k_m.gguf
LFS
Q5
|
1.28 GB | Download |
|
qwen1_5-1_8b-chat-q6_k.gguf
LFS
Q6
|
1.47 GB | Download |
|
qwen1_5-1_8b-chat-q8_0.gguf
LFS
Q8
|
1.82 GB | Download |