π Model Description
No documentation available
π GGUF File List
| π Filename | π¦ Size | β‘ Download |
|---|---|---|
|
Qwen3-4B-Instruct-2507-gguf-BF16.gguf
LFS
FP16
|
7.5 GB | Download |
|
Qwen3-4B-Instruct-2507-gguf-BF16_HXL.gguf
LFS
FP16
|
8.22 GB | Download |
|
Qwen3-4B-Instruct-2507-gguf-IQ3_M_FXL.gguf
LFS
Q3
|
1.92 GB | Download |
|
Qwen3-4B-Instruct-2507-gguf-IQ3_M_GXL.gguf
LFS
Q3
|
2.26 GB | Download |
|
Qwen3-4B-Instruct-2507-gguf-IQ3_M_HXL.gguf
LFS
Q3
|
2.98 GB | Download |
|
Qwen3-4B-Instruct-2507-gguf-IQ4_NL_GXL.gguf
LFS
Q4
|
2.65 GB | Download |
|
Qwen3-4B-Instruct-2507-gguf-IQ4_NL_HXL.gguf
LFS
Q4
|
3.37 GB | Download |
|
Qwen3-4B-Instruct-2507-gguf-IQ4_XS_FXL.gguf
LFS
Q4
|
2.2 GB | Download |
|
Qwen3-4B-Instruct-2507-gguf-IQ4_XS_GXL.gguf
LFS
Q4
|
2.54 GB | Download |
|
Qwen3-4B-Instruct-2507-gguf-IQ4_XS_HXL.gguf
LFS
Q4
|
3.27 GB | Download |
|
Qwen3-4B-Instruct-2507-gguf-Q4_K_M_GXL.gguf
Recommended
LFS
Q4
|
2.75 GB | Download |
|
Qwen3-4B-Instruct-2507-gguf-Q4_K_M_HXL.gguf
LFS
Q4
|
3.48 GB | Download |
|
Qwen3-4B-Instruct-2507-gguf-Q5_K_M_FXL.gguf
LFS
Q5
|
2.78 GB | Download |
|
Qwen3-4B-Instruct-2507-gguf-Q5_K_M_GXL.gguf
LFS
Q5
|
3.12 GB | Download |
|
Qwen3-4B-Instruct-2507-gguf-Q5_K_M_HXL.gguf
LFS
Q5
|
3.84 GB | Download |
|
Qwen3-4B-Instruct-2507-gguf-Q6_K_FXL.gguf
LFS
Q6
|
3.17 GB | Download |
|
Qwen3-4B-Instruct-2507-gguf-Q6_K_GXL.gguf
LFS
Q6
|
3.51 GB | Download |
|
Qwen3-4B-Instruct-2507-gguf-Q6_K_HXL.gguf
LFS
Q6
|
4.23 GB | Download |
|
Qwen3-4B-Instruct-2507-gguf-Q8_0_GXL.gguf
LFS
Q8
|
4.33 GB | Download |
|
Qwen3-4B-Instruct-2507-gguf-Q8_0_HXL.gguf
LFS
Q8
|
5.05 GB | Download |
|
Qwen3-4B-Instruct-2507-gguf-f32.gguf
LFS
|
14.99 GB | Download |
|
imatrix.gguf
LFS
|
3.69 MB | Download |