π Model Description
No documentation available
π GGUF File List
| π Filename | π¦ Size | β‘ Download |
|---|---|---|
|
Qwen2.5-VL-32B-Instruct-bf16-q4_k.gguf
LFS
Q4
|
20.39 GB | Download |
|
Qwen2.5-VL-32B-Instruct-bf16-q6_k.gguf
LFS
Q6
|
26.75 GB | Download |
|
Qwen2.5-VL-32B-Instruct-bf16-q8_0.gguf
LFS
Q8
|
33.79 GB | Download |
|
Qwen2.5-VL-32B-Instruct-f16-q4_k.gguf
LFS
Q4
|
20.39 GB | Download |
|
Qwen2.5-VL-32B-Instruct-f16-q6_k.gguf
LFS
Q6
|
26.75 GB | Download |
|
Qwen2.5-VL-32B-Instruct-f16-q8_0.gguf
LFS
Q8
|
33.79 GB | Download |
|
Qwen2.5-VL-32B-Instruct-iq1_m.gguf
LFS
|
8.59 GB | Download |
|
Qwen2.5-VL-32B-Instruct-iq1_s.gguf
LFS
|
8.15 GB | Download |
|
Qwen2.5-VL-32B-Instruct-iq2_s.gguf
LFS
Q2
|
11.33 GB | Download |
|
Qwen2.5-VL-32B-Instruct-iq2_xs.gguf
LFS
Q2
|
9.95 GB | Download |
|
Qwen2.5-VL-32B-Instruct-iq2_xxs.gguf
LFS
Q2
|
9.32 GB | Download |
|
Qwen2.5-VL-32B-Instruct-mmproj-bf16.gguf
LFS
FP16
|
1.28 GB | Download |
|
Qwen2.5-VL-32B-Instruct-mmproj-f16.gguf
LFS
FP16
|
1.28 GB | Download |
|
Qwen2.5-VL-32B-Instruct-q2_k_s.gguf
LFS
Q2
|
10.86 GB | Download |
|
Qwen2.5-VL-32B-Instruct-q3_k_m.gguf
LFS
Q3
|
14.93 GB | Download |
|
Qwen2.5-VL-32B-Instruct-q3_k_s.gguf
LFS
Q3
|
13.49 GB | Download |
|
Qwen2.5-VL-32B-Instruct-q4_0.gguf
Recommended
LFS
Q4
|
17.17 GB | Download |
|
Qwen2.5-VL-32B-Instruct-q4_1.gguf
LFS
Q4
|
19.08 GB | Download |
|
Qwen2.5-VL-32B-Instruct-q4_k_m.gguf
LFS
Q4
|
18.67 GB | Download |
|
Qwen2.5-VL-32B-Instruct-q4_k_s.gguf
LFS
Q4
|
17.68 GB | Download |
|
Qwen2.5-VL-32B-Instruct-q5_0.gguf
LFS
Q5
|
20.99 GB | Download |
|
Qwen2.5-VL-32B-Instruct-q5_1.gguf
LFS
Q5
|
22.89 GB | Download |
|
Qwen2.5-VL-32B-Instruct-q5_k_m.gguf
LFS
Q5
|
21.76 GB | Download |
|
Qwen2.5-VL-32B-Instruct-q5_k_s.gguf
LFS
Q5
|
21.18 GB | Download |
|
Qwen2.5-VL-32B-Instruct-q6_k_m.gguf
LFS
Q6
|
25.04 GB | Download |
|
Qwen2.5-VL-32B-Instruct-q8_0.gguf
LFS
Q8
|
32.43 GB | Download |