π Model Description
No documentation available
π GGUF File List
| π Filename | π¦ Size | β‘ Download |
|---|---|---|
|
Qwen2-VL-72B-Instruct-Q2_K.gguf
LFS
Q2
|
27.76 GB | Download |
|
Qwen2-VL-72B-Instruct-Q3_K_L.gguf
LFS
Q3
|
36.79 GB | Download |
|
Qwen2-VL-72B-Instruct-Q3_K_M.gguf
LFS
Q3
|
35.11 GB | Download |
|
Qwen2-VL-72B-Instruct-Q3_K_S.gguf
LFS
Q3
|
32.12 GB | Download |
|
Qwen2-VL-72B-Instruct-Q4_0.gguf
Recommended
LFS
Q4
|
38.4 GB | Download |
|
Qwen2-VL-72B-Instruct-Q4_K_M.gguf
LFS
Q4
|
44.16 GB | Download |
|
Qwen2-VL-72B-Instruct-Q4_K_S.gguf
LFS
Q4
|
40.88 GB | Download |
|
Qwen2-VL-72B-Instruct-Q5_0-00001-of-00002.gguf
LFS
Q5
|
27.86 GB | Download |
|
Qwen2-VL-72B-Instruct-Q5_0-00002-of-00002.gguf
LFS
Q5
|
18.86 GB | Download |
|
Qwen2-VL-72B-Instruct-Q5_K_M-00001-of-00002.gguf
LFS
Q5
|
27.88 GB | Download |
|
Qwen2-VL-72B-Instruct-Q5_K_M-00002-of-00002.gguf
LFS
Q5
|
22.83 GB | Download |
|
Qwen2-VL-72B-Instruct-Q5_K_S-00001-of-00002.gguf
LFS
Q5
|
27.78 GB | Download |
|
Qwen2-VL-72B-Instruct-Q5_K_S-00002-of-00002.gguf
LFS
Q5
|
20.07 GB | Download |
|
Qwen2-VL-72B-Instruct-Q6_K-00001-of-00003.gguf
LFS
Q6
|
27.83 GB | Download |
|
Qwen2-VL-72B-Instruct-Q6_K-00002-of-00003.gguf
LFS
Q6
|
27.86 GB | Download |
|
Qwen2-VL-72B-Instruct-Q6_K-00003-of-00003.gguf
LFS
Q6
|
4.24 GB | Download |
|
Qwen2-VL-72B-Instruct-Q8_0-00001-of-00003.gguf
LFS
Q8
|
27.81 GB | Download |
|
Qwen2-VL-72B-Instruct-Q8_0-00002-of-00003.gguf
LFS
Q8
|
27.79 GB | Download |
|
Qwen2-VL-72B-Instruct-Q8_0-00003-of-00003.gguf
LFS
Q8
|
16.35 GB | Download |
|
Qwen2-VL-72B-Instruct-f16-00001-of-00005.gguf
LFS
FP16
|
27.89 GB | Download |
|
Qwen2-VL-72B-Instruct-f16-00002-of-00005.gguf
LFS
FP16
|
27.65 GB | Download |
|
Qwen2-VL-72B-Instruct-f16-00003-of-00005.gguf
LFS
FP16
|
27.62 GB | Download |
|
Qwen2-VL-72B-Instruct-f16-00004-of-00005.gguf
LFS
FP16
|
27.51 GB | Download |
|
Qwen2-VL-72B-Instruct-f16-00005-of-00005.gguf
LFS
FP16
|
24.76 GB | Download |
|
Qwen2-VL-72B-Instruct-vision-encoder.gguf
LFS
|
2.61 GB | Download |