πŸ“‹ Model Description

No documentation available

πŸ“‚ GGUF File List

πŸ“ Filename πŸ“¦ Size ⚑ Download
Qwen2.5-VL-3B-Instruct-bf16-q4_k.gguf
LFS Q4
2.14 GB Download
Qwen2.5-VL-3B-Instruct-bf16-q6_k.gguf
LFS Q6
2.71 GB Download
Qwen2.5-VL-3B-Instruct-bf16-q8_0.gguf
LFS Q8
3.33 GB Download
Qwen2.5-VL-3B-Instruct-bf16.gguf
LFS FP16
5.75 GB Download
Qwen2.5-VL-3B-Instruct-f16-q4_k.gguf
LFS Q4
2.14 GB Download
Qwen2.5-VL-3B-Instruct-f16-q6_k.gguf
LFS Q6
2.71 GB Download
Qwen2.5-VL-3B-Instruct-f16-q8_0.gguf
LFS Q8
3.33 GB Download
Qwen2.5-VL-3B-Instruct-iq2_m.gguf
LFS Q2
1.17 GB Download
Qwen2.5-VL-3B-Instruct-iq2_s.gguf
LFS Q2
1.12 GB Download
Qwen2.5-VL-3B-Instruct-iq2_xs.gguf
LFS Q2
1022.73 MB Download
Qwen2.5-VL-3B-Instruct-iq2_xxs.gguf
LFS Q2
964.79 MB Download
Qwen2.5-VL-3B-Instruct-iq3_m.gguf
LFS Q3
1.35 GB Download
Qwen2.5-VL-3B-Instruct-iq3_s.gguf
LFS Q3
1.32 GB Download
Qwen2.5-VL-3B-Instruct-iq3_xs.gguf
LFS Q3
1.26 GB Download
Qwen2.5-VL-3B-Instruct-iq3_xxs.gguf
LFS Q3
1.19 GB Download
Qwen2.5-VL-3B-Instruct-iq4_nl.gguf
LFS Q4
1.7 GB Download
Qwen2.5-VL-3B-Instruct-iq4_xs.gguf
LFS Q4
1.62 GB Download
Qwen2.5-VL-3B-Instruct-mmproj-f16.gguf
LFS FP16
1.25 GB Download
Qwen2.5-VL-3B-Instruct-q2_k_s.gguf
LFS Q2
1.08 GB Download
Qwen2.5-VL-3B-Instruct-q3_k_m.gguf
LFS Q3
1.44 GB Download
Qwen2.5-VL-3B-Instruct-q3_k_s.gguf
LFS Q3
1.32 GB Download
Qwen2.5-VL-3B-Instruct-q4_0.gguf
Recommended LFS Q4
1.62 GB Download
Qwen2.5-VL-3B-Instruct-q4_1.gguf
LFS Q4
1.8 GB Download
Qwen2.5-VL-3B-Instruct-q4_k_m.gguf
LFS Q4
1.8 GB Download
Qwen2.5-VL-3B-Instruct-q4_k_s.gguf
LFS Q4
1.71 GB Download
Qwen2.5-VL-3B-Instruct-q5_0.gguf
LFS Q5
1.98 GB Download
Qwen2.5-VL-3B-Instruct-q5_1.gguf
LFS Q5
2.16 GB Download
Qwen2.5-VL-3B-Instruct-q5_k_m.gguf
LFS Q5
2.07 GB Download
Qwen2.5-VL-3B-Instruct-q5_k_s.gguf
LFS Q5
2.02 GB Download
Qwen2.5-VL-3B-Instruct-q6_k_m.gguf
LFS Q6
2.36 GB Download
Qwen2.5-VL-3B-Instruct-q8_0.gguf
LFS Q8
3.06 GB Download