π Model Description
pipeline_tag: image-text-to-text base_model:
- huihui-ai/Huihui-Qwen3-VL-8B-Instruct-abliterated
These are quantizations of the model Huihui-Qwen3-VL-8B-Instruct-abliterated
Original model: https://huggingface.co/huihui-ai/Huihui-Qwen3-VL-8B-Instruct-abliterated
Download the latest llama.cpp to use them.
π GGUF File List
| π Filename | π¦ Size | β‘ Download |
|---|---|---|
|
Huihui-Qwen3-VL-8B-Instruct-abliterated-BF16.gguf
LFS
FP16
|
15.26 GB | Download |
|
Huihui-Qwen3-VL-8B-Instruct-abliterated-F16.gguf
LFS
FP16
|
15.26 GB | Download |
|
Huihui-Qwen3-VL-8B-Instruct-abliterated-IQ4_NL.gguf
LFS
Q4
|
4.49 GB | Download |
|
Huihui-Qwen3-VL-8B-Instruct-abliterated-IQ4_XS.gguf
LFS
Q4
|
4.28 GB | Download |
|
Huihui-Qwen3-VL-8B-Instruct-abliterated-Q4_K_M.gguf
Recommended
LFS
Q4
|
4.68 GB | Download |
|
Huihui-Qwen3-VL-8B-Instruct-abliterated-Q4_K_S.gguf
LFS
Q4
|
4.47 GB | Download |
|
Huihui-Qwen3-VL-8B-Instruct-abliterated-Q5_K_M.gguf
LFS
Q5
|
5.45 GB | Download |
|
Huihui-Qwen3-VL-8B-Instruct-abliterated-Q5_K_S.gguf
LFS
Q5
|
5.33 GB | Download |
|
Huihui-Qwen3-VL-8B-Instruct-abliterated-Q6_K.gguf
LFS
Q6
|
6.26 GB | Download |
|
Huihui-Qwen3-VL-8B-Instruct-abliterated-Q8_0.gguf
LFS
Q8
|
8.11 GB | Download |
|
mmproj-BF16.gguf
LFS
FP16
|
1.08 GB | Download |
|
mmproj-F16.gguf
LFS
FP16
|
1.08 GB | Download |
|
mmproj-F32.gguf
LFS
|
2.15 GB | Download |