π Model Description
base_model:
- moonshotai/Kimi-VL-A3B-Thinking-2506
Original model: https://huggingface.co/moonshotai/Kimi-VL-A3B-Thinking-2506
Supported added in this PR: https://github.com/ggml-org/llama.cpp/pull/15458
π GGUF File List
| π Filename | π¦ Size | β‘ Download |
|---|---|---|
|
Kimi-VL-A3B-Thinking-2506-Q4_K_M.gguf
Recommended
LFS
Q4
|
9.82 GB | Download |
|
Kimi-VL-A3B-Thinking-2506-Q8_0.gguf
LFS
Q8
|
15.81 GB | Download |
|
Kimi-VL-A3B-Thinking-2506-bf16.gguf
LFS
FP16
|
29.74 GB | Download |
|
Kimi-VL-A3B-Thinking-2506-f16.gguf
LFS
FP16
|
29.74 GB | Download |
|
mmproj-Kimi-VL-A3B-Thinking-2506-Q8_0.gguf
LFS
Q8
|
589.46 MB | Download |
|
mmproj-Kimi-VL-A3B-Thinking-2506-bf16.gguf
LFS
FP16
|
864.72 MB | Download |
|
mmproj-Kimi-VL-A3B-Thinking-2506-f16.gguf
LFS
FP16
|
863.43 MB | Download |