π Model Description
license: mit base_model:
- coder3101/GLM-4.6V-heretic
Some GGUFS for GLM-4.6V-heretic. In my tests its still overly censored. Only did some very limited text tests tho, no idea how well the vision part works.
Take mmproj from https://huggingface.co/koboldcpp/mmproj
π GGUF File List
| π Filename | π¦ Size | β‘ Download |
|---|---|---|
|
GLM4.6V-Heretic-BF16.gguf
Recommended
LFS
FP16
|
199.08 GB | Download |
|
GLM4.6V-Heretic-IQ3_XS.gguf
LFS
Q3
|
44.86 GB | Download |
|
GLM4.6V-Heretic-IQ4_NL.gguf
LFS
Q4
|
56.76 GB | Download |
|
GLM4.6V-Heretic-Q5_0.gguf
LFS
Q5
|
68.58 GB | Download |
|
GLM4.6V-Heretic-Q5_K_M.gguf
LFS
Q5
|
75.1 GB | Download |