πŸ“‹ Model Description


language:
  • zh
  • en
library_name: transformers license: mit pipeline_tag: image-text-to-text base_model:
  • zai-org/GLM-4.6V-Flash
tags:
  • abliterated
  • uncensored
  • GGUF

huihui-ai/Huihui-GLM-4.6V-Flash-abliterated-GGUF

This is an uncensored version of zai-org/GLM-4.6V-Flash created with abliteration (see remove-refusals-with-transformers to know more about it).

It was only the text part that was processed, not the image part.

GGUF

The latest version of llama.cpp-b7524 supports the Image-text-to-text functionality.

For the files that have already been downloaded, please redownload them. This time, the filemmproj-model-f16.gguf has been added.

huggingface-cli download huihui-ai/Huihui-GLM-4.6V-Flash-abliterated-GGUF --local-dir ./huihui-ai/Huihui-GLM-4.6V-Flash-abliterated-GGUF --token xxx

llama-mtmd-cli -m huihui-ai/Huihui-GLM-4.6V-Flash-abliterated-GGUF/ggml-model-q8_0.gguf --mmproj huihui-ai/Huihui-GLM-4.6V-Flash-abliterated-GGUF/mmproj-ggml-model-f16.gguf -c 4096 --image png/cc.jpg -p "Describe this image."

If it's just for chatting, you can use llama-cli.

llama-cli -m huihui-ai/Huihui-GLM-4.6V-Flash-abliterated-GGUF/ggml-model-q8_0.gguf -c 81920

Usage Warnings

- Risk of Sensitive or Controversial Outputs: This model’s safety filtering has been significantly reduced, potentially generating sensitive, controversial, or inappropriate content. Users should exercise caution and rigorously review generated outputs.

- Not Suitable for All Audiences: Due to limited content filtering, the model’s outputs may be inappropriate for public settings, underage users, or applications requiring high security.

- Legal and Ethical Responsibilities: Users must ensure their usage complies with local laws and ethical standards. Generated content may carry legal or ethical risks, and users are solely responsible for any consequences.

- Research and Experimental Use: It is recommended to use this model for research, testing, or controlled environments, avoiding direct use in production or public-facing commercial applications.

- Monitoring and Review Recommendations: Users are strongly advised to monitor model outputs in real-time and conduct manual reviews when necessary to prevent the dissemination of inappropriate content.

- No Default Safety Guarantees: Unlike standard models, this model has not undergone rigorous safety optimization. huihui.ai bears no responsibility for any consequences arising from its use.

Donation

##### Your donation helps us continue our further development and improvement, a cup of coffee can do it.
  • bitcoin:
bc1qqnkhuchxw0zqjh2ku3lu4hq45hc6gy84uk70ge
  • Support our work on Ko-fi (https://ko-fi.com/huihuiai)!

πŸ“‚ GGUF File List

πŸ“ Filename πŸ“¦ Size ⚑ Download
ggml-model-Q4_K_M.gguf
Recommended LFS Q4
5.74 GB Download
ggml-model-f16.gguf
LFS FP16
17.52 GB Download
ggml-model-q8_0.gguf
LFS Q8
9.31 GB Download
mmproj-model-f16.gguf
LFS FP16
1.66 GB Download