---

license: other license_name: tencent-hunyuan-community-license license_link: https://huggingface.co/tencent/Hunyuan-0.5B-Instruct/blob/main/LICENSE language:

• en
• zh

base_model:

• tencent/Hunyuan-0.5B-Instruct

pipeline_tag: text-generation tags:

• GGUF
• quantization
• hunyuan
• instruct
• text-generation-inference
• text-generation

library_name: gguf

---

Hunyuan-0.5B-Instruct-GGUF

This repository contains GGUF quants for tencent/Hunyuan-0.5B-Instruct.

Hunyuan-0.5B is part of Tencent's efficient LLM series, featuring Hybrid Reasoning (fast and slow thinking modes) and a native 256K context window. Even at 0.5B parameters, it inherits robust performance from larger Hunyuan models, making it ideal for edge devices and resource-constrained environments.

Usage

llama.cpp

You can run these quants using the llama.cpp CLI:

./llama-cli -m Hunyuan-0.5B-Instruct*.gguf -p "Your prompt here" -n 128

Special Features

• Thinking Mode: This model supports "slow-thinking" reasoning. To disable CoT (Chain of Thought), add /nothink before your prompt or set enablethinking=False in your chat template.
• Long Context: Natively supports 256K tokens