πŸ“‹ Model Description


tags:
  • gguf
  • llama.cpp
  • unsloth
datasets:
  • TeichAI/deepseek-v3.2-speciale-OpenCodeReasoning-3k

Qwen3-4B-Thinking-2507-DeepSeek-v3.2-Speciale-Code-Distill-GGUF - GGUF

This model was finetuned and converted to GGUF format using Unsloth.

Example usage:

  • For text only LLMs: llama-cli --hf repoid/modelname -p "why is the sky blue?"
  • For multimodal models: llama-mtmd-cli -m modelname.gguf --mmproj mmprojfile.gguf

Available Model files:

  • qwen3-4b-thinking-2507.Q8_0.gguf
  • qwen3-4b-thinking-2507.F16.gguf

Ollama

An Ollama Modelfile is included for easy deployment.

πŸ“‚ GGUF File List

πŸ“ Filename πŸ“¦ Size ⚑ Download
qwen3-4b-thinking-2507.F16.gguf
Recommended LFS FP16
7.5 GB Download
qwen3-4b-thinking-2507.Q8_0.gguf
LFS Q8
3.99 GB Download