πŸ“‹ Model Description


tags:
  • gguf
  • llama.cpp
  • unsloth
datasets:
  • TeichAI/gpt-5.2-high-reasoning-250x
base_model:
  • TeichAI/Qwen3-4B-Thinking-2507-GPT-5.2-High-Reasoning-Distill

Qwen3 4B Thinking 2507 x GPT 5.2 (High-Reasoning) - GGUF

This model was trained on 250 examples generated by GPT 5.2 (high reasoning)

Note: In this distill I fixed formatting issues found in previous gpt 5 distills. Will be going back to update the other 5.2 distills


This qwen3 model was trained 2x faster with Unsloth and Huggingface's TRL library.
An Ollama Modelfile is included for easy deployment.

πŸ“‚ GGUF File List

πŸ“ Filename πŸ“¦ Size ⚑ Download
Qwen3-4B-Thinking-2507-GPT-5.2-High-Reasoning-Distill.bf16.gguf
LFS FP16
7.5 GB Download
Qwen3-4B-Thinking-2507-GPT-5.2-High-Reasoning-Distill.iq2_m.gguf
LFS Q2
1.41 GB Download
Qwen3-4B-Thinking-2507-GPT-5.2-High-Reasoning-Distill.iq2_xs.gguf
LFS Q2
1.26 GB Download
Qwen3-4B-Thinking-2507-GPT-5.2-High-Reasoning-Distill.iq3_m.gguf
LFS Q3
1.83 GB Download
Qwen3-4B-Thinking-2507-GPT-5.2-High-Reasoning-Distill.iq3_xs.gguf
LFS Q3
1.69 GB Download
Qwen3-4B-Thinking-2507-GPT-5.2-High-Reasoning-Distill.iq4_nl.gguf
LFS Q4
2.22 GB Download
Qwen3-4B-Thinking-2507-GPT-5.2-High-Reasoning-Distill.iq4_xs.gguf
LFS Q4
2.11 GB Download
Qwen3-4B-Thinking-2507-GPT-5.2-High-Reasoning-Distill.q3_k_m.gguf
LFS Q3
1.93 GB Download
Qwen3-4B-Thinking-2507-GPT-5.2-High-Reasoning-Distill.q3_k_s.gguf
LFS Q3
1.76 GB Download
Qwen3-4B-Thinking-2507-GPT-5.2-High-Reasoning-Distill.q4_k_m.gguf
Recommended LFS Q4
2.33 GB Download
Qwen3-4B-Thinking-2507-GPT-5.2-High-Reasoning-Distill.q8_0.gguf
LFS Q8
3.99 GB Download
qwen3-4b-thinking-2507.F16.gguf
LFS FP16
7.5 GB Download
qwen3-4b-thinking-2507.Q8_0.gguf
LFS Q8
3.99 GB Download