π Model Description
tags:
- gguf
- llama.cpp
- unsloth
- TeichAI/gpt-5.2-high-reasoning-250x
- TeichAI/Qwen3-4B-GPT-5.2-High-Reasoning-Distill
Qwen3 4B x GPT 5.2 (High-Reasoning) - GGUF
This model was trained on 250 examples generated by GPT 5.2 (high reasoning)
Note: In this distill I fixed formatting issues found in previous gpt 5 distills. Will be going back to update the other 5.2 distills
This qwen3 model was trained 2x faster with Unsloth and Huggingface's TRL library.
An Ollama Modelfile is included for easy deployment.
π GGUF File List
| π Filename | π¦ Size | β‘ Download |
|---|---|---|
|
Qwen3-4B-GPT-5.2-High-Reasoning-Distill.bf16.gguf
LFS
FP16
|
7.5 GB | Download |
|
Qwen3-4B-GPT-5.2-High-Reasoning-Distill.iq2_m.gguf
LFS
Q2
|
1.41 GB | Download |
|
Qwen3-4B-GPT-5.2-High-Reasoning-Distill.iq2_xs.gguf
LFS
Q2
|
1.26 GB | Download |
|
Qwen3-4B-GPT-5.2-High-Reasoning-Distill.iq3_m.gguf
LFS
Q3
|
1.83 GB | Download |
|
Qwen3-4B-GPT-5.2-High-Reasoning-Distill.iq3_xs.gguf
LFS
Q3
|
1.69 GB | Download |
|
Qwen3-4B-GPT-5.2-High-Reasoning-Distill.iq4_nl.gguf
LFS
Q4
|
2.22 GB | Download |
|
Qwen3-4B-GPT-5.2-High-Reasoning-Distill.iq4_xs.gguf
LFS
Q4
|
2.11 GB | Download |
|
Qwen3-4B-GPT-5.2-High-Reasoning-Distill.q3_k_m.gguf
LFS
Q3
|
1.93 GB | Download |
|
Qwen3-4B-GPT-5.2-High-Reasoning-Distill.q3_k_s.gguf
LFS
Q3
|
1.76 GB | Download |
|
Qwen3-4B-GPT-5.2-High-Reasoning-Distill.q4_k_m.gguf
Recommended
LFS
Q4
|
2.33 GB | Download |
|
Qwen3-4B-GPT-5.2-High-Reasoning-Distill.q8_0.gguf
LFS
Q8
|
3.99 GB | Download |
|
qwen3-4b.F16.gguf
LFS
FP16
|
7.5 GB | Download |
|
qwen3-4b.Q8_0.gguf
LFS
Q8
|
3.99 GB | Download |