πŸ“‹ Model Description

No documentation available

πŸ“‚ GGUF File List

πŸ“ Filename πŸ“¦ Size ⚑ Download
DeepSeek-R1-Distill-Qwen-7B-bf16-q4_k.gguf
LFS Q4
5.69 GB Download
DeepSeek-R1-Distill-Qwen-7B-bf16-q6_k.gguf
LFS Q6
7.02 GB Download
DeepSeek-R1-Distill-Qwen-7B-bf16-q8_0.gguf
LFS Q8
8.49 GB Download
DeepSeek-R1-Distill-Qwen-7B-bf16.gguf
LFS FP16
14.19 GB Download
DeepSeek-R1-Distill-Qwen-7B-f16-q4_k.gguf
LFS Q4
5.69 GB Download
DeepSeek-R1-Distill-Qwen-7B-f16-q6_k.gguf
LFS Q6
7.02 GB Download
DeepSeek-R1-Distill-Qwen-7B-f16-q8_0.gguf
LFS Q8
8.49 GB Download
DeepSeek-R1-Distill-Qwen-7B-iq2_m.gguf
LFS Q2
2.98 GB Download
DeepSeek-R1-Distill-Qwen-7B-iq2_s.gguf
LFS Q2
2.86 GB Download
DeepSeek-R1-Distill-Qwen-7B-iq2_xs.gguf
LFS Q2
2.57 GB Download
DeepSeek-R1-Distill-Qwen-7B-iq2_xxs.gguf
LFS Q2
2.44 GB Download
DeepSeek-R1-Distill-Qwen-7B-iq3_m.gguf
LFS Q3
3.39 GB Download
DeepSeek-R1-Distill-Qwen-7B-iq3_s.gguf
LFS Q3
3.32 GB Download
DeepSeek-R1-Distill-Qwen-7B-iq3_xs.gguf
LFS Q3
3.18 GB Download
DeepSeek-R1-Distill-Qwen-7B-iq3_xxs.gguf
LFS Q3
3.03 GB Download
DeepSeek-R1-Distill-Qwen-7B-iq4_nl.gguf
LFS Q4
4.13 GB Download
DeepSeek-R1-Distill-Qwen-7B-iq4_xs.gguf
LFS Q4
3.93 GB Download
DeepSeek-R1-Distill-Qwen-7B-q2_k_s.gguf
LFS Q2
2.75 GB Download
DeepSeek-R1-Distill-Qwen-7B-q3_k_m.gguf
LFS Q3
3.61 GB Download
DeepSeek-R1-Distill-Qwen-7B-q3_k_s.gguf
LFS Q3
3.32 GB Download
DeepSeek-R1-Distill-Qwen-7B-q4_0.gguf
Recommended LFS Q4
4 GB Download
DeepSeek-R1-Distill-Qwen-7B-q4_1.gguf
LFS Q4
4.44 GB Download
DeepSeek-R1-Distill-Qwen-7B-q4_k_m.gguf
LFS Q4
4.49 GB Download
DeepSeek-R1-Distill-Qwen-7B-q4_k_s.gguf
LFS Q4
4.28 GB Download
DeepSeek-R1-Distill-Qwen-7B-q5_0.gguf
LFS Q5
4.88 GB Download
DeepSeek-R1-Distill-Qwen-7B-q5_1.gguf
LFS Q5
5.33 GB Download
DeepSeek-R1-Distill-Qwen-7B-q5_k_m.gguf
LFS Q5
5.14 GB Download
DeepSeek-R1-Distill-Qwen-7B-q5_k_s.gguf
LFS Q5
5.02 GB Download
DeepSeek-R1-Distill-Qwen-7B-q6_k_m.gguf
LFS Q6
5.82 GB Download
DeepSeek-R1-Distill-Qwen-7B-q8_0.gguf
LFS Q8
7.54 GB Download