π Model Description
No documentation available
π GGUF File List
| π Filename | π¦ Size | β‘ Download |
|---|---|---|
|
DeepSeek-R1-Distill-Llama-70B-Q2_K.gguf
LFS
Q2
|
24.56 GB | Download |
|
DeepSeek-R1-Distill-Llama-70B-Q3_K_L.gguf
LFS
Q3
|
34.59 GB | Download |
|
DeepSeek-R1-Distill-Llama-70B-Q3_K_M.gguf
LFS
Q3
|
31.91 GB | Download |
|
DeepSeek-R1-Distill-Llama-70B-Q3_K_S.gguf
LFS
Q3
|
28.79 GB | Download |
|
DeepSeek-R1-Distill-Llama-70B-Q4_0.gguf
Recommended
LFS
Q4
|
37.22 GB | Download |
|
DeepSeek-R1-Distill-Llama-70B-Q4_K_M.gguf
LFS
Q4
|
39.6 GB | Download |
|
DeepSeek-R1-Distill-Llama-70B-Q4_K_S.gguf
LFS
Q4
|
37.58 GB | Download |
|
DeepSeek-R1-Distill-Llama-70B-Q5_0.gguf
LFS
Q5
|
45.32 GB | Download |
|
DeepSeek-R1-Distill-Llama-70B-Q5_K_M.gguf
LFS
Q5
|
46.52 GB | Download |
|
DeepSeek-R1-Distill-Llama-70B-Q5_K_S.gguf
LFS
Q5
|
45.32 GB | Download |
|
DeepSeek-R1-Distill-Llama-70B-Q6_K-00001-of-00002.gguf
LFS
Q6
|
27.88 GB | Download |
|
DeepSeek-R1-Distill-Llama-70B-Q6_K-00002-of-00002.gguf
LFS
Q6
|
26.03 GB | Download |
|
DeepSeek-R1-Distill-Llama-70B-Q8_0-00001-of-00003.gguf
LFS
Q8
|
27.87 GB | Download |
|
DeepSeek-R1-Distill-Llama-70B-Q8_0-00002-of-00003.gguf
LFS
Q8
|
27.71 GB | Download |
|
DeepSeek-R1-Distill-Llama-70B-Q8_0-00003-of-00003.gguf
LFS
Q8
|
14.25 GB | Download |
|
DeepSeek-R1-Distill-Llama-70B-f16-00001-of-00005.gguf
LFS
FP16
|
27.9 GB | Download |
|
DeepSeek-R1-Distill-Llama-70B-f16-00002-of-00005.gguf
LFS
FP16
|
27.53 GB | Download |
|
DeepSeek-R1-Distill-Llama-70B-f16-00003-of-00005.gguf
LFS
FP16
|
27.81 GB | Download |
|
DeepSeek-R1-Distill-Llama-70B-f16-00004-of-00005.gguf
LFS
FP16
|
27.53 GB | Download |
|
DeepSeek-R1-Distill-Llama-70B-f16-00005-of-00005.gguf
LFS
FP16
|
20.65 GB | Download |