π Model Description
No documentation available
π GGUF File List
| π Filename | π¦ Size | β‘ Download |
|---|---|---|
|
DeepSeek-R1-Distill-Qwen-1.5B-Q4_0.gguf
Recommended
LFS
Q4
|
1019.29 MB | Download |
|
DeepSeek-R1-Distill-Qwen-1.5B-Q4_K_M-split-00001-of-00006.gguf
LFS
Q4
|
188.23 MB | Download |
|
DeepSeek-R1-Distill-Qwen-1.5B-Q4_K_M-split-00002-of-00006.gguf
LFS
Q4
|
185.46 MB | Download |
|
DeepSeek-R1-Distill-Qwen-1.5B-Q4_K_M-split-00003-of-00006.gguf
LFS
Q4
|
186.2 MB | Download |
|
DeepSeek-R1-Distill-Qwen-1.5B-Q4_K_M-split-00004-of-00006.gguf
LFS
Q4
|
190.2 MB | Download |
|
DeepSeek-R1-Distill-Qwen-1.5B-Q4_K_M-split-00005-of-00006.gguf
LFS
Q4
|
186.29 MB | Download |
|
DeepSeek-R1-Distill-Qwen-1.5B-Q4_K_M-split-00006-of-00006.gguf
LFS
Q4
|
129.18 MB | Download |
|
DeepSeek-R1-Distill-Qwen-1.5B-Q4_K_M.gguf
LFS
Q4
|
1.04 GB | Download |
|
DistilGPT2-TinyStories.IQ3_M-00001-of-00005.gguf
LFS
Q3
|
10.43 MB | Download |
|
DistilGPT2-TinyStories.IQ3_M-00002-of-00005.gguf
LFS
Q3
|
8.74 MB | Download |
|
DistilGPT2-TinyStories.IQ3_M-00003-of-00005.gguf
LFS
Q3
|
4.94 MB | Download |
|
DistilGPT2-TinyStories.IQ3_M-00004-of-00005.gguf
LFS
Q3
|
15.82 MB | Download |
|
DistilGPT2-TinyStories.IQ3_M-00005-of-00005.gguf
LFS
Q3
|
30.2 MB | Download |
|
DistilGPT2-TinyStories.IQ3_M.gguf
LFS
Q3
|
70.13 MB | Download |
|
Hermes-2-Pro-Mistral-7B.Q4_K_M.gguf
LFS
Q4
|
4.07 GB | Download |
|
HuggingFaceTB_SmolLM3-3B-Q4_0.gguf
LFS
Q4
|
1.69 GB | Download |
|
Llama-3.2-1B-Instruct-Q4_0.gguf
LFS
Q4
|
737.21 MB | Download |
|
Llama-3.2-1B-Instruct-Q4_K_M.gguf
LFS
Q4
|
770.27 MB | Download |
|
Meta-Llama-3.1-8B-Instruct-Q4_K_M-take2.gguf
LFS
Q4
|
4.58 GB | Download |
|
SmolLM3-Q4_K_M.gguf
LFS
Q4
|
1.78 GB | Download |
|
deepseek-ai_DeepSeek-R1-0528-Qwen3-8B-Q4_0.gguf
LFS
Q4
|
4.46 GB | Download |
|
deepseek-ai_DeepSeek-R1-0528-Qwen3-8B-Q4_K_M.gguf
LFS
Q4
|
4.68 GB | Download |
|
fake_for_testing.gguf
|
21 B | Download |
|
fake_for_testing_mmproj.gguf
|
28 B | Download |
|
google_gemma-3-12b-it-Q4_K_M.gguf
LFS
Q4
|
6.8 GB | Download |
|
google_gemma-3-12b-it-f16.mmproj.gguf
LFS
FP16
|
814.63 MB | Download |
|
google_gemma-3-12b-it-qat-Q4_0.gguf
LFS
Q4
|
6.43 GB | Download |
|
google_gemma-3-27b-it-Q4_K_M.gguf
LFS
Q4
|
15.41 GB | Download |
|
google_gemma-3-27b-it-f32.mmproj.gguf
LFS
|
1.58 GB | Download |
|
google_gemma-3-27b-it-qat-Q4_0.gguf
LFS
Q4
|
14.55 GB | Download |
|
gpt-oss-120b-mxfp4-00001-of-00003.gguf
LFS
|
12.38 MB | Download |
|
gpt-oss-120b-mxfp4-00002-of-00003.gguf
LFS
|
29.56 GB | Download |
|
gpt-oss-120b-mxfp4-00003-of-00003.gguf
LFS
|
29.46 GB | Download |
|
gpt-oss-20b-mxfp4.gguf
LFS
|
11.28 GB | Download |
|
llava-v1.6-mistral-7b-mmproj-model-f16.gguf
LFS
FP16
|
595.51 MB | Download |
|
llava-v1.6-mistral-7b.Q4_K_M.gguf
LFS
Q4
|
4.07 GB | Download |
|
microsoft_Phi-4-mini-instruct-Q4_0.gguf
LFS
Q4
|
2.17 GB | Download |
|
microsoft_Phi-4-mini-instruct-Q4_K_M.gguf
LFS
Q4
|
2.32 GB | Download |
|
mmproj-google_gemma-3-12b-it-qat-f16.gguf
LFS
FP16
|
814.63 MB | Download |
|
mmproj-google_gemma-3-27b-it-qat-f16.gguf
LFS
FP16
|
818 MB | Download |
|
nous-hermes-2-mixtral-8x7b-dpo.Q4_K_M.gguf
LFS
Q4
|
26.49 GB | Download |
|
openhermes-2.5-mistral-7b.Q4_K_M.gguf
LFS
Q4
|
4.07 GB | Download |