πŸ“‹ Model Description


base_model: deepseek-ai/DeepSeek-R1-Distill-Qwen-14B language:
  • en
license: apache-2.0 library_name: transformers tags:
  • deepseek
  • qwen
  • qwen2
  • osllmai
  • transformers

osllm.ai Models Highlights Program

We believe there's no need to pay a token if you have a GPU on your computer.

Highlighting new and noteworthy models from the community. Join the conversation on Discord.


Official WebsiteDocumentationDiscord


NEW: Subscribe to our mailing list for updates and news!

Email: [email protected]

Disclaimers

Osllm.ai is not the creator, originator, or owner of any model featured in the Community Model Program. Each Community Model is created and provided by third parties. Osllm.ai does not endorse, support, represent, or guarantee the completeness, truthfulness, accuracy, or reliability of any Community Model. You understand that Community Models can produce content that might be offensive, harmful, inaccurate, inappropriate, or deceptive. Each Community Model is the sole responsibility of the person or entity who originated it. Osllm.ai may not monitor or control the Community Models and cannot take responsibility for them. Osllm.ai disclaims all warranties or guarantees about the accuracy, reliability, or benefits of the Community Models. Furthermore, Osllm.ai disclaims any warranty that the Community Model will meet your requirements, be secure, uninterrupted, error-free, virus-free, or that any issues will be corrected. You are solely responsible for any damage resulting from your use of or access to the Community Models, downloading of any Community Model, or use of any other Community Model provided by or through Osllm.ai.

πŸ“‚ GGUF File List

πŸ“ Filename πŸ“¦ Size ⚑ Download
DeepSeek-R1-Distill-Qwen-14B-F16.gguf
LFS FP16
27.52 GB Download
DeepSeek-R1-Distill-Qwen-14B-Q2_K.gguf
LFS Q2
5.37 GB Download
DeepSeek-R1-Distill-Qwen-14B-Q2_K_L.gguf
LFS Q2
5.54 GB Download
DeepSeek-R1-Distill-Qwen-14B-Q3_K_M.gguf
LFS Q3
6.84 GB Download
DeepSeek-R1-Distill-Qwen-14B-Q4_K_M.gguf
Recommended LFS Q4
8.37 GB Download
DeepSeek-R1-Distill-Qwen-14B-Q5_K_M.gguf
LFS Q5
9.79 GB Download
DeepSeek-R1-Distill-Qwen-14B-Q6_K.gguf
LFS Q6
11.29 GB Download
DeepSeek-R1-Distill-Qwen-14B-Q8_0.gguf
LFS Q8
14.62 GB Download