π Model Description
No documentation available
π GGUF File List
| π Filename | π¦ Size | β‘ Download |
|---|---|---|
|
AM-Thinking-v1.Q5_K_M.gguf
LFS
Q5
|
21.66 GB | Download |
|
Athene-V2-Chat-Q4_K_L.gguf
LFS
Q4
|
45.02 GB | Download |
|
CodeLlama-70b-Instruct-hf-Q5_K_M.gguf
LFS
Q5
|
45.41 GB | Download |
|
Codestral-22B-v0.1-Q6_K.gguf
LFS
Q6
|
17 GB | Download |
|
DeepSeek-R1-Distill-Llama-70B-Q4_K_M.gguf
Recommended
LFS
Q4
|
39.6 GB | Download |
|
Dolphin3.0-Llama3.1-8B-Q5_K_M.gguf
LFS
Q5
|
5.34 GB | Download |
|
Dolphin3.0-Qwen2.5-1.5B-Q6_K_L.gguf
LFS
Q6
|
1.24 GB | Download |
|
Dolphin3.0-Qwen2.5-3b-Q6_K_L.gguf
LFS
Q6
|
2.43 GB | Download |
|
Everyone-Coder-33b-v2-Base-Q6_K.gguf
LFS
Q6
|
25.48 GB | Download |
|
Llama-3.1-Nemotron-70B-Instruct-HF-Q5_K_S.gguf
LFS
Q5
|
45.32 GB | Download |
|
Llama-3.2-1B-Instruct-Q6_K_L.gguf
LFS
Q6
|
1.01 GB | Download |
|
Llama-3.2-3B-Instruct-Q6_K_L.gguf
LFS
Q6
|
2.55 GB | Download |
|
Llama-3.3-70B-Instruct-Q5_K_S.gguf
LFS
Q5
|
45.32 GB | Download |
|
Llama-4-Scout-17B-16E-Instruct-UD-Q2_K_XL.gguf
LFS
Q2
|
39.67 GB | Download |
|
Meta-Llama-3.1-70B-Instruct.Q5_K_M.gguf
LFS
Q5
|
46.52 GB | Download |
|
Meta-Llama-3.1-8B-Instruct-Q6_K.gguf
LFS
Q6
|
6.14 GB | Download |
|
Mistral-7B-Instruct-v0.2-Neural-Story_Q6_K.gguf
LFS
Q6
|
5.53 GB | Download |
|
Qwen2.5-14B-Instruct-Q5_K_L.gguf
LFS
Q5
|
10.23 GB | Download |
|
Qwen2.5-32B-Instruct-Q4_K_M.gguf
LFS
Q4
|
18.49 GB | Download |
|
Qwen2.5-72B-Instruct-Q4_K_M.gguf
LFS
Q4
|
44.16 GB | Download |
|
Qwen2.5-7B-Instruct-Q4_K_M.gguf
LFS
Q4
|
4.36 GB | Download |
|
Qwen2.5-Coder-32B-Instruct-Q6_K_L.gguf
LFS
Q6
|
25.39 GB | Download |
|
Qwen3-Coder-30B-A3B-Instruct-UD-Q6_K_XL.gguf
LFS
Q6
|
24.53 GB | Download |
|
Qwen_QwQ-32B-Q5_K_L.gguf
LFS
Q5
|
22.11 GB | Download |
|
Qwen_Qwen3-0.6B-Q8_0.gguf
LFS
Q8
|
767.47 MB | Download |
|
Qwen_Qwen3-32B-Q5_K_L.gguf
LFS
Q5
|
22.07 GB | Download |
|
Qwen_Qwen3-8B-Q5_K_L.gguf
LFS
Q5
|
5.81 GB | Download |
|
SmolLM2-1.7B-Instruct-Q6_K_L.gguf
LFS
Q6
|
1.33 GB | Download |
|
SuperNova-Medius-Q5_K_M.gguf
LFS
Q5
|
9.79 GB | Download |
|
THUDM_GLM-4-32B-0414-Q5_K_L.gguf
LFS
Q5
|
22.05 GB | Download |
|
THUDM_GLM-Z1-32B-0414-Q5_K_L.gguf
LFS
Q5
|
22.05 GB | Download |
|
calme-2.4-rys-78b.i1-Q4_K_S.gguf
LFS
Q4
|
43.72 GB | Download |
|
codellama-70b-instruct.Q5_K_M.gguf
LFS
Q5
|
45.41 GB | Download |
|
cognitivecomputations_Dolphin3.0-R1-Mistral-24B-Q5_K_L.gguf
LFS
Q5
|
16 GB | Download |
|
deepseek-coder-33b-instruct.Q6_K.gguf
LFS
Q6
|
25.48 GB | Download |
|
deepseek-coder-7b-instruct-v1.5-Q6_K.gguf
LFS
Q6
|
5.28 GB | Download |
|
dolphin-2.2-70b.Q5_K_M.gguf
LFS
Q5
|
45.41 GB | Download |
|
dolphin-2.7-mixtral-8x7b.Q5_K_M.gguf
LFS
Q5
|
30.02 GB | Download |
|
dolphin-2.9.2-qwen2-72b.i1-Q4_K_M.gguf
LFS
Q4
|
44.16 GB | Download |
|
dolphin-2.9.3-mistral-nemo-12b.Q5_K_M.gguf
LFS
Q5
|
8.13 GB | Download |
|
dolphincoder-starcoder2-15b.Q6_K.gguf
LFS
Q6
|
12.2 GB | Download |
|
gemma-3-12b-it-Q4_K_M.gguf
LFS
Q4
|
6.8 GB | Download |
|
gemma-3-1b-it-Q4_K_M.gguf
LFS
Q4
|
768.72 MB | Download |
|
gemma-3-27b-it-Q4_K_M.gguf
LFS
Q4
|
15.41 GB | Download |
|
gemma-3-4b-it-Q4_K_M.gguf
LFS
Q4
|
2.32 GB | Download |
|
gpt-oss-20b-MXFP4.gguf
LFS
|
11.28 GB | Download |
|
mistralai_Magistral-Small-2506-Q6_K_L.gguf
LFS
Q6
|
18.32 GB | Download |
|
mistralai_Mistral-Small-3.1-24B-Instruct-2503-Q6_K_L.gguf
LFS
Q6
|
18.32 GB | Download |
|
mythomax-l2-13b.Q6_K.gguf
LFS
Q6
|
9.95 GB | Download |
|
nvidia_Llama-3_3-Nemotron-Super-49B-v1-Q6_K.gguf
LFS
Q6
|
38.11 GB | Download |
|
open-r1_OlympicCoder-32B-Q5_K_L.gguf
LFS
Q5
|
22.11 GB | Download |
|
qwen2-72b-instruct-q4_k_m.gguf
LFS
Q4
|
44.16 GB | Download |
|
qwen2-7b-instruct-q5_k_m.gguf
LFS
Q5
|
5.07 GB | Download |
|
sage-ft-mixtral-8x7b-q4_k_m.gguf
LFS
Q4
|
26.49 GB | Download |
|
samantha-1.1-westlake-7b.Q5_K_M.gguf
LFS
Q5
|
4.78 GB | Download |
|
samantha-1.11-70b.Q5_K_M.gguf
LFS
Q5
|
45.41 GB | Download |
|
shuttle-3-Q4_K_M.gguf
LFS
Q4
|
44.16 GB | Download |
|
tinydolphin-2.8-1.1b.Q6_K.gguf
LFS
Q6
|
861.57 MB | Download |