π Model Description
No documentation available
π GGUF File List
| π Filename | π¦ Size | β‘ Download |
|---|---|---|
|
Llama-3.1-8B-Instruct-Q4_0.gguf
Recommended
LFS
Q4
|
4.34 GB | Download |
|
Llama-3.1-8B-Instruct-Q8_0.gguf
LFS
Q8
|
7.95 GB | Download |
|
Meta-Llama-3-8B-32q-8kv-32d-Q4_0.gguf
LFS
Q4
|
4.34 GB | Download |
|
Meta-Llama-3-8B-Instruct-TQ2_0.gguf
LFS
Q2
|
2.36 GB | Download |
|
Mistral-Nemo-Instruct-2407-Q2_K.gguf
LFS
Q2
|
4.46 GB | Download |
|
Mistral-Nemo-Instruct-2407-Q4_0.gguf
LFS
Q4
|
6.59 GB | Download |
|
Mistral-Nemo-Instruct-2407-Q8_0.gguf
LFS
Q8
|
12.13 GB | Download |
|
Mistral-Small-24B-Instruct-2501-Q4_0.gguf
LFS
Q4
|
12.52 GB | Download |
|
Mistral-Small-24B-Instruct-2501-Q8_0.gguf
LFS
Q8
|
23.33 GB | Download |
|
Phi-3-medium-128k-instruct-Q4_0.gguf
LFS
Q4
|
7.35 GB | Download |
|
Phi-3-medium-128k-instruct-Q8_0.gguf
LFS
Q8
|
13.82 GB | Download |
|
Phi-3-medium-4k-instruct-40q-10kv-1d-F16.gguf
LFS
FP16
|
1.25 GB | Download |
|
Phi-3-medium-4k-instruct-40q-10kv-1d-Q2_K.gguf
LFS
Q2
|
298.62 MB | Download |
|
Phi-3-medium-4k-instruct-40q-10kv-1d-Q4_0.gguf
LFS
Q4
|
400.06 MB | Download |
|
Phi-3-medium-4k-instruct-40q-10kv-1d-Q8_0.gguf
LFS
Q8
|
678.76 MB | Download |
|
Phi-3-medium-4k-instruct-40q-10kv-2d-F16.gguf
LFS
FP16
|
1.88 GB | Download |
|
Phi-3-medium-4k-instruct-40q-10kv-4d-Q2_K.gguf
LFS
Q2
|
652.94 MB | Download |
|
Phi-3-medium-4k-instruct-40q-10kv-4d-Q4_0.gguf
LFS
Q4
|
948.62 MB | Download |
|
Phi-3-medium-4k-instruct-40q-10kv-4d-Q8_0.gguf
LFS
Q8
|
1.67 GB | Download |
|
Phi-3-medium-4k-instruct-40q-8kv-12d-F16.gguf
LFS
FP16
|
9.05 GB | Download |
|
Phi-3-medium-4k-instruct-40q-8kv-12d-Q2_K.gguf
LFS
Q2
|
1.95 GB | Download |
|
Phi-3-medium-4k-instruct-40q-8kv-12d-Q4_0.gguf
LFS
Q4
|
2.73 GB | Download |
|
Phi-3-medium-4k-instruct-40q-8kv-12d-Q8_0.gguf
LFS
Q8
|
4.81 GB | Download |
|
Phi-3-medium-4k-instruct-40q-8kv-32d-Q8_0.gguf
LFS
Q8
|
10.26 GB | Download |
|
Phi-3-medium-4k-instruct-40q-8kv-3d-F16.gguf
LFS
FP16
|
4.44 GB | Download |
|
Phi-3-medium-4k-instruct-40q-8kv-3d-Q2_K.gguf
LFS
Q2
|
1.11 GB | Download |
|
Phi-3-medium-4k-instruct-40q-8kv-3d-Q4_0.gguf
LFS
Q4
|
1.44 GB | Download |
|
Phi-3-medium-4k-instruct-40q-8kv-3d-Q8_0.gguf
LFS
Q8
|
2.36 GB | Download |
|
Phi-3-medium-4k-instruct-40q-8kv-6d-F16.gguf
LFS
FP16
|
5.98 GB | Download |
|
Phi-3-medium-4k-instruct-40q-8kv-6d-Q2_K.gguf
LFS
Q2
|
1.39 GB | Download |
|
Phi-3-medium-4k-instruct-40q-8kv-6d-Q4_0.gguf
LFS
Q4
|
1.87 GB | Download |
|
Phi-3-medium-4k-instruct-40q-8kv-6d-Q8_0.gguf
LFS
Q8
|
3.18 GB | Download |
|
Phi-3-medium-4k-instruct-Q2_K.gguf
LFS
Q2
|
4.79 GB | Download |
|
Phi-3-medium-4k-instruct-Q4_0.gguf
LFS
Q4
|
7.35 GB | Download |
|
Phi-3-medium-4k-instruct-Q8_0.gguf
LFS
Q8
|
13.82 GB | Download |
|
Qwen2.5-0.5B-Instruct-Q4_0.gguf
LFS
Q4
|
335.84 MB | Download |
|
Qwen2.5-0.5B-Instruct-Q8_0.gguf
LFS
Q8
|
506.47 MB | Download |
|
Qwen2.5-0.5B-Q4_0.gguf
LFS
Q4
|
335.84 MB | Download |
|
Qwen2.5-0.5B-Q8_0.gguf
LFS
Q8
|
506.47 MB | Download |
|
Qwen2.5-1.5B-Instruct-Q4_0.gguf
LFS
Q4
|
891.64 MB | Download |
|
Qwen2.5-1.5B-Instruct-Q8_0.gguf
LFS
Q8
|
1.53 GB | Download |
|
Qwen2.5-1.5B-Q4_0.gguf
LFS
Q4
|
891.64 MB | Download |
|
Qwen2.5-1.5B-Q8_0.gguf
LFS
Q8
|
1.53 GB | Download |
|
Qwen2.5-14B-40q-8kv-12d-F16.gguf
LFS
FP16
|
9.06 GB | Download |
|
Qwen2.5-14B-40q-8kv-12d-Q2_K.gguf
LFS
Q2
|
1.97 GB | Download |
|
Qwen2.5-14B-40q-8kv-12d-Q4_0.gguf
LFS
Q4
|
2.74 GB | Download |
|
Qwen2.5-14B-40q-8kv-12d-Q8_0.gguf
LFS
Q8
|
4.82 GB | Download |
|
Qwen2.5-14B-40q-8kv-1d-F16.gguf
LFS
FP16
|
3.42 GB | Download |
|
Qwen2.5-14B-40q-8kv-1d-Q2_K.gguf
LFS
Q2
|
955.16 MB | Download |
|
Qwen2.5-14B-40q-8kv-1d-Q4_0.gguf
LFS
Q4
|
1.15 GB | Download |
|
Qwen2.5-14B-40q-8kv-1d-Q8_0.gguf
LFS
Q8
|
1.82 GB | Download |
|
Qwen2.5-14B-40q-8kv-3d-F16.gguf
LFS
FP16
|
4.44 GB | Download |
|
Qwen2.5-14B-40q-8kv-3d-Q2_K.gguf
LFS
Q2
|
1.12 GB | Download |
|
Qwen2.5-14B-40q-8kv-3d-Q4_0.gguf
LFS
Q4
|
1.44 GB | Download |
|
Qwen2.5-14B-40q-8kv-3d-Q8_0.gguf
LFS
Q8
|
2.36 GB | Download |
|
Qwen2.5-14B-40q-8kv-6d-F16.gguf
LFS
FP16
|
5.98 GB | Download |
|
Qwen2.5-14B-40q-8kv-6d-Q2_K.gguf
LFS
Q2
|
1.41 GB | Download |
|
Qwen2.5-14B-40q-8kv-6d-Q4_0.gguf
LFS
Q4
|
1.87 GB | Download |
|
Qwen2.5-14B-40q-8kv-6d-Q8_0.gguf
LFS
Q8
|
3.18 GB | Download |
|
Qwen2.5-14B-Instruct-Q4_0.gguf
LFS
Q4
|
7.93 GB | Download |
|
Qwen2.5-14B-Instruct-Q8_0.gguf
LFS
Q8
|
14.62 GB | Download |
|
Qwen2.5-14B-Q2_K.gguf
LFS
Q2
|
5.37 GB | Download |
|
Qwen2.5-14B-Q4_0.gguf
LFS
Q4
|
7.93 GB | Download |
|
Qwen2.5-14B-Q8_0.gguf
LFS
Q8
|
14.62 GB | Download |
|
Qwen2.5-14B-TQ2_0.gguf
LFS
Q2
|
4.18 GB | Download |
|
Qwen2.5-3B-Instruct-Q4_0.gguf
LFS
Q4
|
1.7 GB | Download |
|
Qwen2.5-3B-Instruct-Q8_0.gguf
LFS
Q8
|
3.06 GB | Download |
|
Qwen2.5-3B-Q4_0.gguf
LFS
Q4
|
1.7 GB | Download |
|
Qwen2.5-3B-Q8_0.gguf
LFS
Q8
|
3.06 GB | Download |
|
Qwen2.5-3B-TQ2_0.gguf
LFS
Q2
|
932.2 MB | Download |
|
Qwen2.5-7B-28q-4kv-28d-Q4_0.gguf
LFS
Q4
|
4.34 GB | Download |
|
Qwen2.5-7B-Instruct-Q4_0.gguf
LFS
Q4
|
4.13 GB | Download |
|
Qwen2.5-7B-Instruct-Q8_0.gguf
LFS
Q8
|
7.54 GB | Download |
|
Qwen2.5-7B-Q2_0.gguf
LFS
Q2
|
2.61 GB | Download |
|
Qwen2.5-7B-Q4_0.gguf
LFS
Q4
|
4.13 GB | Download |
|
Qwen2.5-7B-Q8_0.gguf
LFS
Q8
|
7.54 GB | Download |
|
Qwen2.5-7B-TQ2_0.gguf
LFS
Q2
|
2.28 GB | Download |