π Model Description
No documentation available
π GGUF File List
| π Filename | π¦ Size | β‘ Download |
|---|---|---|
|
Lumimaid-v0.2-8B-BF16.gguf
LFS
FP16
|
14.97 GB | Download |
|
Lumimaid-v0.2-8B-F16.gguf
LFS
FP16
|
14.97 GB | Download |
|
Lumimaid-v0.2-8B-IQ3_M-imat.gguf
LFS
Q3
|
3.52 GB | Download |
|
Lumimaid-v0.2-8B-IQ3_XXS-imat.gguf
LFS
Q3
|
3.05 GB | Download |
|
Lumimaid-v0.2-8B-IQ4_XS-imat.gguf
LFS
Q4
|
4.14 GB | Download |
|
Lumimaid-v0.2-8B-Q4_K_M-imat.gguf
Recommended
LFS
Q4
|
4.58 GB | Download |
|
Lumimaid-v0.2-8B-Q4_K_S-imat.gguf
LFS
Q4
|
4.37 GB | Download |
|
Lumimaid-v0.2-8B-Q5_K_M-imat.gguf
LFS
Q5
|
5.34 GB | Download |
|
Lumimaid-v0.2-8B-Q5_K_S-imat.gguf
LFS
Q5
|
5.21 GB | Download |
|
Lumimaid-v0.2-8B-Q6_K-imat.gguf
LFS
Q6
|
6.14 GB | Download |
|
Lumimaid-v0.2-8B-Q8_0-imat.gguf
LFS
Q8
|
7.95 GB | Download |