Model Description
base_model:
- Nanbeige/Nanbeige4.1-3B
- open4bits
- llm
- gguf
- nanbeige
- en
- zh
GGUF File List
| 📁 Filename | 📦 Size | ⚡ Download |
|---|---|---|
|
nanbeige4.1-3b-IQ3_M-imat.gguf
LFS
Q3
|
1.78 GB | Download |
|
nanbeige4.1-3b-IQ3_XXS-imat.gguf
LFS
Q3
|
1.55 GB | Download |
|
nanbeige4.1-3b-IQ4_NL-imat.gguf
LFS
Q4
|
2.17 GB | Download |
|
nanbeige4.1-3b-IQ4_XS-imat.gguf
LFS
Q4
|
2.07 GB | Download |
|
nanbeige4.1-3b-Q3_K_L.gguf
LFS
Q3
|
2 GB | Download |
|
nanbeige4.1-3b-Q3_K_M.gguf
LFS
Q3
|
1.88 GB | Download |
|
nanbeige4.1-3b-Q3_K_S.gguf
LFS
Q3
|
1.73 GB | Download |
|
nanbeige4.1-3b-Q4_0.gguf
Recommended
LFS
Q4
|
2.17 GB | Download |
|
nanbeige4.1-3b-Q5_0.gguf
LFS
Q5
|
2.58 GB | Download |
|
nanbeige4.1-3b-Q5_K_M.gguf
LFS
Q5
|
2.63 GB | Download |
|
nanbeige4.1-3b-Q5_K_S.gguf
LFS
Q5
|
2.58 GB | Download |
|
nanbeige4.1-3b-Q6_K.gguf
LFS
Q6
|
3.01 GB | Download |
|
nanbeige4.1-3b-Q8_0.gguf
LFS
Q8
|
3.9 GB | Download |
|
nanbeige4.1-3b-q2_k.gguf
LFS
Q2
|
1.51 GB | Download |
|
nanbeige4.1-3b-q4_k_m.gguf
LFS
Q4
|
2.28 GB | Download |