π Model Description
base_model:
- zai-org/GLM-4.5-Air
GLM-4.5-Air-GGUF
This repository contains several custom GGUF quantizations of GLM-4.5-Air, to be used with llama.cpp:
| Filename | Size (GiB) | Average BPW | Direct link |
|---|---|---|---|
| GLM-4.5-Air-Q80-FFN-IQ3S-IQ3S-Q50.gguf | 57.43 | 4.47 | Download |
| GLM-4.5-Air-Q80-FFN-IQ4XS-IQ4XS-Q50.gguf | 63.86 | 4.97 | Download |
| GLM-4.5-Air-Q80-FFN-Q4K-Q4K-Q51.gguf | 67.82 | 5.27 | Download |
| GLM-4.5-Air-Q80-FFN-Q4K-Q4K-Q80.gguf | 77.71 | 6.04 | Download |
| GLM-4.5-Air-Q80-FFN-Q5K-Q5K-Q80.gguf | 85.63 | 6.66 | Download |
| GLM-4.5-Air-Q80-FFN-Q6K-Q6K-Q80.gguf | 94.04 | 7.31 | Download |
| GLM-4.5-Air-Q80.gguf | 109.39 | 8.50 | Download |
| GLM-4.5-Air-bf16.gguf | 205.81 | 16.00 | Download |
π GGUF File List
| π Filename | π¦ Size | β‘ Download |
|---|---|---|
|
GLM-4.5-Air-Q8_0-FFN-IQ3_S-IQ3_S-Q5_0.gguf
Recommended
LFS
Q3
|
57.44 GB | Download |
|
GLM-4.5-Air-Q8_0-FFN-IQ4_XS-IQ4_XS-Q5_0.gguf
LFS
Q4
|
63.87 GB | Download |
|
GLM-4.5-Air-Q8_0-FFN-Q4_K-Q4_K-Q5_1.gguf
LFS
Q4
|
67.83 GB | Download |
|
GLM-4.5-Air-Q8_0-FFN-Q4_K-Q4_K-Q8_0.gguf
LFS
Q4
|
77.72 GB | Download |
|
GLM-4.5-Air-Q8_0-FFN-Q5_K-Q5_K-Q8_0.gguf
LFS
Q5
|
85.64 GB | Download |
|
GLM-4.5-Air-Q8_0-FFN-Q6_K-Q6_K-Q8_0.gguf
LFS
Q6
|
94.05 GB | Download |
|
GLM-4.5-Air-Q8_0.gguf
LFS
Q8
|
109.39 GB | Download |
|
GLM-4.5-Air-bf16.gguf
LFS
FP16
|
205.82 GB | Download |