π Model Description
license: other license_name: modified-mit license_link: LICENSE base_model:
- MiniMaxAI/MiniMax-M2.5
- cerebras/MiniMax-M2.5-REAP-172B-A10B
This repository contains quantized GGUFs of Cerebras MiniMax-M2.5-REAP-172B-A10B, which in turn is a pruned version of MiniMax M2.5
No imatrix was used.
π GGUF File List
| π Filename | π¦ Size | β‘ Download |
|---|---|---|
|
Cerebras-MiniMax-M2.5-REAP-172B-IQ4_NL.gguf
LFS
Q4
|
91.41 GB | Download |
|
Cerebras-MiniMax-M2.5-REAP-172B-IQ4_XS.gguf
LFS
Q4
|
86.6 GB | Download |
|
Cerebras-MiniMax-M2.5-REAP-172B-Q4_K_M.gguf
Recommended
LFS
Q4
|
97.19 GB | Download |
|
Cerebras-MiniMax-M2.5-REAP-172B-Q4_K_S.gguf
LFS
Q4
|
91.39 GB | Download |
|
Cerebras-MiniMax-M2.5-REAP-172B-Q5_K_M.gguf
LFS
Q5
|
114.03 GB | Download |
|
Cerebras-MiniMax-M2.5-REAP-172B-Q5_K_S.gguf
LFS
Q5
|
110.65 GB | Download |
|
Cerebras-MiniMax-M2.5-REAP-172B-Q6_K.gguf
LFS
Q6
|
131.91 GB | Download |