BeaverAI/GLM-Steam-106B-A12B-v1g-GGUF

Name: BeaverAI/GLM-Steam-106B-A12B-v1g-GGUF
Author: BeaverAI

High-quality GGUF model

2.2K 📥 Downloads

2 ❤️ Likes

6 📁 GGUF Files

442.13 GB 💾 Total Size

2 months ago 🔄 Last Updated

📋 Model Description

Important: Use if you want thinking. is broken. Omitting /nothink may cause to appear.

(Note to self: Ask for support in tuning Big GLM. Figure out if it should be 4.5, 4.6, or 4.7)

📁 Filename	📦 Size	⚡ Download
GLM-Steam-106B-A12B-v1g-Q2_K.gguf LFS Q2	41.88 GB	Download
GLM-Steam-106B-A12B-v1g-Q3_K_M.gguf LFS Q3	53.12 GB	Download
GLM-Steam-106B-A12B-v1g-Q4_K_M.gguf Recommended LFS Q4	67.85 GB	Download
GLM-Steam-106B-A12B-v1g-Q5_K_M.gguf LFS Q5	77.68 GB	Download
GLM-Steam-106B-A12B-v1g-Q6_K.gguf LFS Q6	92.21 GB	Download
GLM-Steam-106B-A12B-v1g-Q8_0.gguf LFS Q8	109.39 GB	Download

🆔 Model ID: BeaverAI/GLM-Steam-106B-A12B-v1g-GGUF

📅 Created: 2 months ago

🔄 Last Updated: 2 months ago

📥 Downloads: 2.2K

❤️ Likes: 2

🎯 Difficulty: Advanced

⚙️ Quantization: Q2, Q3, Q4, Q5, Q6, Q8

ggufendpoints_compatibleregion:usconversational