allenai/OLMo-2-0325-32B-Instruct-GGUF

Name: allenai/OLMo-2-0325-32B-Instruct-GGUF
Author: allenai

High-quality GGUF model

12.4K 📥 Downloads

17 ❤️ Likes

7 📁 GGUF Files

123 GB 💾 Total Size

8 months ago 🔄 Last Updated

📋 Model Description

base_model:

GGUF version of https://huggingface.co/allenai/OLMo-2-0325-32B-Instruct

📁 Filename	📦 Size	⚡ Download
OLMo-2-0325-32B-Instruct-Q3_K_M.gguf LFS Q3	14.53 GB	Download
OLMo-2-0325-32B-Instruct-Q4_0.gguf Recommended LFS Q4	17.02 GB	Download
OLMo-2-0325-32B-Instruct-Q4_K_S.gguf LFS Q4	17.15 GB	Download
OLMo-2-0325-32B-Instruct-Q5_0.gguf LFS Q5	20.71 GB	Download
OLMo-2-0325-32B-Instruct-Q5_K_S.gguf LFS Q5	20.71 GB	Download
OLMo-2-0325-32B-Instruct-Q8_0.gguf LFS Q8	31.9 GB	Download
OLMo-2-0425-1B-Instruct-Q5_0.gguf LFS Q5	1003.43 MB	Download

🆔 Model ID: allenai/OLMo-2-0325-32B-Instruct-GGUF

📅 Created: 10 months ago

🔄 Last Updated: 8 months ago

📥 Downloads: 12.4K

❤️ Likes: 17

🎯 Difficulty: Advanced

⚙️ Quantization: Q3, Q4, Q5, Q8

ggufbase_model:allenai/OLMo-2-0325-32B-Instructbase_model:quantized:allenai/OLMo-2-0325-32B-Instructendpoints_compatibleregion:usconversational