πŸ“‹ Model Description


tags:
  • gguf
  • llama.cpp
  • quantization
base_model: bknyaz/Qwen3-235B-A22B-Instruct-2507-REAM

Qwen3-235B-A22B-Instruct-2507-REAM-GGUF

This repository is done generating

Status

  • Job ID: 2cd16891-dc6d-4262-b56e-f1bd5ceba5d5
  • Stage: finito
  • Updated: 2026-02-13 21:55:22
  • Remaining quants: Q6K, Q5K_L

Ollama Support

Full Ollama support is provided by merging any sharded GGUF output into a single file after quantization.
This README is temporary and will be replaced when conversion completes. Converted automatically by GGUF Forge v6.8

πŸ“‚ GGUF File List

πŸ“ Filename πŸ“¦ Size ⚑ Download
Qwen3-235B-A22B-Instruct-2507-REAM.Q2_K.gguf
LFS Q2
60.62 GB Download
Qwen3-235B-A22B-Instruct-2507-REAM.Q3_K_L.gguf
LFS Q3
86.15 GB Download
Qwen3-235B-A22B-Instruct-2507-REAM.Q3_K_M.gguf
LFS Q3
79.5 GB Download
Qwen3-235B-A22B-Instruct-2507-REAM.Q3_K_S.gguf
LFS Q3
71.71 GB Download
Qwen3-235B-A22B-Instruct-2507-REAM.Q4_0.gguf
Recommended LFS Q4
93.69 GB Download
Qwen3-235B-A22B-Instruct-2507-REAM.Q4_K_M.gguf
LFS Q4
100.38 GB Download
Qwen3-235B-A22B-Instruct-2507-REAM.Q4_K_S.gguf
LFS Q4
94.46 GB Download
Qwen3-235B-A22B-Instruct-2507-REAM.Q5_K_M.gguf
LFS Q5
117.81 GB Download
Qwen3-235B-A22B-Instruct-2507-REAM.Q5_K_S.gguf
LFS Q5
114.37 GB Download
Qwen3-235B-A22B-Instruct-2507-REAM.Q8_0.gguf
LFS Q8
176.55 GB Download