πŸ“‹ Model Description


license: apache-2.0

Model Summary

This repository hosts quantized versions of the Alibaba Qwen-3 Instruct 14B model.

Format: GGUF
Converter: llama.cpp b6ce7430b7eb51f032152316880204e0a9c0470e
Quantizer: LM-Kit.NET 2025.4.13

For more detailed information on the base model, please visit the following link:

πŸ“‚ GGUF File List

πŸ“ Filename πŸ“¦ Size ⚑ Download
Qwen3-14B-F16.gguf
LFS FP16
27.51 GB Download
Qwen3-14B-Q4_K_M.gguf
Recommended LFS Q4
8.38 GB Download
Qwen3-14B-Q5_K_M.gguf
LFS Q5
9.79 GB Download
Qwen3-14B-Q6_K.gguf
LFS Q6
11.29 GB Download
Qwen3-14B-Q8_0.gguf
LFS Q8
14.62 GB Download