πŸ“‹ Model Description


base_model: DavidAU/Qwen3-6B-Almost-Human-XMEN-X4-X2-X1-Dare-e32 datasets:
  • DavidAU/The-works-PK-Dick
language:
  • en
library_name: transformers license: apache-2.0 mradermacher: readme_rev: 1 quantized_by: mradermacher tags:
  • programming
  • code generation
  • code
  • coding
  • coder
  • chat
  • code
  • chat
  • brainstorm
  • qwen
  • float32
  • qwen3
  • qwencoder
  • brainstorm 20x
  • all uses cases
  • Jan-V1
  • merge
  • thinking
  • reasoning
  • unsloth
  • not-for-all-audiences

About









weighted/imatrix quants of https://huggingface.co/DavidAU/Qwen3-6B-Almost-Human-XMEN-X4-X2-X1-Dare-e32

For a convenient overview and download list, visit our model page for this model.

static quants are available at https://huggingface.co/mradermacher/Qwen3-6B-Almost-Human-XMEN-X4-X2-X1-Dare-e32-GGUF

Usage

If you are unsure how to use GGUF files, refer to one of TheBloke's
READMEs
for
more details, including on how to concatenate multi-part files.

Provided Quants

(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)

LinkTypeSize/GBNotes
GGUFimatrix0.1imatrix file (for creating your own quants)
GGUFi1-IQ1_S1.7for the desperate
GGUFi1-IQ1_M1.8mostly desperate
GGUFi1-IQ2_XXS2.0
GGUFi1-IQ2_XS2.2
GGUFi1-IQ2_S2.3
GGUFi1-IQ2_M2.4
GGUFi1-Q2K_S2.4very low quality
GGUFi1-Q2K2.6IQ3XXS probably better
GGUFi1-IQ3_XXS2.7lower quality
GGUFi1-IQ3_XS2.9
GGUFi1-Q3KS3.0IQ3XS probably better
GGUFi1-IQ3S3.0beats Q3K*
GGUFi1-IQ3_M3.1
GGUFi1-Q3KM3.3IQ3S probably better
GGUFi1-Q3KL3.5IQ3M probably better
GGUFi1-IQ4_XS3.6
GGUFi1-Q4_03.8fast, low quality
GGUFi1-IQ4NL3.8prefer IQ4XS
GGUFi1-Q4K_S3.8optimal size/speed/quality
GGUFi1-Q4K_M4.0fast, recommended
GGUFi1-Q4_14.1
GGUFi1-Q5K_S4.5
GGUFi1-Q5K_M4.6
GGUFi1-Q6K5.3practically like static Q6K
Here is a handy graph by ikawrakow comparing some lower-quality quant types (lower is better):

!image.png

And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9

FAQ / Model Request

See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.

Thanks

I thank my company, nethype GmbH, for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to @nicoboss for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.

πŸ“‚ GGUF File List

πŸ“ Filename πŸ“¦ Size ⚑ Download
Qwen3-6B-Almost-Human-XMEN-X4-X2-X1-Dare-e32.i1-IQ1_M.gguf
LFS
1.59 GB Download
Qwen3-6B-Almost-Human-XMEN-X4-X2-X1-Dare-e32.i1-IQ1_S.gguf
LFS
1.48 GB Download
Qwen3-6B-Almost-Human-XMEN-X4-X2-X1-Dare-e32.i1-IQ2_M.gguf
LFS Q2
2.17 GB Download
Qwen3-6B-Almost-Human-XMEN-X4-X2-X1-Dare-e32.i1-IQ2_S.gguf
LFS Q2
2.04 GB Download
Qwen3-6B-Almost-Human-XMEN-X4-X2-X1-Dare-e32.i1-IQ2_XS.gguf
LFS Q2
1.91 GB Download
Qwen3-6B-Almost-Human-XMEN-X4-X2-X1-Dare-e32.i1-IQ2_XXS.gguf
LFS Q2
1.76 GB Download
Qwen3-6B-Almost-Human-XMEN-X4-X2-X1-Dare-e32.i1-IQ3_M.gguf
LFS Q3
2.79 GB Download
Qwen3-6B-Almost-Human-XMEN-X4-X2-X1-Dare-e32.i1-IQ3_S.gguf
LFS Q3
2.7 GB Download
Qwen3-6B-Almost-Human-XMEN-X4-X2-X1-Dare-e32.i1-IQ3_XS.gguf
LFS Q3
2.58 GB Download
Qwen3-6B-Almost-Human-XMEN-X4-X2-X1-Dare-e32.i1-IQ3_XXS.gguf
LFS Q3
2.4 GB Download
Qwen3-6B-Almost-Human-XMEN-X4-X2-X1-Dare-e32.i1-IQ4_NL.gguf
LFS Q4
3.43 GB Download
Qwen3-6B-Almost-Human-XMEN-X4-X2-X1-Dare-e32.i1-IQ4_XS.gguf
LFS Q4
3.26 GB Download
Qwen3-6B-Almost-Human-XMEN-X4-X2-X1-Dare-e32.i1-Q2_K.gguf
LFS Q2
2.33 GB Download
Qwen3-6B-Almost-Human-XMEN-X4-X2-X1-Dare-e32.i1-Q2_K_S.gguf
LFS Q2
2.18 GB Download
Qwen3-6B-Almost-Human-XMEN-X4-X2-X1-Dare-e32.i1-Q3_K_L.gguf
LFS Q3
3.18 GB Download
Qwen3-6B-Almost-Human-XMEN-X4-X2-X1-Dare-e32.i1-Q3_K_M.gguf
LFS Q3
2.95 GB Download
Qwen3-6B-Almost-Human-XMEN-X4-X2-X1-Dare-e32.i1-Q3_K_S.gguf
LFS Q3
2.68 GB Download
Qwen3-6B-Almost-Human-XMEN-X4-X2-X1-Dare-e32.i1-Q4_0.gguf
Recommended LFS Q4
3.42 GB Download
Qwen3-6B-Almost-Human-XMEN-X4-X2-X1-Dare-e32.i1-Q4_1.gguf
LFS Q4
3.76 GB Download
Qwen3-6B-Almost-Human-XMEN-X4-X2-X1-Dare-e32.i1-Q4_K_M.gguf
LFS Q4
3.59 GB Download
Qwen3-6B-Almost-Human-XMEN-X4-X2-X1-Dare-e32.i1-Q4_K_S.gguf
LFS Q4
3.43 GB Download
Qwen3-6B-Almost-Human-XMEN-X4-X2-X1-Dare-e32.i1-Q5_K_M.gguf
LFS Q5
4.2 GB Download
Qwen3-6B-Almost-Human-XMEN-X4-X2-X1-Dare-e32.i1-Q5_K_S.gguf
LFS Q5
4.11 GB Download
Qwen3-6B-Almost-Human-XMEN-X4-X2-X1-Dare-e32.i1-Q6_K.gguf
LFS Q6
4.84 GB Download
Qwen3-6B-Almost-Human-XMEN-X4-X2-X1-Dare-e32.imatrix.gguf
LFS
5.64 MB Download