π Model Description
license: apache-2.0 language:
- en
- Qwen/Qwen-Image
- text: >-
- text: >-
- text: >-
- gguf-node
- gguf-connector
gguf quantized version of qwen-image
- run it straight with
gguf-connector
ggc q5
>
>GGUF file(s) available. Select which one to use:
>
>1. qwen-image-iq2_s.gguf
>2. qwen-image-iq4_nl.gguf
>3. qwen-image-q4_0.gguf
>4. qwen-image-q8_0.gguf
>
>Enter your choice (1 to 4): _
>
run it with gguf-node via comfyui
- drag qwen-image to >
./ComfyUI/models/diffusionmodels - drag qwen2.5-vl-7b [4.43GB] to >
./ComfyUI/models/textencoders - drag pig [254MB] to >
./ComfyUI/models/vae
tip: the text encoder used for this model is qwen2.5-vl-7b; get more encoder either here (pig quant) or here (llama.cpp quant); the size is different from the one (qwen2.5-vl-3b) used in omnigen2
run it with diffusers
import torch
from diffusers import DiffusionPipeline, GGUFQuantizationConfig, QwenImageTransformer2DModel
modelpath = "https://huggingface.co/calcuis/qwen-image-gguf/blob/main/qwen-image-q2k.gguf"
transformer = QwenImageTransformer2DModel.fromsinglefile(
model_path,
quantizationconfig=GGUFQuantizationConfig(computedtype=torch.bfloat16),
torch_dtype=torch.bfloat16,
config="callgg/qi-decoder",
subfolder="transformer"
)
pipe = DiffusionPipeline.from_pretrained(
"callgg/qi-decoder",
transformer=transformer,
torch_dtype=torch.bfloat16,
)
pipe.enablemodelcpu_offload()
prompt = "a pig holding a sign that says hello world"
positive_magic = {"en": "Ultra HD, 4K, cinematic composition."}
negative_prompt = " "
image = pipe(
prompt=prompt + positive_magic["en"],
negativeprompt=negativeprompt,
height=1024,
width=1024,
numinferencesteps=24,
truecfgscale=2.5,
generator=torch.Generator()
).images[0]
image.save("output.png")
note: diffusers not yet supported t and i quants; opt gguf-node via comfyui or run it straight with gguf-connector
reference
- base model from qwen
- distilled model from modelscope
- lite model is a lora merge from lightx2v
- comfyui from comfyanonymous
- diffusers from huggingface
- gguf-node (pypi|repo|pack)
- gguf-connector (pypi)
π GGUF File List
| π Filename | π¦ Size | β‘ Download |
|---|---|---|
|
qwen-image-bf16.gguf
LFS
FP16
|
38.09 GB | Download |
|
qwen-image-distilled-iq3_s.gguf
LFS
Q3
|
8.36 GB | Download |
|
qwen-image-distilled-q4_0.gguf
Recommended
LFS
Q4
|
10.8 GB | Download |
|
qwen-image-distilled-q4_1.gguf
LFS
Q4
|
11.98 GB | Download |
|
qwen-image-distilled-q5_0.gguf
LFS
Q5
|
13.17 GB | Download |
|
qwen-image-distilled-q5_1.gguf
LFS
Q5
|
14.36 GB | Download |
|
qwen-image-distilled-q6_k.gguf
LFS
Q6
|
15.69 GB | Download |
|
qwen-image-distilled-q8_0.gguf
LFS
Q8
|
20.29 GB | Download |
|
qwen-image-distilled-tq1_0.gguf
LFS
|
6.5 GB | Download |
|
qwen-image-distilled-tq2_0.gguf
LFS
Q2
|
6.51 GB | Download |
|
qwen-image-f16.gguf
LFS
FP16
|
38.05 GB | Download |
|
qwen-image-iq2_s.gguf
LFS
Q2
|
6.55 GB | Download |
|
qwen-image-iq3_xxs.gguf
LFS
Q3
|
8.36 GB | Download |
|
qwen-image-iq4_nl.gguf
LFS
Q4
|
10.8 GB | Download |
|
qwen-image-iq4_xs.gguf
LFS
Q4
|
10.2 GB | Download |
|
qwen-image-lite-iq2_s.gguf
LFS
Q2
|
6.48 GB | Download |
|
qwen-image-lite-iq3_s.gguf
LFS
Q3
|
8.33 GB | Download |
|
qwen-image-lite-iq3_xxs.gguf
LFS
Q3
|
8.33 GB | Download |
|
qwen-image-lite-iq4_nl.gguf
LFS
Q4
|
10.76 GB | Download |
|
qwen-image-lite-iq4_xs.gguf
LFS
Q4
|
10.17 GB | Download |
|
qwen-image-lite-mxfp4_moe.gguf
LFS
|
20.27 GB | Download |
|
qwen-image-lite-q4_0.gguf
LFS
Q4
|
10.76 GB | Download |
|
qwen-image-lite-q5_0.gguf
LFS
Q5
|
13.14 GB | Download |
|
qwen-image-lite-q6_k.gguf
LFS
Q6
|
15.66 GB | Download |
|
qwen-image-lite-q8_0.gguf
LFS
Q8
|
20.26 GB | Download |
|
qwen-image-lite-tq1_0.gguf
LFS
|
6.47 GB | Download |
|
qwen-image-lite-tq2_0.gguf
LFS
Q2
|
6.52 GB | Download |
|
qwen-image-q2_k.gguf
LFS
Q2
|
6.59 GB | Download |
|
qwen-image-q2_k_s.gguf
LFS
Q2
|
6.47 GB | Download |
|
qwen-image-q3_k_l.gguf
LFS
Q3
|
8.53 GB | Download |
|
qwen-image-q3_k_m.gguf
LFS
Q3
|
8.43 GB | Download |
|
qwen-image-q3_k_s.gguf
LFS
Q3
|
8.36 GB | Download |
|
qwen-image-q4_0.gguf
LFS
Q4
|
10.8 GB | Download |
|
qwen-image-q4_1.gguf
LFS
Q4
|
11.98 GB | Download |
|
qwen-image-q4_k_m.gguf
LFS
Q4
|
10.93 GB | Download |
|
qwen-image-q4_k_s.gguf
LFS
Q4
|
10.8 GB | Download |
|
qwen-image-q5_0.gguf
LFS
Q5
|
13.17 GB | Download |
|
qwen-image-q5_1.gguf
LFS
Q5
|
14.36 GB | Download |
|
qwen-image-q5_k_m.gguf
LFS
Q5
|
13.24 GB | Download |
|
qwen-image-q5_k_s.gguf
LFS
Q5
|
13.17 GB | Download |
|
qwen-image-q6_k.gguf
LFS
Q6
|
15.69 GB | Download |
|
qwen-image-q8_0.gguf
LFS
Q8
|
20.29 GB | Download |