πŸ“‹ Model Description


license: apache-2.0 language:
  • en
base_model:
  • Qwen/Qwen-Image
pipeline_tag: text-to-image library_name: diffusers widget:
  • text: >-
cute anime girl with massive fennec ears and a big fluffy fox tail with long wavy blonde hair between eyes and large blue eyes blonde colored eyelashes chubby wearing oversized clothes summer uniform long blue maxi skirt muddy clothes happy sitting on the side of the road in a run down dark gritty cyberpunk city with neon and a crumbling skyscraper in the rain at night while dipping her feet in a river of water she is holding a sign that says "ComfyUI is the best" written in cursive output: url: workflow-demo1.png
  • text: >-
cute anime girl with massive fennec ears and a big fluffy fox tail with long wavy blonde hair between eyes and large blue eyes blonde colored eyelashes chubby wearing oversized clothes summer uniform long blue maxi skirt muddy clothes happy sitting on the side of the road in a run down dark gritty cyberpunk city with neon and a crumbling skyscraper in the rain at night while dipping her feet in a river of water she is holding a sign that says "PIG is the best" written in cursive output: url: workflow-demo2.png
  • text: >-
cute anime girl with massive fennec ears and a big fluffy fox tail with long wavy blonde hair between eyes and large blue eyes blonde colored eyelashes chubby wearing oversized clothes summer uniform long blue maxi skirt muddy clothes happy sitting on the side of the road in a run down dark gritty cyberpunk city with neon and a crumbling skyscraper in the rain at night while dipping her feet in a river of water she is holding a sign that says "1+1=2 is it correct?" written in cursive output: url: workflow-demo3.png tags:
  • gguf-node
  • gguf-connector

gguf quantized version of qwen-image

  • run it straight with gguf-connector
ggc q5
> >GGUF file(s) available. Select which one to use: > >1. qwen-image-iq2_s.gguf >2. qwen-image-iq4_nl.gguf >3. qwen-image-q4_0.gguf >4. qwen-image-q8_0.gguf > >Enter your choice (1 to 4): _ >

run it with gguf-node via comfyui

  • drag qwen-image to > ./ComfyUI/models/diffusionmodels
  • drag qwen2.5-vl-7b [4.43GB] to > ./ComfyUI/models/textencoders
  • drag pig [254MB] to > ./ComfyUI/models/vae

!screenshot

tip: the text encoder used for this model is qwen2.5-vl-7b; get more encoder either here (pig quant) or here (llama.cpp quant); the size is different from the one (qwen2.5-vl-3b) used in omnigen2

run it with diffusers

import torch
from diffusers import DiffusionPipeline, GGUFQuantizationConfig, QwenImageTransformer2DModel

modelpath = "https://huggingface.co/calcuis/qwen-image-gguf/blob/main/qwen-image-q2k.gguf"
transformer = QwenImageTransformer2DModel.fromsinglefile(
model_path,
quantizationconfig=GGUFQuantizationConfig(computedtype=torch.bfloat16),
torch_dtype=torch.bfloat16,
config="callgg/qi-decoder",
subfolder="transformer"
)
pipe = DiffusionPipeline.from_pretrained(
"callgg/qi-decoder",
transformer=transformer,
torch_dtype=torch.bfloat16,
)
pipe.enablemodelcpu_offload()

prompt = "a pig holding a sign that says hello world"
positive_magic = {"en": "Ultra HD, 4K, cinematic composition."}
negative_prompt = " "
image = pipe(
prompt=prompt + positive_magic["en"],
negativeprompt=negativeprompt,
height=1024,
width=1024,
numinferencesteps=24,
truecfgscale=2.5,
generator=torch.Generator()
).images[0]
image.save("output.png")

note: diffusers not yet supported t and i quants; opt gguf-node via comfyui or run it straight with gguf-connector

reference

πŸ“‚ GGUF File List

πŸ“ Filename πŸ“¦ Size ⚑ Download
qwen-image-bf16.gguf
LFS FP16
38.09 GB Download
qwen-image-distilled-iq3_s.gguf
LFS Q3
8.36 GB Download
qwen-image-distilled-q4_0.gguf
Recommended LFS Q4
10.8 GB Download
qwen-image-distilled-q4_1.gguf
LFS Q4
11.98 GB Download
qwen-image-distilled-q5_0.gguf
LFS Q5
13.17 GB Download
qwen-image-distilled-q5_1.gguf
LFS Q5
14.36 GB Download
qwen-image-distilled-q6_k.gguf
LFS Q6
15.69 GB Download
qwen-image-distilled-q8_0.gguf
LFS Q8
20.29 GB Download
qwen-image-distilled-tq1_0.gguf
LFS
6.5 GB Download
qwen-image-distilled-tq2_0.gguf
LFS Q2
6.51 GB Download
qwen-image-f16.gguf
LFS FP16
38.05 GB Download
qwen-image-iq2_s.gguf
LFS Q2
6.55 GB Download
qwen-image-iq3_xxs.gguf
LFS Q3
8.36 GB Download
qwen-image-iq4_nl.gguf
LFS Q4
10.8 GB Download
qwen-image-iq4_xs.gguf
LFS Q4
10.2 GB Download
qwen-image-lite-iq2_s.gguf
LFS Q2
6.48 GB Download
qwen-image-lite-iq3_s.gguf
LFS Q3
8.33 GB Download
qwen-image-lite-iq3_xxs.gguf
LFS Q3
8.33 GB Download
qwen-image-lite-iq4_nl.gguf
LFS Q4
10.76 GB Download
qwen-image-lite-iq4_xs.gguf
LFS Q4
10.17 GB Download
qwen-image-lite-mxfp4_moe.gguf
LFS
20.27 GB Download
qwen-image-lite-q4_0.gguf
LFS Q4
10.76 GB Download
qwen-image-lite-q5_0.gguf
LFS Q5
13.14 GB Download
qwen-image-lite-q6_k.gguf
LFS Q6
15.66 GB Download
qwen-image-lite-q8_0.gguf
LFS Q8
20.26 GB Download
qwen-image-lite-tq1_0.gguf
LFS
6.47 GB Download
qwen-image-lite-tq2_0.gguf
LFS Q2
6.52 GB Download
qwen-image-q2_k.gguf
LFS Q2
6.59 GB Download
qwen-image-q2_k_s.gguf
LFS Q2
6.47 GB Download
qwen-image-q3_k_l.gguf
LFS Q3
8.53 GB Download
qwen-image-q3_k_m.gguf
LFS Q3
8.43 GB Download
qwen-image-q3_k_s.gguf
LFS Q3
8.36 GB Download
qwen-image-q4_0.gguf
LFS Q4
10.8 GB Download
qwen-image-q4_1.gguf
LFS Q4
11.98 GB Download
qwen-image-q4_k_m.gguf
LFS Q4
10.93 GB Download
qwen-image-q4_k_s.gguf
LFS Q4
10.8 GB Download
qwen-image-q5_0.gguf
LFS Q5
13.17 GB Download
qwen-image-q5_1.gguf
LFS Q5
14.36 GB Download
qwen-image-q5_k_m.gguf
LFS Q5
13.24 GB Download
qwen-image-q5_k_s.gguf
LFS Q5
13.17 GB Download
qwen-image-q6_k.gguf
LFS Q6
15.69 GB Download
qwen-image-q8_0.gguf
LFS Q8
20.29 GB Download