---

base_model: black-forest-labs/FLUX.1-schnell license: apache-2.0 model_creator: black-forest-labs model_name: FLUX.1-schnell quantized_by: Second State Inc. language:

• en

tags:

• text-to-image
• image-generation
• flux

---

---

FLUX.1-schnell-GGUF

Original Model

black-forest-labs/FLUX.1-schnell

Run with sd-api-server

• sd-api-server version: 0.1.4
• Run as LlamaEdge service

wasmedge --dir .:. sd-api-server.wasm \
    --model-name flux1-schnell \
    --diffusion-model flux1-schnell-Q4_0.gguf \
    --vae ae.safetensors \
    --clip-l clip_l.safetensors \
    --t5xxl t5xxl-Q8_0.gguf

For details, see https://github.com/LlamaEdge/sd-api-server/blob/main/examples/flux.md

Quantized GGUF Models

Name	Quant method	Bits	Size	Use case
ae-f16.gguf	f16	16	168 MB
ae.safetensors	f32	32	335 MB
clipl-Q80.gguf	Q80	8	131 MB
clip_l.safetensors	f16	16	246 MB
flux1-schnell-Q40.gguf	Q40	4	6.69 GB
flux1-schnell-Q41.gguf	Q41	4	7.43 GB
flux1-schnell-Q50.gguf	Q50	5	8.18 GB
flux1-schnell-Q51.gguf	Q51	5	8.92 GB
flux1-schnell-Q80.gguf	Q80	8	12.6 GB
flux1-schnell.safetensors	f16	16	23.8 GB
t5xxl-Q2K.gguf	Q2K	2	1.61 GB
t5xxl-Q3K.gguf	Q3K	3	2.10 GB
t5xxl-Q40.gguf	Q40	4	2.75 GB
t5xxl-Q4K.gguf	Q4K	4	2.75 GB
t5xxl-Q50.gguf	Q50	5	3.36 GB
t5xxl-Q51.gguf	Q51	5	3.67 GB
t5xxl-Q80.gguf	Q80	8	5.20 GB
t5xxl_fp16.safetensors	f16	16	9.79 GB

Quantized with stable-diffusion.cpp master-64d231f.