π Model Description
license: other license_name: qwen-research license_link: https://huggingface.co/Qwen/Qwen2.5-Omni-3B/blob/main/LICENSE language:
- en
- multimodal
- Qwen/Qwen2.5-Omni-3B
Qwen2.5-Omni-3B-GGUF
Original model: https://huggingface.co/Qwen/Qwen2.5-Omni-3B
Modalities:
- β Text input
- β Audio input
- β Image input
- β Video input
- β Audio generation
Ref PR: https://github.com/ggml-org/llama.cpp/pull/13784
π GGUF File List
| π Filename | π¦ Size | β‘ Download |
|---|---|---|
|
Qwen2.5-Omni-3B-Q4_K_M.gguf
Recommended
LFS
Q4
|
1.96 GB | Download |
|
Qwen2.5-Omni-3B-Q8_0.gguf
LFS
Q8
|
3.37 GB | Download |
|
Qwen2.5-Omni-3B-f16.gguf
LFS
FP16
|
6.33 GB | Download |
|
mmproj-Qwen2.5-Omni-3B-Q8_0.gguf
LFS
Q8
|
1.43 GB | Download |
|
mmproj-Qwen2.5-Omni-3B-f16.gguf
LFS
FP16
|
2.44 GB | Download |