πŸ“‹ Model Description


license: other license_name: qwen-research license_link: https://huggingface.co/Qwen/Qwen2.5-Omni-3B/blob/main/LICENSE language:
  • en
tags:
  • multimodal
pipeline_tag: any-to-any base_model:
  • Qwen/Qwen2.5-Omni-3B

Qwen2.5-Omni-3B-GGUF

Original model: https://huggingface.co/Qwen/Qwen2.5-Omni-3B

Modalities:

  • βœ… Text input
  • βœ… Audio input
  • βœ… Image input
  • ❌ Video input
  • ❌ Audio generation

Ref PR: https://github.com/ggml-org/llama.cpp/pull/13784

πŸ“‚ GGUF File List

πŸ“ Filename πŸ“¦ Size ⚑ Download
Qwen2.5-Omni-3B-Q4_K_M.gguf
Recommended LFS Q4
1.96 GB Download
Qwen2.5-Omni-3B-Q8_0.gguf
LFS Q8
3.37 GB Download
Qwen2.5-Omni-3B-f16.gguf
LFS FP16
6.33 GB Download
mmproj-Qwen2.5-Omni-3B-Q8_0.gguf
LFS Q8
1.43 GB Download
mmproj-Qwen2.5-Omni-3B-f16.gguf
LFS FP16
2.44 GB Download