πŸ“‹ Model Description


license: apache-2.0 base_model:
  • vikhyatk/moondream2

This repo contains the llama.cpp compatible GGUFs of vikhyatk/moondream2: https://huggingface.co/vikhyatk/moondream2.

The GGUFs hosted in the original repo is missing the tokenizer.chattemplate field, thanks to @Hahasb for adding the vicuna template.

For further discussion, please refer to the PR: https://github.com/ggml-org/llama.cpp/pull/13745

πŸ“‚ GGUF File List

πŸ“ Filename πŸ“¦ Size ⚑ Download
moondream2-mmproj-f16-20250414.gguf
Recommended LFS FP16
867.63 MB Download
moondream2-text-model-f16_ct-vicuna.gguf
LFS FP16
2.64 GB Download