πŸ“‹ Model Description


tags:
  • llava
  • lmm
  • ggml
  • llama.cpp

ggml_llava-v1.5-7b

This repo contains GGUF files to inference llava-v1.5-7b with llama.cpp end-to-end without any extra dependency.

Note: The mmproj-model-f16.gguf file structure is experimental and may change. Always use the latest code in llama.cpp.

πŸ“‚ GGUF File List

πŸ“ Filename πŸ“¦ Size ⚑ Download
ggml-model-f16.gguf
Recommended LFS FP16
12.55 GB Download
ggml-model-q4_k.gguf
LFS Q4
3.8 GB Download
ggml-model-q5_k.gguf
LFS Q5
4.45 GB Download
mmproj-model-f16.gguf
LFS FP16
595.51 MB Download