πŸ“‹ Model Description


license: cc-by-nc-4.0 base_model:
  • CohereForAI/c4ai-command-r7b-12-2024

Quantized from model: CohereForAI/c4ai-command-r7b-12-2024

The model was quantized to GGUF format using these:

  • Model loaded with Transformers: v4.48.3
  • Converted to gguf with Transformers: v4.49.0 (from requirements.txt llama.cpp)
  • Llama.cpp commit: @7841fc7 (Compatible with Llama-cpp-python v0.3.8)

πŸ“‚ GGUF File List

πŸ“ Filename πŸ“¦ Size ⚑ Download
c4ai-command-r7b-12-2024-F16.gguf
LFS FP16
14.96 GB Download
c4ai-command-r7b-12-2024-Q4_K_M.gguf
Recommended LFS Q4
4.71 GB Download
c4ai-command-r7b-12-2024-Q5_K_M.gguf
LFS Q5
5.41 GB Download
c4ai-command-r7b-12-2024-Q8_0.gguf
LFS Q8
7.95 GB Download