πŸ“‹ Model Description

No documentation available

πŸ“‚ GGUF File List

πŸ“ Filename πŸ“¦ Size ⚑ Download
granite-8b-code-instruct-4k-bf16.gguf
LFS FP16
15.01 GB Download
granite-8b-code-instruct-4k-bf16_q8_0.gguf
LFS Q8
10.66 GB Download
granite-8b-code-instruct-4k-f16_q8_0.gguf
LFS Q8
10.66 GB Download
granite-8b-code-instruct-4k-iq2_m.gguf
LFS Q2
2.7 GB Download
granite-8b-code-instruct-4k-iq2_s.gguf
LFS Q2
2.57 GB Download
granite-8b-code-instruct-4k-iq2_xs.gguf
LFS Q2
2.49 GB Download
granite-8b-code-instruct-4k-iq2_xxs.gguf
LFS Q2
2.27 GB Download
granite-8b-code-instruct-4k-iq3_m.gguf
LFS Q3
3.52 GB Download
granite-8b-code-instruct-4k-iq3_s.gguf
LFS Q3
3.52 GB Download
granite-8b-code-instruct-4k-iq3_xs.gguf
LFS Q3
3.16 GB Download
granite-8b-code-instruct-4k-iq3_xxs.gguf
LFS Q3
3.07 GB Download
granite-8b-code-instruct-4k-iq4_nl.gguf
LFS Q4
4.29 GB Download
granite-8b-code-instruct-4k-iq4_xs.gguf
LFS Q4
4.07 GB Download
granite-8b-code-instruct-4k-q2_k_m.gguf
LFS Q2
2.81 GB Download
granite-8b-code-instruct-4k-q2_k_s.gguf
LFS Q2
2.79 GB Download
granite-8b-code-instruct-4k-q3_k_m.gguf
LFS Q3
3.65 GB Download
granite-8b-code-instruct-4k-q3_k_s.gguf
LFS Q3
3.62 GB Download
granite-8b-code-instruct-4k-q4_0.gguf
Recommended LFS Q4
4.23 GB Download
granite-8b-code-instruct-4k-q4_1.gguf
LFS Q4
4.7 GB Download
granite-8b-code-instruct-4k-q4_k_m.gguf
LFS Q4
4.5 GB Download
granite-8b-code-instruct-4k-q4_k_s.gguf
LFS Q4
4.35 GB Download
granite-8b-code-instruct-4k-q5_0.gguf
LFS Q5
5.16 GB Download
granite-8b-code-instruct-4k-q5_1.gguf
LFS Q5
5.63 GB Download
granite-8b-code-instruct-4k-q5_k_m.gguf
LFS Q5
5.35 GB Download
granite-8b-code-instruct-4k-q5_k_s.gguf
LFS Q5
5.27 GB Download
granite-8b-code-instruct-4k-q6_k_m.gguf
LFS Q6
6.16 GB Download
granite-8b-code-instruct-4k-q8_0.gguf
LFS Q8
7.98 GB Download