πŸ“‹ Model Description

No documentation available

πŸ“‚ GGUF File List

πŸ“ Filename πŸ“¦ Size ⚑ Download
Llama-3.1-8B-Instruct-bf16-q4_k.gguf
LFS Q4
5.86 GB Download
Llama-3.1-8B-Instruct-bf16-q6_k.gguf
LFS Q6
7.3 GB Download
Llama-3.1-8B-Instruct-bf16-q8_0.gguf
LFS Q8
8.87 GB Download
Llama-3.1-8B-Instruct-bf16.gguf
LFS FP16
14.97 GB Download
Llama-3.1-8B-Instruct-bf16_q8_0.gguf
LFS Q8
11.1 GB Download
Llama-3.1-8B-Instruct-f16-q4_k.gguf
LFS Q4
5.86 GB Download
Llama-3.1-8B-Instruct-f16-q6_k.gguf
LFS Q6
7.3 GB Download
Llama-3.1-8B-Instruct-f16-q8_0.gguf
LFS Q8
8.87 GB Download
Llama-3.1-8B-Instruct-f16_q8_0.gguf
LFS Q8
11.1 GB Download
Llama-3.1-8B-Instruct-iq2_m.gguf
LFS Q2
3 GB Download
Llama-3.1-8B-Instruct-iq2_s.gguf
LFS Q2
2.88 GB Download
Llama-3.1-8B-Instruct-iq2_xs.gguf
LFS Q2
2.79 GB Download
Llama-3.1-8B-Instruct-iq2_xxs.gguf
LFS Q2
2.6 GB Download
Llama-3.1-8B-Instruct-iq3_m.gguf
LFS Q3
3.75 GB Download
Llama-3.1-8B-Instruct-iq3_s.gguf
LFS Q3
3.69 GB Download
Llama-3.1-8B-Instruct-iq3_xs.gguf
LFS Q3
3.38 GB Download
Llama-3.1-8B-Instruct-iq3_xxs.gguf
LFS Q3
3.3 GB Download
Llama-3.1-8B-Instruct-iq4_nl.gguf
LFS Q4
4.36 GB Download
Llama-3.1-8B-Instruct-iq4_xs.gguf
LFS Q4
4.14 GB Download
Llama-3.1-8B-Instruct-q2_k_m.gguf
LFS Q2
3.2 GB Download
Llama-3.1-8B-Instruct-q2_k_s.gguf
LFS Q2
3.06 GB Download
Llama-3.1-8B-Instruct-q3_k_m.gguf
LFS Q3
3.93 GB Download
Llama-3.1-8B-Instruct-q3_k_s.gguf
LFS Q3
3.78 GB Download
Llama-3.1-8B-Instruct-q4_0.gguf
Recommended LFS Q4
4.21 GB Download
Llama-3.1-8B-Instruct-q4_1.gguf
LFS Q4
4.68 GB Download
Llama-3.1-8B-Instruct-q4_k_m.gguf
LFS Q4
4.72 GB Download
Llama-3.1-8B-Instruct-q4_k_s.gguf
LFS Q4
4.54 GB Download
Llama-3.1-8B-Instruct-q5_0.gguf
LFS Q5
5.15 GB Download
Llama-3.1-8B-Instruct-q5_1.gguf
LFS Q5
5.62 GB Download
Llama-3.1-8B-Instruct-q5_k_m.gguf
LFS Q5
5.42 GB Download
Llama-3.1-8B-Instruct-q5_k_s.gguf
LFS Q5
5.36 GB Download
Llama-3.1-8B-Instruct-q6_k_m.gguf
LFS Q6
6.14 GB Download
Llama-3.1-8B-Instruct-q8_0.gguf
LFS Q8
7.95 GB Download