πŸ“‹ Model Description

No documentation available

πŸ“‚ GGUF File List

πŸ“ Filename πŸ“¦ Size ⚑ Download
Llama-3.1-Nemotron-Nano-4B-v1.1-bf16.gguf
LFS FP16
8.41 GB Download
Llama-3.1-Nemotron-Nano-4B-v1.1-bf16_q8_0.gguf
LFS Q8
5.16 GB Download
Llama-3.1-Nemotron-Nano-4B-v1.1-f16_q8_0.gguf
LFS Q8
6.39 GB Download
Llama-3.1-Nemotron-Nano-4B-v1.1-iq2_m.gguf
LFS Q2
1.73 GB Download
Llama-3.1-Nemotron-Nano-4B-v1.1-iq2_s.gguf
LFS Q2
1.67 GB Download
Llama-3.1-Nemotron-Nano-4B-v1.1-iq2_xs.gguf
LFS Q2
1.63 GB Download
Llama-3.1-Nemotron-Nano-4B-v1.1-iq2_xxs.gguf
LFS Q2
1.53 GB Download
Llama-3.1-Nemotron-Nano-4B-v1.1-iq3_m.gguf
LFS Q3
2.05 GB Download
Llama-3.1-Nemotron-Nano-4B-v1.1-iq3_s.gguf
LFS Q3
2.01 GB Download
Llama-3.1-Nemotron-Nano-4B-v1.1-iq3_xs.gguf
LFS Q3
1.93 GB Download
Llama-3.1-Nemotron-Nano-4B-v1.1-iq3_xxs.gguf
LFS Q3
1.85 GB Download
Llama-3.1-Nemotron-Nano-4B-v1.1-iq4_nl.gguf
LFS Q4
2.48 GB Download
Llama-3.1-Nemotron-Nano-4B-v1.1-iq4_xs.gguf
LFS Q4
2.36 GB Download
Llama-3.1-Nemotron-Nano-4B-v1.1-q2_k_m.gguf
LFS Q2
1.88 GB Download
Llama-3.1-Nemotron-Nano-4B-v1.1-q2_k_s.gguf
LFS Q2
1.69 GB Download
Llama-3.1-Nemotron-Nano-4B-v1.1-q3_k_m.gguf
LFS Q3
2.26 GB Download
Llama-3.1-Nemotron-Nano-4B-v1.1-q3_k_s.gguf
LFS Q3
2.04 GB Download
Llama-3.1-Nemotron-Nano-4B-v1.1-q4_0.gguf
Recommended LFS Q4
2.37 GB Download
Llama-3.1-Nemotron-Nano-4B-v1.1-q4_1.gguf
LFS Q4
2.63 GB Download
Llama-3.1-Nemotron-Nano-4B-v1.1-q4_k_m.gguf
LFS Q4
2.66 GB Download
Llama-3.1-Nemotron-Nano-4B-v1.1-q4_k_s.gguf
LFS Q4
2.6 GB Download
Llama-3.1-Nemotron-Nano-4B-v1.1-q5_0.gguf
LFS Q5
2.9 GB Download
Llama-3.1-Nemotron-Nano-4B-v1.1-q5_1.gguf
LFS Q5
3.16 GB Download
Llama-3.1-Nemotron-Nano-4B-v1.1-q5_k_m.gguf
LFS Q5
3.07 GB Download
Llama-3.1-Nemotron-Nano-4B-v1.1-q5_k_s.gguf
LFS Q5
3.04 GB Download
Llama-3.1-Nemotron-Nano-4B-v1.1-q6_k_m.gguf
LFS Q6
3.46 GB Download
Llama-3.1-Nemotron-Nano-4B-v1.1-q8_0.gguf
LFS Q8
4.47 GB Download