πŸ“‹ Model Description

No documentation available

πŸ“‚ GGUF File List

πŸ“ Filename πŸ“¦ Size ⚑ Download
llama-3.2_3B-thinking-v2-50k.IQ4_XS.gguf
LFS Q4
1.71 GB Download
llama-3.2_3B-thinking-v2-50k.Q2_K.gguf
LFS Q2
1.27 GB Download
llama-3.2_3B-thinking-v2-50k.Q3_K_L.gguf
LFS Q3
1.69 GB Download
llama-3.2_3B-thinking-v2-50k.Q3_K_M.gguf
LFS Q3
1.57 GB Download
llama-3.2_3B-thinking-v2-50k.Q3_K_S.gguf
LFS Q3
1.44 GB Download
llama-3.2_3B-thinking-v2-50k.Q4_K_M.gguf
Recommended LFS Q4
1.88 GB Download
llama-3.2_3B-thinking-v2-50k.Q4_K_S.gguf
LFS Q4
1.8 GB Download
llama-3.2_3B-thinking-v2-50k.Q5_K_M.gguf
LFS Q5
2.16 GB Download
llama-3.2_3B-thinking-v2-50k.Q5_K_S.gguf
LFS Q5
2.11 GB Download
llama-3.2_3B-thinking-v2-50k.Q6_K.gguf
LFS Q6
2.46 GB Download
llama-3.2_3B-thinking-v2-50k.Q8_0.gguf
LFS Q8
3.19 GB Download
llama-3.2_3B-thinking-v2-50k.f16.gguf
LFS FP16
5.99 GB Download