π Model Description
No documentation available
π GGUF File List
| π Filename | π¦ Size | β‘ Download |
|---|---|---|
|
TinyLlama-1.1B-Chat-v1.0-Q2_K.gguf
LFS
Q2
|
459.81 MB | Download |
|
TinyLlama-1.1B-Chat-v1.0-Q3_K_L.gguf
LFS
Q3
|
564.12 MB | Download |
|
TinyLlama-1.1B-Chat-v1.0-Q3_K_M.gguf
LFS
Q3
|
524.37 MB | Download |
|
TinyLlama-1.1B-Chat-v1.0-Q3_K_S.gguf
LFS
Q3
|
476.21 MB | Download |
|
TinyLlama-1.1B-Chat-v1.0-Q4_0.gguf
Recommended
LFS
Q4
|
607.23 MB | Download |
|
TinyLlama-1.1B-Chat-v1.0-Q4_K_M.gguf
LFS
Q4
|
636.88 MB | Download |
|
TinyLlama-1.1B-Chat-v1.0-Q4_K_S.gguf
LFS
Q4
|
612.98 MB | Download |
|
TinyLlama-1.1B-Chat-v1.0-Q5_0.gguf
LFS
Q5
|
730.54 MB | Download |
|
TinyLlama-1.1B-Chat-v1.0-Q5_K_M.gguf
LFS
Q5
|
745.82 MB | Download |
|
TinyLlama-1.1B-Chat-v1.0-Q5_K_S.gguf
LFS
Q5
|
730.54 MB | Download |
|
TinyLlama-1.1B-Chat-v1.0-Q6_K.gguf
LFS
Q6
|
861.56 MB | Download |
|
TinyLlama-1.1B-Chat-v1.0-Q8_0.gguf
LFS
Q8
|
1.09 GB | Download |
|
tinyllama-1.1b-chat-v1.0.Q5_K_M.gguf
LFS
Q5
|
746.74 MB | Download |