π Model Description
license: other
Join our Discord! https://discord.gg/Nbv9pQ88Xb
Nearly 5000 members strong πͺ Now with more channels! A hub for users and makers alike!
BeaverAI proudly presents...
Gemmasutra Small 4B v1 π§
Special Thanks
- Thank you to each and everyone who donated and subscribed in Ko-Fi to make our venture a little bit easier.
- I'm also recently unemployed. I am a Software Developer with 8 years of experience in Web, API, AI, and adapting to new tech and requirements. If you're hiring, feel free to reach out to me however.
Supported Chat Template
- Gemma (user, assistant)
Description
An upscaled Gemma 2B tune with modern techniques. Au Revoir, Gemma!
Links
- Original: https://huggingface.co/TheDrummer/Gemmasutra-Small-4B-v1
- GGUF: https://huggingface.co/TheDrummer/Gemmasutra-Small-4B-v1-GGUF
- iMatrix (recommended): https://huggingface.co/bartowski/TheDrummer_Gemmasutra-Small-4B-v1-GGUF
π GGUF File List
| π Filename | π¦ Size | β‘ Download |
|---|---|---|
|
Gemmasutra-Small-4B-v1a-Q2_K.gguf
LFS
Q2
|
1.57 GB | Download |
|
Gemmasutra-Small-4B-v1a-Q3_K_M.gguf
LFS
Q3
|
1.92 GB | Download |
|
Gemmasutra-Small-4B-v1a-Q4_K_M.gguf
Recommended
LFS
Q4
|
2.29 GB | Download |
|
Gemmasutra-Small-4B-v1a-Q5_K_M.gguf
LFS
Q5
|
2.61 GB | Download |
|
Gemmasutra-Small-4B-v1a-Q6_K.gguf
LFS
Q6
|
2.96 GB | Download |
|
Gemmasutra-Small-4B-v1a-Q8_0.gguf
LFS
Q8
|
3.83 GB | Download |