π Model Description
license: other
Join our Discord! https://discord.gg/Nbv9pQ88Xb
Works on Kobold 1.72 and Layla (iOS / Android)
BeaverAI team proudly presents
Gemmasutra Mini 2B v1 π§
Gemma's been training for ALL of you.
A tiny RP model packing an unbelievable PUNCH. Finetuned by yours truly.
Description
Gone are the days when models below 7B were too small to give you a satisfying RP experience.
Gemmasutra Mini 2B v1 marks the beginning of a new chapter in our local LLM community.
Be it in your browser, your crappy laptop, your mid-tier phone running Layla, or your Raspberry Pi...
This lil 2B will give you a playthrough worth having.
A model for thee, a model for all!
(And yes, it is uncensored and unaligned. Enjoy!)
Links
- Original: https://huggingface.co/TheDrummer/Gemmasutra-Mini-2B-v1
- GGUF: https://huggingface.co/TheDrummer/Gemmasutra-Mini-2B-v1-GGUF
- iMatrix (recommended / better quants): https://huggingface.co/MarsupialAI/Gemmasutra-Mini-2B-v1iMatrixGGUF
Usage
- For the best experience, use the Gemma Instruct template and modify it to support the
system
role (e.g.,
)ofturn>system - Chat Completion works well too
- Don't use it for Math
Examples
A big thanks to @kurgan1138 for most of the logs!
SFW
#### 4K context
NSFW NSFW NSFW NSFW NSFW
NSFW NSFW NSFW NSFW NSFW
NSFW NSFW NSFW NSFW NSFW
#### Forgiveness Meter
#### Group Character
π GGUF File List
π Filename | π¦ Size | β‘ Download |
---|---|---|
Gemmasutra-Mini-2B-v1-BF16.gguf
LFS
FP16
|
4.88 GB | Download |
Gemmasutra-Mini-2B-v1-Q2_K.gguf
LFS
Q2
|
1.15 GB | Download |
Gemmasutra-Mini-2B-v1-Q3_K.gguf
LFS
Q3
|
1.36 GB | Download |
Gemmasutra-Mini-2B-v1-Q3_K_L.gguf
LFS
Q3
|
1.44 GB | Download |
Gemmasutra-Mini-2B-v1-Q3_K_M.gguf
LFS
Q3
|
1.36 GB | Download |
Gemmasutra-Mini-2B-v1-Q3_K_S.gguf
LFS
Q3
|
1.27 GB | Download |
Gemmasutra-Mini-2B-v1-Q4_0_4_4.gguf
Recommended
LFS
Q4
|
1.52 GB | Download |
Gemmasutra-Mini-2B-v1-Q4_0_4_8.gguf
LFS
Q4
|
1.52 GB | Download |
Gemmasutra-Mini-2B-v1-Q4_0_8_8.gguf
LFS
Q4
|
1.52 GB | Download |
Gemmasutra-Mini-2B-v1-Q4_K.gguf
LFS
Q4
|
1.59 GB | Download |
Gemmasutra-Mini-2B-v1-Q4_K_M.gguf
LFS
Q4
|
1.59 GB | Download |
Gemmasutra-Mini-2B-v1-Q4_K_S.gguf
LFS
Q4
|
1.53 GB | Download |
Gemmasutra-Mini-2B-v1-Q5_K.gguf
LFS
Q5
|
1.79 GB | Download |
Gemmasutra-Mini-2B-v1-Q5_K_M.gguf
LFS
Q5
|
1.79 GB | Download |
Gemmasutra-Mini-2B-v1-Q5_K_S.gguf
LFS
Q5
|
1.75 GB | Download |
Gemmasutra-Mini-2B-v1-Q6_K.gguf
LFS
Q6
|
2 GB | Download |
Gemmasutra-Mini-2B-v1-Q8_0.gguf
LFS
Q8
|
2.59 GB | Download |
Gemmasutra-Mini-2B-v1-f16.gguf
LFS
FP16
|
4.88 GB | Download |
Gemmasutra-Mini-2B-v1-f32.gguf
LFS
|
9.74 GB | Download |