πŸ“‹ Model Description


license: other

Join our Discord! https://discord.gg/Nbv9pQ88Xb

Works on Kobold 1.72 and Layla (iOS / Android)


!image/png

BeaverAI team proudly presents

Gemmasutra Mini 2B v1 🧘

Gemma's been training for ALL of you.

!image/webp

A tiny RP model packing an unbelievable PUNCH. Finetuned by yours truly.

Description

Gone are the days when models below 7B were too small to give you a satisfying RP experience.

Gemmasutra Mini 2B v1 marks the beginning of a new chapter in our local LLM community.

Be it in your browser, your crappy laptop, your mid-tier phone running Layla, or your Raspberry Pi...

This lil 2B will give you a playthrough worth having.

A model for thee, a model for all!

(And yes, it is uncensored and unaligned. Enjoy!)

Links

  • Original: https://huggingface.co/TheDrummer/Gemmasutra-Mini-2B-v1
  • GGUF: https://huggingface.co/TheDrummer/Gemmasutra-Mini-2B-v1-GGUF
  • iMatrix (recommended / better quants): https://huggingface.co/MarsupialAI/Gemmasutra-Mini-2B-v1iMatrixGGUF

Usage

  • For the best experience, use the Gemma Instruct template and modify it to support the system role (e.g., ofturn>system)
  • Chat Completion works well too
  • Don't use it for Math

Examples

A big thanks to @kurgan1138 for most of the logs!

SFW

!image/png

!image/png

!image/png

!image/png

#### 4K context

!image/png

!image/png

NSFW NSFW NSFW NSFW NSFW

NSFW NSFW NSFW NSFW NSFW

NSFW NSFW NSFW NSFW NSFW

!image/png

!image/png

!image/png

#### Forgiveness Meter

!image/png

#### Group Character

!image/png

!image/png

!image/png

!image/png

!image/png

πŸ“‚ GGUF File List

πŸ“ Filename πŸ“¦ Size ⚑ Download
Gemmasutra-Mini-2B-v1-BF16.gguf
LFS FP16
4.88 GB Download
Gemmasutra-Mini-2B-v1-Q2_K.gguf
LFS Q2
1.15 GB Download
Gemmasutra-Mini-2B-v1-Q3_K.gguf
LFS Q3
1.36 GB Download
Gemmasutra-Mini-2B-v1-Q3_K_L.gguf
LFS Q3
1.44 GB Download
Gemmasutra-Mini-2B-v1-Q3_K_M.gguf
LFS Q3
1.36 GB Download
Gemmasutra-Mini-2B-v1-Q3_K_S.gguf
LFS Q3
1.27 GB Download
Gemmasutra-Mini-2B-v1-Q4_0_4_4.gguf
Recommended LFS Q4
1.52 GB Download
Gemmasutra-Mini-2B-v1-Q4_0_4_8.gguf
LFS Q4
1.52 GB Download
Gemmasutra-Mini-2B-v1-Q4_0_8_8.gguf
LFS Q4
1.52 GB Download
Gemmasutra-Mini-2B-v1-Q4_K.gguf
LFS Q4
1.59 GB Download
Gemmasutra-Mini-2B-v1-Q4_K_M.gguf
LFS Q4
1.59 GB Download
Gemmasutra-Mini-2B-v1-Q4_K_S.gguf
LFS Q4
1.53 GB Download
Gemmasutra-Mini-2B-v1-Q5_K.gguf
LFS Q5
1.79 GB Download
Gemmasutra-Mini-2B-v1-Q5_K_M.gguf
LFS Q5
1.79 GB Download
Gemmasutra-Mini-2B-v1-Q5_K_S.gguf
LFS Q5
1.75 GB Download
Gemmasutra-Mini-2B-v1-Q6_K.gguf
LFS Q6
2 GB Download
Gemmasutra-Mini-2B-v1-Q8_0.gguf
LFS Q8
2.59 GB Download
Gemmasutra-Mini-2B-v1-f16.gguf
LFS FP16
4.88 GB Download
Gemmasutra-Mini-2B-v1-f32.gguf
LFS
9.74 GB Download