πŸ“‹ Model Description


license: cc-by-4.0
language:

  • en

base_model:
  • mistralai/Mistral-Nemo-Instruct-2407
  • Epiculous/Violet_Twilight-v0.2
  • NeverSleep/Lumimaid-v0.2-12B
  • flammenai/Mahou-1.5-mistral-nemo-12B
  • Sao10K/MN-12B-Lyra-v4

library_name: transformers
tags:
  • storywriting
  • text adventure
  • creative
  • story
  • writing
  • fiction
  • roleplaying
  • rp
  • mergekit
  • merge


QuantFactory Banner</a>

QuantFactory/MN-Violet-Lotus-12B-GGUF

This is quantized version of
FallenMerick/MN-Violet-Lotus-12B created using llama.cpp

Original Model Card

!pic

MN-Violet-Lotus-12B

This is the model I was trying to create when Chunky-Lotus emerged. Not only does this model score higher on my local EQ benchmarks (80.00 w/ 100% parsed @ 8-bit), but it does an even better job at roleplaying and producing creative outputs while still adhering to wide ranges of character personalities. The high levels of emotional intelligence are really quite noticeable as well.

!pic

Once again, models tend to score higher on my local tests when compared to their posted scores, but this has become the new high score for models I've personally tested.

I really like the way this model writes, and I hope you'll enjoy using it as well!

GGUF Quants:

  • https://huggingface.co/backyardai/MN-Violet-Lotus-12B-GGUF
  • https://huggingface.co/mradermacher/MN-Violet-Lotus-12B-GGUF
  • https://huggingface.co/mradermacher/MN-Violet-Lotus-12B-i1-GGUF

Recommended ST Settings

Special thanks to @Zeldazachman for these amazing ST settings that I now wholeheartedly recommend!

!pic

Merge Details

This is a merge of pre-trained language models created using mergekit.

Merge Method

This model was merged using the Model Stock merge method.

Models Merged

The following models were included in the merge:

Configuration

The following YAML configuration was used to produce this model:

models:
  - model: FallenMerick/MN-Twilight-Maid-SLERP-12B #(unreleased)
  - model: Sao10K/MN-12B-Lyra-v4
  - model: flammenai/Mahou-1.5-mistral-nemo-12B
mergemethod: modelstock
base_model: mistralai/Mistral-Nemo-Instruct-2407
parameters:
  normalize: true
dtype: bfloat16

In this recipe, Violet Twilight and Lumimaid were first blended using the SLERP method to create a strong roleplaying foundation. Lyra v4 is then added to the mix for its great creativity and roleplaying performance, along with Mahou to once again curtail the outputs and prevent the resulting model from becoming too wordy. Model Stock was used for the final merge in order to really push the resulting weights in the proper direction while using Nemo Instruct as a strong anchor point.

πŸ“‚ GGUF File List

πŸ“ Filename πŸ“¦ Size ⚑ Download
MN-Violet-Lotus-12B.Q2_K.gguf
LFS Q2
4.46 GB Download
MN-Violet-Lotus-12B.Q3_K_L.gguf
LFS Q3
6.11 GB Download
MN-Violet-Lotus-12B.Q3_K_M.gguf
LFS Q3
5.67 GB Download
MN-Violet-Lotus-12B.Q3_K_S.gguf
LFS Q3
5.15 GB Download
MN-Violet-Lotus-12B.Q4_0.gguf
Recommended LFS Q4
6.59 GB Download
MN-Violet-Lotus-12B.Q4_1.gguf
LFS Q4
7.26 GB Download
MN-Violet-Lotus-12B.Q4_K_M.gguf
LFS Q4
6.96 GB Download
MN-Violet-Lotus-12B.Q4_K_S.gguf
LFS Q4
6.63 GB Download
MN-Violet-Lotus-12B.Q5_0.gguf
LFS Q5
7.93 GB Download
MN-Violet-Lotus-12B.Q5_1.gguf
LFS Q5
8.61 GB Download
MN-Violet-Lotus-12B.Q5_K_M.gguf
LFS Q5
8.13 GB Download
MN-Violet-Lotus-12B.Q5_K_S.gguf
LFS Q5
7.93 GB Download
MN-Violet-Lotus-12B.Q6_K.gguf
LFS Q6
9.37 GB Download
MN-Violet-Lotus-12B.Q8_0.gguf
LFS Q8
12.13 GB Download