• Nitral-AI/CaptainErisNebula-12B-Chimera-v1.1

• text-generation-inference
• testing
• mistral
• chatml

[!TIP]

# GGUF quants for Nitral-AI/CaptainErisNebula-12B-Chimera-v1.1's recipe.

[!IMPORTANT]

Author recommended initial SillyTavern presets:

- Chimera: v1.1

- (backup)(633788596ef1810cc9ea9abd375bbda3e568bd37)

!https://iili.io/KKtCMf2.md.jpg

[!NOTE]

## This is an improvement on the previous experimental version.

- Not "chaotic", and at a usable size for most people seeking to perform inference locally with good speeds.

- The model does not show excessive alignment, so it should be good for most scenarios/writing situations.

- Feel free to use some light system prompting to nudge it out of a blocker if needed.

- It does well in adhering to characters and instructions.

Thank you so much, "crazy chef" and "mad scientist", Nitral!

# Using the latest llama.cpp ...
release version at the time: b6258.
Imatrix was based on the full ...
FP16 precision GGUF.

START: BF16 HuggingFace Model
↓
(1) Conversion to Full-Precision GGUF
↓
FP16 GGUF (for Calibration Imatrix)
BF16 GGUF (for Quantization)
↓
(2) Generate Imatrix (from FP16 GGUF)
↓
imatrix.fp16.gguf
↓
(3) Quantize with Imatrix (using BF16 GGUF)
↓
Final Quantized GGUF Models
↓
END