πŸ“‹ Model Description


base_model:
  • Casual-Autopsy/CREC-n-WREC-Mate-24B-v2
pipeline_tag: text-generation tags:
  • imatrixgguf
  • staticgguf
  • sillytavern
  • charactercreation
  • wicreation
  • not-for-all-audiences

CREC-n-WREC-Mate-24B-v2

THIS MODEL IS UNOFFICIAL!

This model has no official affiliation with Weather and his SillyTavern Extensions. This is simply a fan project to help fellow users of these extensions.

Merge Description

CREC-n-WREC-Mate is a model made to help create World Info entries mid-roleplay using the SillyTavern extensions CREC and WREC.

The responses a bit on the shorter side by default, but this should be all the more beneficial for creating World Info entries. Needless to say, this isn't a model designed for creating Char Cards, instead it's meant for saving characters you encounter on your adventures to a Lorebook, so make sure to enable the feature that allows adding characters to a WI entry in the CREC settings menu.

WREC Setup: here

CREC Setup: here

Merge Details

This is a merge of pre-trained language models created using mergekit.

Merge Method

This model was merged using the Conflict-Aware N:M Sparsification merge method using TheDrummer/Cydonia-24B-v2.1 as a base.

Models Merged

The following models were included in the merge:

Configuration

The following YAML configurations were used to produce this model:

#### C-n-W-CharGen_v2

models:
- model: CharGen-Archive/CharGen-v3-beta-275-s0
- model: Mawdistical/Mawdistic-NightLife-24b
parameters:
weight: 0.3
n_val: 64
m_val: 128
- model: SlerpE/CardProjector-24B-v3
parameters:
weight: 0.2
n_val: 16
m_val: 32
merge_method: cabs
pruning_order:
- Mawdistical/Mawdistic-NightLife-24b
- SlerpE/CardProjector-24B-v3
base_model: CharGen-Archive/CharGen-v3-beta-275-s0
dtype: float32
tokenizer:
source: union
tokens:
</s>:
source:
kind: model_token
model: CharGen-Archive/CharGen-v3-beta-275-s0
token: "<|im_end|>"
"[INST]":
source:
kind: model_token
model: CharGen-Archive/CharGen-v3-beta-275-s0
token: "<|im_start|>"

#### C-n-W-CardProj_v2

models:
- model: SlerpE/CardProjector-24B-v3
- model: ReadyArt/Broken-Tutu-24B
parameters:
weight: 0.3
n_val: 64
m_val: 128
- model: CharGen-Archive/CharGen-v3-beta-275-s0
parameters:
weight: 0.2
n_val: 16
m_val: 32
merge_method: cabs
pruning_order:
- ReadyArt/Broken-Tutu-24B
- CharGen-Archive/CharGen-v3-beta-275-s0
base_model: SlerpE/CardProjector-24B-v3
dtype: float32
tokenizer:
source: union
tokens:
"[/INST]":
source:
kind: model_token
model: CharGen-Archive/CharGen-v3-beta-275-s0
token: "<|im_end|>"
source:
kind: model_token
model: CharGen-Archive/CharGen-v3-beta-275-s0
token: "<|im_start|>"

#### CREC-n-WREC-Mate-24B-v2

models:
- model: TheDrummer/Cydonia-24B-v2.1
- model: C-n-W-CardProj_v2
parameters:
weight: 0.6
n_val: 64
m_val: 128
- model: C-n-W-CharGen_v2
parameters:
weight: 0.4
n_val: 12
m_val: 32
merge_method: cabs
pruning_order:
- C-n-W-CardProj_v2
- C-n-W-CharGen_v2
base_model: TheDrummer/Cydonia-24B-v2.1
dtype: float32
out_dtype: bfloat16
tokenizer:
source: union
tokens:
"[/INST]":
source:
kind: model_token
model: C-n-W-CardProj_v2
token: "[/INST]"
source:
kind: model_token
model: C-n-W-CharGen_v2
token: "[/INST]"
"[INST]":
source:
kind: model_token
model: C-n-W-CardProj_v2
token: "[INST]"
source:
kind: model_token
model: C-n-W-CharGen_v2
token: "[INST]"
</s>:
source:
kind: model_token
model: C-n-W-CardProj_v2
token: "</s>"
source:
kind: model_token
model: C-n-W-CharGen_v2
token: "</s>"

πŸ“‚ GGUF File List

πŸ“ Filename πŸ“¦ Size ⚑ Download
CREC-n-WREC-Mate-24B-v2-bf16.gguf
LFS FP16
43.92 GB Download
CREC-n-WREC-Mate-24B-v2-iq3_m.gguf
LFS Q3
9.92 GB Download
CREC-n-WREC-Mate-24B-v2-iq3_s.gguf
LFS Q3
9.71 GB Download
CREC-n-WREC-Mate-24B-v2-iq4_nl.gguf
LFS Q4
12.54 GB Download
CREC-n-WREC-Mate-24B-v2-iq4_xs.gguf
LFS Q4
11.88 GB Download
CREC-n-WREC-Mate-24B-v2-q3_k_l.gguf
LFS Q3
11.55 GB Download
CREC-n-WREC-Mate-24B-v2-q3_k_m.gguf
LFS Q3
10.69 GB Download
CREC-n-WREC-Mate-24B-v2-q3_k_s.gguf
LFS Q3
9.69 GB Download
CREC-n-WREC-Mate-24B-v2-q3_k_xl.gguf
LFS Q3
12.1 GB Download
CREC-n-WREC-Mate-24B-v2-q4_0.gguf
Recommended LFS Q4
12.57 GB Download
CREC-n-WREC-Mate-24B-v2-q4_1.gguf
LFS Q4
13.85 GB Download
CREC-n-WREC-Mate-24B-v2-q4_k_l.gguf
LFS Q4
13.81 GB Download
CREC-n-WREC-Mate-24B-v2-q4_k_m.gguf
LFS Q4
13.35 GB Download
CREC-n-WREC-Mate-24B-v2-q4_k_s.gguf
LFS Q4
12.62 GB Download
CREC-n-WREC-Mate-24B-v2-q5_0.gguf
LFS Q5
15.23 GB Download
CREC-n-WREC-Mate-24B-v2-q5_1.gguf
LFS Q5
16.52 GB Download
CREC-n-WREC-Mate-24B-v2-q5_k_l.gguf
LFS Q5
16 GB Download
CREC-n-WREC-Mate-24B-v2-q5_k_m.gguf
LFS Q5
15.61 GB Download
CREC-n-WREC-Mate-24B-v2-q5_k_s.gguf
LFS Q5
15.18 GB Download
CREC-n-WREC-Mate-24B-v2-q6_k.gguf
LFS Q6
18.02 GB Download
CREC-n-WREC-Mate-24B-v2-q6_k_l.gguf
LFS Q6
18.32 GB Download
CREC-n-WREC-Mate-24B-v2-q8_0.gguf
LFS Q8
23.33 GB Download