π Model Description
base_model:
- Casual-Autopsy/CREC-n-WREC-Mate-24B-v2
- imatrixgguf
- staticgguf
- sillytavern
- charactercreation
- wicreation
- not-for-all-audiences
CREC-n-WREC-Mate-24B-v2
THIS MODEL IS UNOFFICIAL!
This model has no official affiliation with Weather and his SillyTavern Extensions. This is simply a fan project to help fellow users of these extensions.
Merge Description
CREC-n-WREC-Mate is a model made to help create World Info entries mid-roleplay using the SillyTavern extensions CREC and WREC.
The responses a bit on the shorter side by default, but this should be all the more beneficial for creating World Info entries. Needless to say, this isn't a model designed for creating Char Cards, instead it's meant for saving characters you encounter on your adventures to a Lorebook, so make sure to enable the feature that allows adding characters to a WI entry in the CREC settings menu.
WREC Setup: here
CREC Setup: here
Merge Details
This is a merge of pre-trained language models created using mergekit.Merge Method
This model was merged using the Conflict-Aware N:M Sparsification merge method using TheDrummer/Cydonia-24B-v2.1 as a base.
Models Merged
The following models were included in the merge:
- CharGen-Archive/CharGen-v3-beta-275-s0
- SlerpE/CardProjector-24B-v3
- Mawdistical/Mawdistic-NightLife-24b
- ReadyArt/Broken-Tutu-24B
Configuration
The following YAML configurations were used to produce this model:
#### C-n-W-CharGen_v2
models:
- model: CharGen-Archive/CharGen-v3-beta-275-s0
- model: Mawdistical/Mawdistic-NightLife-24b
parameters:
weight: 0.3
n_val: 64
m_val: 128
- model: SlerpE/CardProjector-24B-v3
parameters:
weight: 0.2
n_val: 16
m_val: 32
merge_method: cabs
pruning_order:
- Mawdistical/Mawdistic-NightLife-24b
- SlerpE/CardProjector-24B-v3
base_model: CharGen-Archive/CharGen-v3-beta-275-s0
dtype: float32
tokenizer:
source: union
tokens:
</s>:
source:
kind: model_token
model: CharGen-Archive/CharGen-v3-beta-275-s0
token: "<|im_end|>"
"[INST]":
source:
kind: model_token
model: CharGen-Archive/CharGen-v3-beta-275-s0
token: "<|im_start|>"
#### C-n-W-CardProj_v2
models:
- model: SlerpE/CardProjector-24B-v3
- model: ReadyArt/Broken-Tutu-24B
parameters:
weight: 0.3
n_val: 64
m_val: 128
- model: CharGen-Archive/CharGen-v3-beta-275-s0
parameters:
weight: 0.2
n_val: 16
m_val: 32
merge_method: cabs
pruning_order:
- ReadyArt/Broken-Tutu-24B
- CharGen-Archive/CharGen-v3-beta-275-s0
base_model: SlerpE/CardProjector-24B-v3
dtype: float32
tokenizer:
source: union
tokens:
"[/INST]":
source:
kind: model_token
model: CharGen-Archive/CharGen-v3-beta-275-s0
token: "<|im_end|>"
source:
kind: model_token
model: CharGen-Archive/CharGen-v3-beta-275-s0
token: "<|im_start|>"
#### CREC-n-WREC-Mate-24B-v2
models:
- model: TheDrummer/Cydonia-24B-v2.1
- model: C-n-W-CardProj_v2
parameters:
weight: 0.6
n_val: 64
m_val: 128
- model: C-n-W-CharGen_v2
parameters:
weight: 0.4
n_val: 12
m_val: 32
merge_method: cabs
pruning_order:
- C-n-W-CardProj_v2
- C-n-W-CharGen_v2
base_model: TheDrummer/Cydonia-24B-v2.1
dtype: float32
out_dtype: bfloat16
tokenizer:
source: union
tokens:
"[/INST]":
source:
kind: model_token
model: C-n-W-CardProj_v2
token: "[/INST]"
source:
kind: model_token
model: C-n-W-CharGen_v2
token: "[/INST]"
"[INST]":
source:
kind: model_token
model: C-n-W-CardProj_v2
token: "[INST]"
source:
kind: model_token
model: C-n-W-CharGen_v2
token: "[INST]"
</s>:
source:
kind: model_token
model: C-n-W-CardProj_v2
token: "</s>"
source:
kind: model_token
model: C-n-W-CharGen_v2
token: "</s>"
π GGUF File List
π Filename | π¦ Size | β‘ Download |
---|---|---|
CREC-n-WREC-Mate-24B-v2-bf16.gguf
LFS
FP16
|
43.92 GB | Download |
CREC-n-WREC-Mate-24B-v2-iq3_m.gguf
LFS
Q3
|
9.92 GB | Download |
CREC-n-WREC-Mate-24B-v2-iq3_s.gguf
LFS
Q3
|
9.71 GB | Download |
CREC-n-WREC-Mate-24B-v2-iq4_nl.gguf
LFS
Q4
|
12.54 GB | Download |
CREC-n-WREC-Mate-24B-v2-iq4_xs.gguf
LFS
Q4
|
11.88 GB | Download |
CREC-n-WREC-Mate-24B-v2-q3_k_l.gguf
LFS
Q3
|
11.55 GB | Download |
CREC-n-WREC-Mate-24B-v2-q3_k_m.gguf
LFS
Q3
|
10.69 GB | Download |
CREC-n-WREC-Mate-24B-v2-q3_k_s.gguf
LFS
Q3
|
9.69 GB | Download |
CREC-n-WREC-Mate-24B-v2-q3_k_xl.gguf
LFS
Q3
|
12.1 GB | Download |
CREC-n-WREC-Mate-24B-v2-q4_0.gguf
Recommended
LFS
Q4
|
12.57 GB | Download |
CREC-n-WREC-Mate-24B-v2-q4_1.gguf
LFS
Q4
|
13.85 GB | Download |
CREC-n-WREC-Mate-24B-v2-q4_k_l.gguf
LFS
Q4
|
13.81 GB | Download |
CREC-n-WREC-Mate-24B-v2-q4_k_m.gguf
LFS
Q4
|
13.35 GB | Download |
CREC-n-WREC-Mate-24B-v2-q4_k_s.gguf
LFS
Q4
|
12.62 GB | Download |
CREC-n-WREC-Mate-24B-v2-q5_0.gguf
LFS
Q5
|
15.23 GB | Download |
CREC-n-WREC-Mate-24B-v2-q5_1.gguf
LFS
Q5
|
16.52 GB | Download |
CREC-n-WREC-Mate-24B-v2-q5_k_l.gguf
LFS
Q5
|
16 GB | Download |
CREC-n-WREC-Mate-24B-v2-q5_k_m.gguf
LFS
Q5
|
15.61 GB | Download |
CREC-n-WREC-Mate-24B-v2-q5_k_s.gguf
LFS
Q5
|
15.18 GB | Download |
CREC-n-WREC-Mate-24B-v2-q6_k.gguf
LFS
Q6
|
18.02 GB | Download |
CREC-n-WREC-Mate-24B-v2-q6_k_l.gguf
LFS
Q6
|
18.32 GB | Download |
CREC-n-WREC-Mate-24B-v2-q8_0.gguf
LFS
Q8
|
23.33 GB | Download |