π Model Description
license: gpl-3.0
datasets:
- NobodyExistsOnTheInternet/ToxicQAFinal
- anthracite-org/kalo-opus-instruct-22k-no-refusal
- Orion-zhen/dpo-toxic-zh
- unalignment/toxic-dpo-v0.2
- Crystalcareai/Intel-DPO-Pairs-Norefusals
language:
- zh
- en
base_model:
- Qwen/Qwen2.5-7B-Instruct
pipeline_tag: text-generation
tags:
- qwen
- uncensored
QuantFactory/Qwen2.5-7B-Instruct-Uncensored-GGUF
This is quantized version of Orion-zhen/Qwen2.5-7B-Instruct-Uncensored created using llama.cppOriginal Model Card
Qwen2.5-7B-Instruct-Uncensored
This model is an uncensored fine-tune version of Qwen2.5-7B-Instruct. However, I can still notice that though uncensored, the model fails to generate detailed descriptions on certain extreme scenarios, which might be associated with deletion on some pretrain datasets in Qwen's pretraining stage.
Check out my roleplay&writing enhanced model based on this model: Orion-zhen/Meissa-Qwen2.5-7B-Instruct
Traning details
I used SFT + DPO to ensure uncensorment as well as trying to maintain original model's capabilities.
- SFT:
- DPO:
π GGUF File List
| π Filename | π¦ Size | β‘ Download |
|---|---|---|
|
Qwen2.5-7B-Instruct-Uncensored.Q2_K.gguf
LFS
Q2
|
2.81 GB | Download |
|
Qwen2.5-7B-Instruct-Uncensored.Q3_K_L.gguf
LFS
Q3
|
3.81 GB | Download |
|
Qwen2.5-7B-Instruct-Uncensored.Q3_K_M.gguf
LFS
Q3
|
3.55 GB | Download |
|
Qwen2.5-7B-Instruct-Uncensored.Q3_K_S.gguf
LFS
Q3
|
3.25 GB | Download |
|
Qwen2.5-7B-Instruct-Uncensored.Q4_0.gguf
Recommended
LFS
Q4
|
4.13 GB | Download |
|
Qwen2.5-7B-Instruct-Uncensored.Q4_1.gguf
LFS
Q4
|
4.54 GB | Download |
|
Qwen2.5-7B-Instruct-Uncensored.Q4_K_M.gguf
LFS
Q4
|
4.36 GB | Download |
|
Qwen2.5-7B-Instruct-Uncensored.Q4_K_S.gguf
LFS
Q4
|
4.15 GB | Download |
|
Qwen2.5-7B-Instruct-Uncensored.Q5_0.gguf
LFS
Q5
|
4.95 GB | Download |
|
Qwen2.5-7B-Instruct-Uncensored.Q5_1.gguf
LFS
Q5
|
5.36 GB | Download |
|
Qwen2.5-7B-Instruct-Uncensored.Q5_K_M.gguf
LFS
Q5
|
5.07 GB | Download |
|
Qwen2.5-7B-Instruct-Uncensored.Q5_K_S.gguf
LFS
Q5
|
4.95 GB | Download |
|
Qwen2.5-7B-Instruct-Uncensored.Q6_K.gguf
LFS
Q6
|
5.82 GB | Download |
|
Qwen2.5-7B-Instruct-Uncensored.Q8_0.gguf
LFS
Q8
|
7.54 GB | Download |