πŸ“‹ Model Description


license: gpl-3.0
datasets:

  • NobodyExistsOnTheInternet/ToxicQAFinal
  • anthracite-org/kalo-opus-instruct-22k-no-refusal
  • Orion-zhen/dpo-toxic-zh
  • unalignment/toxic-dpo-v0.2
  • Crystalcareai/Intel-DPO-Pairs-Norefusals

language:
  • zh
  • en

base_model:
  • Qwen/Qwen2.5-7B-Instruct

pipeline_tag: text-generation
tags:
  • qwen
  • uncensored


QuantFactory Banner</a>

QuantFactory/Qwen2.5-7B-Instruct-Uncensored-GGUF

This is quantized version of
Orion-zhen/Qwen2.5-7B-Instruct-Uncensored created using llama.cpp

Original Model Card

Qwen2.5-7B-Instruct-Uncensored

This model is an uncensored fine-tune version of Qwen2.5-7B-Instruct. However, I can still notice that though uncensored, the model fails to generate detailed descriptions on certain extreme scenarios, which might be associated with deletion on some pretrain datasets in Qwen's pretraining stage.

Check out my roleplay&writing enhanced model based on this model: Orion-zhen/Meissa-Qwen2.5-7B-Instruct

Traning details

I used SFT + DPO to ensure uncensorment as well as trying to maintain original model's capabilities.

  • SFT:
- NobodyExistsOnTheInternet/ToxicQAFinal - anthracite-org/kalo-opus-instruct-22k-no-refusal
  • DPO:
- Orion-zhen/dpo-toxic-zh - unalignment/toxic-dpo-v0.2 - Crystalcareai/Intel-DPO-Pairs-Norefusals

πŸ“‚ GGUF File List

πŸ“ Filename πŸ“¦ Size ⚑ Download
Qwen2.5-7B-Instruct-Uncensored.Q2_K.gguf
LFS Q2
2.81 GB Download
Qwen2.5-7B-Instruct-Uncensored.Q3_K_L.gguf
LFS Q3
3.81 GB Download
Qwen2.5-7B-Instruct-Uncensored.Q3_K_M.gguf
LFS Q3
3.55 GB Download
Qwen2.5-7B-Instruct-Uncensored.Q3_K_S.gguf
LFS Q3
3.25 GB Download
Qwen2.5-7B-Instruct-Uncensored.Q4_0.gguf
Recommended LFS Q4
4.13 GB Download
Qwen2.5-7B-Instruct-Uncensored.Q4_1.gguf
LFS Q4
4.54 GB Download
Qwen2.5-7B-Instruct-Uncensored.Q4_K_M.gguf
LFS Q4
4.36 GB Download
Qwen2.5-7B-Instruct-Uncensored.Q4_K_S.gguf
LFS Q4
4.15 GB Download
Qwen2.5-7B-Instruct-Uncensored.Q5_0.gguf
LFS Q5
4.95 GB Download
Qwen2.5-7B-Instruct-Uncensored.Q5_1.gguf
LFS Q5
5.36 GB Download
Qwen2.5-7B-Instruct-Uncensored.Q5_K_M.gguf
LFS Q5
5.07 GB Download
Qwen2.5-7B-Instruct-Uncensored.Q5_K_S.gguf
LFS Q5
4.95 GB Download
Qwen2.5-7B-Instruct-Uncensored.Q6_K.gguf
LFS Q6
5.82 GB Download
Qwen2.5-7B-Instruct-Uncensored.Q8_0.gguf
LFS Q8
7.54 GB Download