πŸ“‹ Model Description

Quantization made by Richard Erkhov.

Github

Discord

Request more models

Noromaid-7B-0.4-DPO - GGUF

  • Model creator: https://huggingface.co/NeverSleep/
  • Original model: https://huggingface.co/NeverSleep/Noromaid-7B-0.4-DPO/

NameQuant methodSize
Noromaid-7B-0.4-DPO.Q2K.ggufQ2K2.53GB
Noromaid-7B-0.4-DPO.IQ3XS.ggufIQ3XS2.81GB
Noromaid-7B-0.4-DPO.IQ3S.ggufIQ3S2.96GB
Noromaid-7B-0.4-DPO.Q3KS.ggufQ3K_S2.95GB
Noromaid-7B-0.4-DPO.IQ3M.ggufIQ3M3.06GB
Noromaid-7B-0.4-DPO.Q3K.ggufQ3K3.28GB
Noromaid-7B-0.4-DPO.Q3KM.ggufQ3K_M3.28GB
Noromaid-7B-0.4-DPO.Q3KL.ggufQ3K_L3.56GB
Noromaid-7B-0.4-DPO.IQ4XS.ggufIQ4XS3.67GB
Noromaid-7B-0.4-DPO.Q40.ggufQ403.83GB
Noromaid-7B-0.4-DPO.IQ4NL.ggufIQ4NL3.87GB
Noromaid-7B-0.4-DPO.Q4KS.ggufQ4K_S3.86GB
Noromaid-7B-0.4-DPO.Q4K.ggufQ4K4.07GB
Noromaid-7B-0.4-DPO.Q4KM.ggufQ4K_M4.07GB
Noromaid-7B-0.4-DPO.Q41.ggufQ414.24GB
Noromaid-7B-0.4-DPO.Q50.ggufQ504.65GB
Noromaid-7B-0.4-DPO.Q5KS.ggufQ5K_S4.65GB
Noromaid-7B-0.4-DPO.Q5K.ggufQ5K4.78GB
Noromaid-7B-0.4-DPO.Q5KM.ggufQ5K_M4.78GB
Noromaid-7B-0.4-DPO.Q51.ggufQ515.07GB
Noromaid-7B-0.4-DPO.Q6K.ggufQ6K5.53GB
Noromaid-7B-0.4-DPO.Q80.ggufQ807.17GB

Original model description:



license: cc-by-nc-4.0

!image/png


This model is a collab between IkariDev and Undi!


Description

This repo contains fp16 files of Noromaid-7b-v0.4-DPO.

FP16 - by IkariDev and Undi

GGUF - by IkariDev and Undi

Ratings:

Note: We have permission of all users to upload their ratings, we DONT screenshot random reviews without asking if we can put them here!

No ratings yet!

If you want your rating to be here, send us a message over on DC and we'll put up a screenshot of it here. DC name is "ikaridev" and "undi".


Prompt format: Chatml

<|im_start|>system
{sysprompt}<|im_end|>
<|im_start|>user
{input}<|im_end|>
<|im_start|>assistant
{output}<|im_end|>

Training data used:

  • norobots dataset let the model have more human behavior, enhances the output.
  • [Aesir Private RP dataset] New data from a new and never used before dataset, add fresh data, no LimaRP spam, this is 100% new. Thanks to the MinvervaAI Team and, in particular, Gryphe for letting us use it!
  • [Another private Aesir dataset]
  • [Another private Aesir dataset]
  • limarp

DPO training data used:

This is a full finetune.

Others

Undi: If you want to support me, you can here.

IkariDev: Visit my retro/neocities style website please kek

πŸ“‚ GGUF File List

πŸ“ Filename πŸ“¦ Size ⚑ Download
Noromaid-7B-0.4-DPO.IQ3_M.gguf
LFS Q3
3.06 GB Download
Noromaid-7B-0.4-DPO.IQ3_S.gguf
LFS Q3
2.96 GB Download
Noromaid-7B-0.4-DPO.IQ3_XS.gguf
LFS Q3
2.81 GB Download
Noromaid-7B-0.4-DPO.IQ4_NL.gguf
LFS Q4
3.87 GB Download
Noromaid-7B-0.4-DPO.IQ4_XS.gguf
LFS Q4
3.67 GB Download
Noromaid-7B-0.4-DPO.Q2_K.gguf
LFS Q2
2.53 GB Download
Noromaid-7B-0.4-DPO.Q3_K.gguf
LFS Q3
3.28 GB Download
Noromaid-7B-0.4-DPO.Q3_K_L.gguf
LFS Q3
3.56 GB Download
Noromaid-7B-0.4-DPO.Q3_K_M.gguf
LFS Q3
3.28 GB Download
Noromaid-7B-0.4-DPO.Q3_K_S.gguf
LFS Q3
2.95 GB Download
Noromaid-7B-0.4-DPO.Q4_0.gguf
Recommended LFS Q4
3.83 GB Download
Noromaid-7B-0.4-DPO.Q4_1.gguf
LFS Q4
4.24 GB Download
Noromaid-7B-0.4-DPO.Q4_K.gguf
LFS Q4
4.07 GB Download
Noromaid-7B-0.4-DPO.Q4_K_M.gguf
LFS Q4
4.07 GB Download
Noromaid-7B-0.4-DPO.Q4_K_S.gguf
LFS Q4
3.86 GB Download
Noromaid-7B-0.4-DPO.Q5_0.gguf
LFS Q5
4.65 GB Download
Noromaid-7B-0.4-DPO.Q5_1.gguf
LFS Q5
5.07 GB Download
Noromaid-7B-0.4-DPO.Q5_K.gguf
LFS Q5
4.78 GB Download
Noromaid-7B-0.4-DPO.Q5_K_M.gguf
LFS Q5
4.78 GB Download
Noromaid-7B-0.4-DPO.Q5_K_S.gguf
LFS Q5
4.65 GB Download
Noromaid-7B-0.4-DPO.Q6_K.gguf
LFS Q6
5.53 GB Download
Noromaid-7B-0.4-DPO.Q8_0.gguf
LFS Q8
7.17 GB Download