๐Ÿ“‹ Model Description


license: apache-2.0 language:
  • ja
datasets:
  • TFMC/imatrix-dataset-for-japanese-llm

Ninja-v1-NSFW-128k-gguf

Local-Novel-LLM-projectใ•ใ‚“ใŒๅ…ฌ้–‹ใ—ใฆใ„ใ‚‹Ninja-v1-NSFW-128kใฎggufใƒ•ใ‚ฉใƒผใƒžใƒƒใƒˆๅค‰ๆ›็‰ˆใงใ™ใ€‚

imatrixใฎใƒ‡ใƒผใ‚ฟใฏTFMC/imatrix-dataset-for-japanese-llmใ‚’ไฝฟ็”จใ—ใฆไฝœๆˆใ—ใพใ—ใŸใ€‚

ไป–ใฎใƒขใƒ‡ใƒซ

mmnga/Ninja-v1-gguf mmnga/Ninja-v1-NSFW-gguf mmnga/Ninja-v1-128k-gguf mmnga/Ninja-v1-NSFW-128k-gguf mmnga/Vecteus-v1-gguf

Usage

git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
make -j
./main -m 'Ninja-v1-NSFW-128k-Q4_0.gguf' -n 1024 -c 1024 -p 'ใ‚ใชใŸใฏใƒ—ใƒญใฎๅฐ่ชฌๅฎถใงใ™ใ€‚\nๅฐ่ชฌใ‚’ๆ›ธใ„ใฆใใ ใ•ใ„\n-------- \nใใ˜ใ‚‰ใฎ็‰ฉ่ชž\n-------- \n'

๐Ÿ“‚ GGUF File List

๐Ÿ“ Filename ๐Ÿ“ฆ Size โšก Download
Ninja-v1-NSFW-128k-IQ1_M.gguf
LFS
1.63 GB Download
Ninja-v1-NSFW-128k-IQ1_S.gguf
LFS
1.5 GB Download
Ninja-v1-NSFW-128k-IQ2_M.gguf
LFS Q2
2.33 GB Download
Ninja-v1-NSFW-128k-IQ2_S.gguf
LFS Q2
2.15 GB Download
Ninja-v1-NSFW-128k-IQ2_XS.gguf
LFS Q2
2.05 GB Download
Ninja-v1-NSFW-128k-IQ2_XXS.gguf
LFS Q2
1.85 GB Download
Ninja-v1-NSFW-128k-IQ3_M.gguf
LFS Q3
3.06 GB Download
Ninja-v1-NSFW-128k-IQ3_S.gguf
LFS Q3
2.96 GB Download
Ninja-v1-NSFW-128k-IQ3_XS.gguf
LFS Q3
2.81 GB Download
Ninja-v1-NSFW-128k-IQ3_XXS.gguf
LFS Q3
2.63 GB Download
Ninja-v1-NSFW-128k-IQ4_NL.gguf
LFS Q4
3.84 GB Download
Ninja-v1-NSFW-128k-IQ4_XS.gguf
LFS Q4
3.64 GB Download
Ninja-v1-NSFW-128k-Q2_K.gguf
LFS Q2
2.53 GB Download
Ninja-v1-NSFW-128k-Q3_K_L.gguf
LFS Q3
3.56 GB Download
Ninja-v1-NSFW-128k-Q3_K_M.gguf
LFS Q3
3.28 GB Download
Ninja-v1-NSFW-128k-Q3_K_S.gguf
LFS Q3
2.95 GB Download
Ninja-v1-NSFW-128k-Q4_0.gguf
Recommended LFS Q4
3.83 GB Download
Ninja-v1-NSFW-128k-Q4_K_M.gguf
LFS Q4
4.07 GB Download
Ninja-v1-NSFW-128k-Q4_K_S.gguf
LFS Q4
3.86 GB Download
Ninja-v1-NSFW-128k-Q5_0.gguf
LFS Q5
4.65 GB Download
Ninja-v1-NSFW-128k-Q5_K_M.gguf
LFS Q5
4.78 GB Download
Ninja-v1-NSFW-128k-Q5_K_S.gguf
LFS Q5
4.65 GB Download
Ninja-v1-NSFW-128k-Q6_K.gguf
LFS Q6
5.53 GB Download
Ninja-v1-NSFW-128k-Q8_0.gguf
LFS Q8
7.17 GB Download