πŸ“‹ Model Description

No documentation available

πŸ“‚ GGUF File List

πŸ“ Filename πŸ“¦ Size ⚑ Download
Seed-OSS-36B-Instruct-abliterated.i1-IQ1_M.gguf
LFS
8.15 GB Download
Seed-OSS-36B-Instruct-abliterated.i1-IQ1_S.gguf
LFS
7.5 GB Download
Seed-OSS-36B-Instruct-abliterated.i1-IQ2_M.gguf
LFS Q2
11.68 GB Download
Seed-OSS-36B-Instruct-abliterated.i1-IQ2_S.gguf
LFS Q2
10.82 GB Download
Seed-OSS-36B-Instruct-abliterated.i1-IQ2_XS.gguf
LFS Q2
10.19 GB Download
Seed-OSS-36B-Instruct-abliterated.i1-IQ2_XXS.gguf
LFS Q2
9.23 GB Download
Seed-OSS-36B-Instruct-abliterated.i1-IQ3_M.gguf
LFS Q3
15.36 GB Download
Seed-OSS-36B-Instruct-abliterated.i1-IQ3_S.gguf
LFS Q3
14.81 GB Download
Seed-OSS-36B-Instruct-abliterated.i1-IQ3_XS.gguf
LFS Q3
14.05 GB Download
Seed-OSS-36B-Instruct-abliterated.i1-IQ3_XXS.gguf
LFS Q3
13.15 GB Download
Seed-OSS-36B-Instruct-abliterated.i1-IQ4_XS.gguf
LFS Q4
18.16 GB Download
Seed-OSS-36B-Instruct-abliterated.i1-Q2_K.gguf
LFS Q2
12.67 GB Download
Seed-OSS-36B-Instruct-abliterated.i1-Q2_K_S.gguf
LFS Q2
11.74 GB Download
Seed-OSS-36B-Instruct-abliterated.i1-Q3_K_L.gguf
LFS Q3
17.83 GB Download
Seed-OSS-36B-Instruct-abliterated.i1-Q3_K_M.gguf
LFS Q3
16.41 GB Download
Seed-OSS-36B-Instruct-abliterated.i1-Q3_K_S.gguf
LFS Q3
14.77 GB Download
Seed-OSS-36B-Instruct-abliterated.i1-Q4_0.gguf
Recommended LFS Q4
19.21 GB Download
Seed-OSS-36B-Instruct-abliterated.i1-Q4_1.gguf
LFS Q4
21.2 GB Download
Seed-OSS-36B-Instruct-abliterated.i1-Q4_K_M.gguf
LFS Q4
20.27 GB Download
Seed-OSS-36B-Instruct-abliterated.i1-Q4_K_S.gguf
LFS Q4
19.27 GB Download
Seed-OSS-36B-Instruct-abliterated.i1-Q5_K_M.gguf
LFS Q5
23.84 GB Download
Seed-OSS-36B-Instruct-abliterated.i1-Q5_K_S.gguf
LFS Q5
23.26 GB Download
Seed-OSS-36B-Instruct-abliterated.i1-Q6_K.gguf
LFS Q6
27.63 GB Download
Seed-OSS-36B-Instruct-abliterated.imatrix.gguf
LFS
15.57 MB Download