π Model Description
No documentation available
π GGUF File List
π Filename | π¦ Size | β‘ Download |
---|---|---|
gemma-2-9b-it-abliterated-IQ2_M.gguf
LFS
Q2
|
3.2 GB | Download |
gemma-2-9b-it-abliterated-IQ3_M.gguf
LFS
Q3
|
4.19 GB | Download |
gemma-2-9b-it-abliterated-IQ3_XS.gguf
LFS
Q3
|
3.86 GB | Download |
gemma-2-9b-it-abliterated-IQ4_XS.gguf
LFS
Q4
|
4.83 GB | Download |
gemma-2-9b-it-abliterated-Q2_K.gguf
LFS
Q2
|
3.54 GB | Download |
gemma-2-9b-it-abliterated-Q2_K_L.gguf
LFS
Q2
|
3.75 GB | Download |
gemma-2-9b-it-abliterated-Q3_K_L.gguf
LFS
Q3
|
4.78 GB | Download |
gemma-2-9b-it-abliterated-Q3_K_M.gguf
LFS
Q3
|
4.43 GB | Download |
gemma-2-9b-it-abliterated-Q3_K_S.gguf
LFS
Q3
|
4.04 GB | Download |
gemma-2-9b-it-abliterated-Q3_K_XL.gguf
LFS
Q3
|
4.99 GB | Download |
gemma-2-9b-it-abliterated-Q4_0.gguf
Recommended
LFS
Q4
|
5.08 GB | Download |
gemma-2-9b-it-abliterated-Q4_0_4_4.gguf
LFS
Q4
|
5.07 GB | Download |
gemma-2-9b-it-abliterated-Q4_0_4_8.gguf
LFS
Q4
|
5.07 GB | Download |
gemma-2-9b-it-abliterated-Q4_0_8_8.gguf
LFS
Q4
|
5.07 GB | Download |
gemma-2-9b-it-abliterated-Q4_K_L.gguf
LFS
Q4
|
5.57 GB | Download |
gemma-2-9b-it-abliterated-Q4_K_M.gguf
LFS
Q4
|
5.37 GB | Download |
gemma-2-9b-it-abliterated-Q4_K_S.gguf
LFS
Q4
|
5.1 GB | Download |
gemma-2-9b-it-abliterated-Q5_K_L.gguf
LFS
Q5
|
6.4 GB | Download |
gemma-2-9b-it-abliterated-Q5_K_M.gguf
LFS
Q5
|
6.19 GB | Download |
gemma-2-9b-it-abliterated-Q5_K_S.gguf
LFS
Q5
|
6.04 GB | Download |
gemma-2-9b-it-abliterated-Q6_K.gguf
LFS
Q6
|
7.07 GB | Download |
gemma-2-9b-it-abliterated-Q6_K_L.gguf
LFS
Q6
|
7.27 GB | Download |
gemma-2-9b-it-abliterated-Q8_0.gguf
LFS
Q8
|
9.15 GB | Download |
gemma-2-9b-it-abliterated-f32.gguf
LFS
|
34.43 GB | Download |