π Model Description
No documentation available
π GGUF File List
| π Filename | π¦ Size | β‘ Download |
|---|---|---|
|
all-MiniLM-L12-v2.F16.gguf
LFS
FP16
|
64.19 MB | Download |
|
all-MiniLM-L12-v2.F32.gguf
LFS
|
127.42 MB | Download |
|
all-MiniLM-L12-v2.Q2_K.gguf
LFS
Q2
|
23.71 MB | Download |
|
all-MiniLM-L12-v2.Q3_K_L.gguf
LFS
Q3
|
26.08 MB | Download |
|
all-MiniLM-L12-v2.Q3_K_M.gguf
LFS
Q3
|
25.11 MB | Download |
|
all-MiniLM-L12-v2.Q3_K_S.gguf
LFS
Q3
|
23.71 MB | Download |
|
all-MiniLM-L12-v2.Q4_0.gguf
Recommended
LFS
Q4
|
24.6 MB | Download |
|
all-MiniLM-L12-v2.Q4_K_M.gguf
LFS
Q4
|
27.48 MB | Download |
|
all-MiniLM-L12-v2.Q4_K_S.gguf
LFS
Q4
|
26.54 MB | Download |
|
all-MiniLM-L12-v2.Q5_0.gguf
LFS
Q5
|
27.13 MB | Download |
|
all-MiniLM-L12-v2.Q5_K_M.gguf
LFS
Q5
|
28.69 MB | Download |
|
all-MiniLM-L12-v2.Q5_K_S.gguf
LFS
Q5
|
27.98 MB | Download |
|
all-MiniLM-L12-v2.Q6_K.gguf
LFS
Q6
|
33.09 MB | Download |
|
all-MiniLM-L12-v2.Q8_0.gguf
LFS
Q8
|
34.73 MB | Download |