π Model Description
base_model: sentence-transformers/all-MiniLM-L6-v2 license: apache-2.0 inference: false model_creator: Sentence Transformers model_name: all-MiniLM-L6-v2 quantized_by: Leliuga pipeline_tag: sentence-similarity tags: - bert - sentence-transformers - feature-extraction - sentence-similarity - transformers - gguf language: - en datasets: - s2orc - flax-sentence-embeddings/stackexchange_xml - ms_marco - gooaq - yahooanswerstopics - codesearchnet - search_qa - eli5 - snli - multi_nli - wikihow - natural_questions - trivia_qa - embedding-data/sentence-compression - embedding-data/flickr30k-captions - embedding-data/altlex - embedding-data/simple-wiki - embedding-data/QQP - embedding-data/SPECTER - embedding-data/PAQ_pairs - embedding-data/WikiAnswers
all-MiniLM-L6-v2 - GGUF
- Model creator: Sentence Transformers
- Original model: all-MiniLM-L6-v2
Description
This repo contains GGUF format model files for all-MiniLM-L6-v2.
π GGUF File List
| π Filename | π¦ Size | β‘ Download |
|---|---|---|
|
all-MiniLM-L6-v2.F16.gguf
LFS
FP16
|
43.82 MB | Download |
|
all-MiniLM-L6-v2.F32.gguf
LFS
|
86.8 MB | Download |
|
all-MiniLM-L6-v2.Q2_K.gguf
LFS
Q2
|
18.34 MB | Download |
|
all-MiniLM-L6-v2.Q3_K_L.gguf
LFS
Q3
|
19.53 MB | Download |
|
all-MiniLM-L6-v2.Q3_K_M.gguf
LFS
Q3
|
19.02 MB | Download |
|
all-MiniLM-L6-v2.Q3_K_S.gguf
LFS
Q3
|
18.34 MB | Download |
|
all-MiniLM-L6-v2.Q4_0.gguf
Recommended
LFS
Q4
|
18.79 MB | Download |
|
all-MiniLM-L6-v2.Q4_K_M.gguf
LFS
Q4
|
20.03 MB | Download |
|
all-MiniLM-L6-v2.Q4_K_S.gguf
LFS
Q4
|
19.74 MB | Download |
|
all-MiniLM-L6-v2.Q5_0.gguf
LFS
Q5
|
20.05 MB | Download |
|
all-MiniLM-L6-v2.Q5_K_M.gguf
LFS
Q5
|
20.71 MB | Download |
|
all-MiniLM-L6-v2.Q5_K_S.gguf
LFS
Q5
|
20.47 MB | Download |
|
all-MiniLM-L6-v2.Q6_K.gguf
LFS
Q6
|
23.03 MB | Download |
|
all-MiniLM-L6-v2.Q8_0.gguf
LFS
Q8
|
23.85 MB | Download |