πŸ“‹ Model Description


base_model: sentence-transformers/all-MiniLM-L6-v2 license: apache-2.0 inference: false model_creator: Sentence Transformers model_name: all-MiniLM-L6-v2 quantized_by: Leliuga pipeline_tag: sentence-similarity tags: - bert - sentence-transformers - feature-extraction - sentence-similarity - transformers - gguf language: - en datasets: - s2orc - flax-sentence-embeddings/stackexchange_xml - ms_marco - gooaq - yahooanswerstopics - codesearchnet - search_qa - eli5 - snli - multi_nli - wikihow - natural_questions - trivia_qa - embedding-data/sentence-compression - embedding-data/flickr30k-captions - embedding-data/altlex - embedding-data/simple-wiki - embedding-data/QQP - embedding-data/SPECTER - embedding-data/PAQ_pairs - embedding-data/WikiAnswers

all-MiniLM-L6-v2 - GGUF

Description

This repo contains GGUF format model files for all-MiniLM-L6-v2.

πŸ“‚ GGUF File List

πŸ“ Filename πŸ“¦ Size ⚑ Download
all-MiniLM-L6-v2.F16.gguf
LFS FP16
43.82 MB Download
all-MiniLM-L6-v2.F32.gguf
LFS
86.8 MB Download
all-MiniLM-L6-v2.Q2_K.gguf
LFS Q2
18.34 MB Download
all-MiniLM-L6-v2.Q3_K_L.gguf
LFS Q3
19.53 MB Download
all-MiniLM-L6-v2.Q3_K_M.gguf
LFS Q3
19.02 MB Download
all-MiniLM-L6-v2.Q3_K_S.gguf
LFS Q3
18.34 MB Download
all-MiniLM-L6-v2.Q4_0.gguf
Recommended LFS Q4
18.79 MB Download
all-MiniLM-L6-v2.Q4_K_M.gguf
LFS Q4
20.03 MB Download
all-MiniLM-L6-v2.Q4_K_S.gguf
LFS Q4
19.74 MB Download
all-MiniLM-L6-v2.Q5_0.gguf
LFS Q5
20.05 MB Download
all-MiniLM-L6-v2.Q5_K_M.gguf
LFS Q5
20.71 MB Download
all-MiniLM-L6-v2.Q5_K_S.gguf
LFS Q5
20.47 MB Download
all-MiniLM-L6-v2.Q6_K.gguf
LFS Q6
23.03 MB Download
all-MiniLM-L6-v2.Q8_0.gguf
LFS Q8
23.85 MB Download