RichardErkhov/mistral-community_-_Mistral-7B-v0.2-gguf

Quantization made by Richard Erkhov.

Github

Discord

Request more models

Mistral-7B-v0.2 - GGUF

• Model creator: https://huggingface.co/mistral-community/
• Original model: https://huggingface.co/mistral-community/Mistral-7B-v0.2/

Original model description:

1. Download original weights from https://models.mistralcdn.com/mistral-7b-v0-2/mistral-7B-v0.2.tar
2. Convert with https://github.com/huggingface/transformers/blob/main/src/transformers/models/mistral/convertmistralweightstohf.py
3. You may need to copy the tokenizer.model from Mistral-7B-Instruct-v0.2 repo.