πŸ“‹ Model Description

Quantization made by Richard Erkhov.

Github

Discord

Request more models

OpenMia-Indo-Mistral-7b-v3 - GGUF

  • Model creator: https://huggingface.co/indischepartij/
  • Original model: https://huggingface.co/indischepartij/OpenMia-Indo-Mistral-7b-v3/

NameQuant methodSize
OpenMia-Indo-Mistral-7b-v3.Q2K.ggufQ2K2.53GB
OpenMia-Indo-Mistral-7b-v3.IQ3XS.ggufIQ3XS2.81GB
OpenMia-Indo-Mistral-7b-v3.IQ3S.ggufIQ3S2.96GB
OpenMia-Indo-Mistral-7b-v3.Q3KS.ggufQ3K_S2.95GB
OpenMia-Indo-Mistral-7b-v3.IQ3M.ggufIQ3M3.06GB
OpenMia-Indo-Mistral-7b-v3.Q3K.ggufQ3K3.28GB
OpenMia-Indo-Mistral-7b-v3.Q3KM.ggufQ3K_M3.28GB
OpenMia-Indo-Mistral-7b-v3.Q3KL.ggufQ3K_L3.56GB
OpenMia-Indo-Mistral-7b-v3.IQ4XS.ggufIQ4XS3.67GB
OpenMia-Indo-Mistral-7b-v3.Q40.ggufQ403.83GB
OpenMia-Indo-Mistral-7b-v3.IQ4NL.ggufIQ4NL3.87GB
OpenMia-Indo-Mistral-7b-v3.Q4KS.ggufQ4K_S3.86GB
OpenMia-Indo-Mistral-7b-v3.Q4K.ggufQ4K4.07GB
OpenMia-Indo-Mistral-7b-v3.Q4KM.ggufQ4K_M4.07GB
OpenMia-Indo-Mistral-7b-v3.Q41.ggufQ414.24GB
OpenMia-Indo-Mistral-7b-v3.Q50.ggufQ504.65GB
OpenMia-Indo-Mistral-7b-v3.Q5KS.ggufQ5K_S4.65GB
OpenMia-Indo-Mistral-7b-v3.Q5K.ggufQ5K4.78GB
OpenMia-Indo-Mistral-7b-v3.Q5KM.ggufQ5K_M4.78GB
OpenMia-Indo-Mistral-7b-v3.Q51.ggufQ515.07GB
OpenMia-Indo-Mistral-7b-v3.Q6K.ggufQ6K5.53GB
OpenMia-Indo-Mistral-7b-v3.Q80.ggufQ807.17GB

Original model description:



language:
  • en
  • id

license: cc-by-nc-4.0
tags:
  • text-generation-inference
  • transformers
  • mistral
  • trl

datasets:
  • cahya/alpaca-id-cleaned

base_model: mistral-7b
model-index:
  • name: OpenMia-Indo-Mistral-7b-v3

results:
- task:
type: text-generation
name: Text Generation
dataset:
name: AI2 Reasoning Challenge (25-Shot)
type: ai2_arc
config: ARC-Challenge
split: test
args:
numfewshot: 25
metrics:
- type: acc_norm
value: 66.13
name: normalized accuracy
source:
url: https://huggingface.co/spaces/HuggingFaceH4/openllmleaderboard?query=gmonsoon/OpenMia-Indo-Mistral-7b-v3
name: Open LLM Leaderboard
- task:
type: text-generation
name: Text Generation
dataset:
name: HellaSwag (10-Shot)
type: hellaswag
split: validation
args:
numfewshot: 10
metrics:
- type: acc_norm
value: 85.47
name: normalized accuracy
source:
url: https://huggingface.co/spaces/HuggingFaceH4/openllmleaderboard?query=gmonsoon/OpenMia-Indo-Mistral-7b-v3
name: Open LLM Leaderboard
- task:
type: text-generation
name: Text Generation
dataset:
name: MMLU (5-Shot)
type: cais/mmlu
config: all
split: test
args:
numfewshot: 5
metrics:
- type: acc
value: 64.03
name: accuracy
source:
url: https://huggingface.co/spaces/HuggingFaceH4/openllmleaderboard?query=gmonsoon/OpenMia-Indo-Mistral-7b-v3
name: Open LLM Leaderboard
- task:
type: text-generation
name: Text Generation
dataset:
name: TruthfulQA (0-shot)
type: truthful_qa
config: multiple_choice
split: validation
args:
numfewshot: 0
metrics:
- type: mc2
value: 60.05
source:
url: https://huggingface.co/spaces/HuggingFaceH4/openllmleaderboard?query=gmonsoon/OpenMia-Indo-Mistral-7b-v3
name: Open LLM Leaderboard
- task:
type: text-generation
name: Text Generation
dataset:
name: Winogrande (5-shot)
type: winogrande
config: winogrande_xl
split: validation
args:
numfewshot: 5
metrics:
- type: acc
value: 82.95
name: accuracy
source:
url: https://huggingface.co/spaces/HuggingFaceH4/openllmleaderboard?query=gmonsoon/OpenMia-Indo-Mistral-7b-v3
name: Open LLM Leaderboard
- task:
type: text-generation
name: Text Generation
dataset:
name: GSM8k (5-shot)
type: gsm8k
config: main
split: test
args:
numfewshot: 5
metrics:
- type: acc
value: 67.63
name: accuracy
source:
url: https://huggingface.co/spaces/HuggingFaceH4/openllmleaderboard?query=gmonsoon/OpenMia-Indo-Mistral-7b-v3
name: Open LLM Leaderboard

!image/png

updated to V3-refined, see: https://huggingface.co/indischepartij/OpenMia-Indo-Mistral-7b-v3-refined

Open LLM Leaderboard

!image/png

MIA : (M)istral finetuned with (I)ndonesia language from (A)lpaca dataset

(formerly named Mistral-7b-Alpaca-Indonesia)

OpenMia-Indo-Mistral-7b-v2 is finetuned model based of Mistral-7b with capability to do conversation in Bahasa Indonesia.

Due to limited resources, this model is still in alpha stage.

Want to contribute to this project? join our organization: https://huggingface.co/indischepartij or contact me at https://twitter.com/gmonsooniii

Modelfile/Prompt format

SYSTEM You are a caring and empathetic sentient AI companion named Mia.

PARAMETER stop <|im_start|>
PARAMETER stop <|im_end|>

TEMPLATE <|imstart|>system {{ .System }}<|imend|> <|imstart|>user {{ .Prompt }}<|imend|> <|im_start|>assistant


Open LLM Leaderboard Evaluation Results


Detailed results can be found here

MetricValue
Avg.71.04
AI2 Reasoning Challenge (25-Shot)66.13
HellaSwag (10-Shot)85.47
MMLU (5-Shot)64.03
TruthfulQA (0-shot)60.05
Winogrande (5-shot)82.95
GSM8k (5-shot)67.63

πŸ“‚ GGUF File List

πŸ“ Filename πŸ“¦ Size ⚑ Download
OpenMia-Indo-Mistral-7b-v3.IQ3_M.gguf
LFS Q3
3.06 GB Download
OpenMia-Indo-Mistral-7b-v3.IQ3_S.gguf
LFS Q3
2.96 GB Download
OpenMia-Indo-Mistral-7b-v3.IQ3_XS.gguf
LFS Q3
2.81 GB Download
OpenMia-Indo-Mistral-7b-v3.IQ4_NL.gguf
LFS Q4
3.87 GB Download
OpenMia-Indo-Mistral-7b-v3.IQ4_XS.gguf
LFS Q4
3.67 GB Download
OpenMia-Indo-Mistral-7b-v3.Q2_K.gguf
LFS Q2
2.53 GB Download
OpenMia-Indo-Mistral-7b-v3.Q3_K.gguf
LFS Q3
3.28 GB Download
OpenMia-Indo-Mistral-7b-v3.Q3_K_L.gguf
LFS Q3
3.56 GB Download
OpenMia-Indo-Mistral-7b-v3.Q3_K_M.gguf
LFS Q3
3.28 GB Download
OpenMia-Indo-Mistral-7b-v3.Q3_K_S.gguf
LFS Q3
2.95 GB Download
OpenMia-Indo-Mistral-7b-v3.Q4_0.gguf
Recommended LFS Q4
3.83 GB Download
OpenMia-Indo-Mistral-7b-v3.Q4_1.gguf
LFS Q4
4.24 GB Download
OpenMia-Indo-Mistral-7b-v3.Q4_K.gguf
LFS Q4
4.07 GB Download
OpenMia-Indo-Mistral-7b-v3.Q4_K_M.gguf
LFS Q4
4.07 GB Download
OpenMia-Indo-Mistral-7b-v3.Q4_K_S.gguf
LFS Q4
3.86 GB Download
OpenMia-Indo-Mistral-7b-v3.Q5_0.gguf
LFS Q5
4.65 GB Download
OpenMia-Indo-Mistral-7b-v3.Q5_1.gguf
LFS Q5
5.07 GB Download
OpenMia-Indo-Mistral-7b-v3.Q5_K.gguf
LFS Q5
4.78 GB Download
OpenMia-Indo-Mistral-7b-v3.Q5_K_M.gguf
LFS Q5
4.78 GB Download
OpenMia-Indo-Mistral-7b-v3.Q5_K_S.gguf
LFS Q5
4.65 GB Download
OpenMia-Indo-Mistral-7b-v3.Q6_K.gguf
LFS Q6
5.53 GB Download
OpenMia-Indo-Mistral-7b-v3.Q8_0.gguf
LFS Q8
7.17 GB Download