πŸ“‹ Model Description

Quantization made by Richard Erkhov.

Github

Discord

Request more models

OPEN-SOLAR-KO-10.7B-S-Core - GGUF

  • Model creator: https://huggingface.co/refarde/
  • Original model: https://huggingface.co/refarde/OPEN-SOLAR-KO-10.7B-S-Core/

NameQuant methodSize
OPEN-SOLAR-KO-10.7B-S-Core.Q2K.ggufQ2K3.79GB
OPEN-SOLAR-KO-10.7B-S-Core.IQ3XS.ggufIQ3XS4.21GB
OPEN-SOLAR-KO-10.7B-S-Core.IQ3S.ggufIQ3S4.44GB
OPEN-SOLAR-KO-10.7B-S-Core.Q3KS.ggufQ3K_S4.41GB
OPEN-SOLAR-KO-10.7B-S-Core.IQ3M.ggufIQ3M4.58GB
OPEN-SOLAR-KO-10.7B-S-Core.Q3K.ggufQ3K4.91GB
OPEN-SOLAR-KO-10.7B-S-Core.Q3KM.ggufQ3K_M4.91GB
OPEN-SOLAR-KO-10.7B-S-Core.Q3KL.ggufQ3K_L5.33GB
OPEN-SOLAR-KO-10.7B-S-Core.IQ4XS.ggufIQ4XS5.5GB
OPEN-SOLAR-KO-10.7B-S-Core.Q40.ggufQ405.73GB
OPEN-SOLAR-KO-10.7B-S-Core.IQ4NL.ggufIQ4NL5.8GB
OPEN-SOLAR-KO-10.7B-S-Core.Q4KS.ggufQ4K_S5.78GB
OPEN-SOLAR-KO-10.7B-S-Core.Q4K.ggufQ4K6.1GB
OPEN-SOLAR-KO-10.7B-S-Core.Q4KM.ggufQ4K_M6.1GB
OPEN-SOLAR-KO-10.7B-S-Core.Q41.ggufQ416.35GB
OPEN-SOLAR-KO-10.7B-S-Core.Q50.ggufQ506.97GB
OPEN-SOLAR-KO-10.7B-S-Core.Q5KS.ggufQ5K_S6.97GB
OPEN-SOLAR-KO-10.7B-S-Core.Q5K.ggufQ5K7.16GB
OPEN-SOLAR-KO-10.7B-S-Core.Q5KM.ggufQ5K_M7.16GB
OPEN-SOLAR-KO-10.7B-S-Core.Q51.ggufQ517.59GB
OPEN-SOLAR-KO-10.7B-S-Core.Q6K.ggufQ6K8.29GB
OPEN-SOLAR-KO-10.7B-S-Core.Q80.ggufQ8010.74GB

Original model description:



base_model: beomi/OPEN-SOLAR-KO-10.7B
license: apache-2.0
pipeline_tag: text-generation
language:
- en
- ko
tags:
- finetuned
- text-generation
datasets:
- royboy0416/ko-alpaca
inference: false
model_type: mixtral


Model Card for OPEN-SOLAR-KO-10.7B-S-Core

Model Details

Dataset Details

Used Datasets

  • royboy0416/ko-alpaca

πŸ“‚ GGUF File List

πŸ“ Filename πŸ“¦ Size ⚑ Download
OPEN-SOLAR-KO-10.7B-S-Core.IQ3_M.gguf
LFS Q3
4.58 GB Download
OPEN-SOLAR-KO-10.7B-S-Core.IQ3_S.gguf
LFS Q3
4.44 GB Download
OPEN-SOLAR-KO-10.7B-S-Core.IQ3_XS.gguf
LFS Q3
4.21 GB Download
OPEN-SOLAR-KO-10.7B-S-Core.IQ4_NL.gguf
LFS Q4
5.8 GB Download
OPEN-SOLAR-KO-10.7B-S-Core.IQ4_XS.gguf
LFS Q4
5.5 GB Download
OPEN-SOLAR-KO-10.7B-S-Core.Q2_K.gguf
LFS Q2
3.79 GB Download
OPEN-SOLAR-KO-10.7B-S-Core.Q3_K.gguf
LFS Q3
4.91 GB Download
OPEN-SOLAR-KO-10.7B-S-Core.Q3_K_L.gguf
LFS Q3
5.33 GB Download
OPEN-SOLAR-KO-10.7B-S-Core.Q3_K_M.gguf
LFS Q3
4.91 GB Download
OPEN-SOLAR-KO-10.7B-S-Core.Q3_K_S.gguf
LFS Q3
4.41 GB Download
OPEN-SOLAR-KO-10.7B-S-Core.Q4_0.gguf
Recommended LFS Q4
5.73 GB Download
OPEN-SOLAR-KO-10.7B-S-Core.Q4_1.gguf
LFS Q4
6.35 GB Download
OPEN-SOLAR-KO-10.7B-S-Core.Q4_K.gguf
LFS Q4
6.1 GB Download
OPEN-SOLAR-KO-10.7B-S-Core.Q4_K_M.gguf
LFS Q4
6.1 GB Download
OPEN-SOLAR-KO-10.7B-S-Core.Q4_K_S.gguf
LFS Q4
5.78 GB Download
OPEN-SOLAR-KO-10.7B-S-Core.Q5_0.gguf
LFS Q5
6.97 GB Download
OPEN-SOLAR-KO-10.7B-S-Core.Q5_1.gguf
LFS Q5
7.59 GB Download
OPEN-SOLAR-KO-10.7B-S-Core.Q5_K.gguf
LFS Q5
7.16 GB Download
OPEN-SOLAR-KO-10.7B-S-Core.Q5_K_M.gguf
LFS Q5
7.16 GB Download
OPEN-SOLAR-KO-10.7B-S-Core.Q5_K_S.gguf
LFS Q5
6.97 GB Download
OPEN-SOLAR-KO-10.7B-S-Core.Q6_K.gguf
LFS Q6
8.29 GB Download
OPEN-SOLAR-KO-10.7B-S-Core.Q8_0.gguf
LFS Q8
10.74 GB Download