πŸ“‹ Model Description

Quantization made by Richard Erkhov.

Github

Discord

Request more models

berg1 - GGUF

  • Model creator: https://huggingface.co/Sakalti/
  • Original model: https://huggingface.co/Sakalti/berg1/

NameQuant methodSize
berg1.Q2K.ggufQ2K0.01GB
berg1.IQ3XS.ggufIQ3XS0.01GB
berg1.IQ3S.ggufIQ3S0.01GB
berg1.Q3KS.ggufQ3K_S0.01GB
berg1.IQ3M.ggufIQ3M0.01GB
berg1.Q3K.ggufQ3K0.01GB
berg1.Q3KM.ggufQ3K_M0.01GB
berg1.Q3KL.ggufQ3K_L0.01GB
berg1.IQ4XS.ggufIQ4XS0.01GB
berg1.Q40.ggufQ400.01GB
berg1.IQ4NL.ggufIQ4NL0.01GB
berg1.Q4KS.ggufQ4K_S0.01GB
berg1.Q4K.ggufQ4K0.01GB
berg1.Q4KM.ggufQ4K_M0.01GB
berg1.Q41.ggufQ410.01GB
berg1.Q50.ggufQ500.01GB
berg1.Q5KS.ggufQ5K_S0.01GB
berg1.Q5K.ggufQ5K0.01GB
berg1.Q5KM.ggufQ5K_M0.01GB
berg1.Q51.ggufQ510.01GB
berg1.Q6K.ggufQ6K0.01GB
berg1.Q80.ggufQ800.01GB

Original model description:



base_model:
  • Qwen/Qwen2.5-Math-1.5B-Instruct
  • Qwen/Qwen2.5-Coder-1.5B-Instruct
  • Goekdeniz-Guelmez/Josiefied-Qwen2.5-1.5B-Instruct-abliterated-v1
  • Qwen/Qwen2.5-1.5B-Instruct

library_name: transformers
tags:
  • mergekit
  • merge


merge

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the Model Stock merge method using Qwen/Qwen2.5-1.5B-Instruct as a base.

Models Merged

The following models were included in the merge:

Configuration

The following YAML configuration was used to produce this model:

models:
  - model: Qwen/Qwen2.5-Coder-1.5B-Instruct
  - model: Qwen/Qwen2.5-1.5B-Instruct
  - model: Qwen/Qwen2.5-Math-1.5B-Instruct
  - model: Goekdeniz-Guelmez/Josiefied-Qwen2.5-1.5B-Instruct-abliterated-v1
mergemethod: modelstock
base_model: Qwen/Qwen2.5-1.5B-Instruct
dtype: float16

πŸ“‚ GGUF File List

πŸ“ Filename πŸ“¦ Size ⚑ Download
berg1.IQ3_M.gguf
LFS Q3
5.68 MB Download
berg1.IQ3_S.gguf
LFS Q3
5.68 MB Download
berg1.IQ3_XS.gguf
LFS Q3
5.68 MB Download
berg1.IQ4_NL.gguf
LFS Q4
5.68 MB Download
berg1.IQ4_XS.gguf
LFS Q4
5.68 MB Download
berg1.Q2_K.gguf
LFS Q2
5.68 MB Download
berg1.Q3_K.gguf
LFS Q3
5.68 MB Download
berg1.Q3_K_L.gguf
LFS Q3
5.68 MB Download
berg1.Q3_K_M.gguf
LFS Q3
5.68 MB Download
berg1.Q3_K_S.gguf
LFS Q3
5.68 MB Download
berg1.Q4_0.gguf
Recommended LFS Q4
5.68 MB Download
berg1.Q4_1.gguf
LFS Q4
5.68 MB Download
berg1.Q4_K.gguf
LFS Q4
5.68 MB Download
berg1.Q4_K_M.gguf
LFS Q4
5.68 MB Download
berg1.Q4_K_S.gguf
LFS Q4
5.68 MB Download
berg1.Q5_0.gguf
LFS Q5
5.68 MB Download
berg1.Q5_1.gguf
LFS Q5
5.68 MB Download
berg1.Q5_K.gguf
LFS Q5
5.68 MB Download
berg1.Q5_K_M.gguf
LFS Q5
5.68 MB Download
berg1.Q5_K_S.gguf
LFS Q5
5.68 MB Download
berg1.Q6_K.gguf
LFS Q6
5.68 MB Download
berg1.Q8_0.gguf
LFS Q8
5.68 MB Download