πŸ“‹ Model Description

Quantization made by Richard Erkhov.

Github

Discord

Request more models

L3-8B-Helium3-baseStheno - GGUF

  • Model creator: https://huggingface.co/inflatebot/
  • Original model: https://huggingface.co/inflatebot/L3-8B-Helium3-baseStheno/

NameQuant methodSize
L3-8B-Helium3-baseStheno.Q2K.ggufQ2K2.96GB
L3-8B-Helium3-baseStheno.IQ3XS.ggufIQ3XS3.28GB
L3-8B-Helium3-baseStheno.IQ3S.ggufIQ3S3.43GB
L3-8B-Helium3-baseStheno.Q3KS.ggufQ3K_S3.41GB
L3-8B-Helium3-baseStheno.IQ3M.ggufIQ3M3.52GB
L3-8B-Helium3-baseStheno.Q3K.ggufQ3K3.74GB
L3-8B-Helium3-baseStheno.Q3KM.ggufQ3K_M3.74GB
L3-8B-Helium3-baseStheno.Q3KL.ggufQ3K_L4.03GB
L3-8B-Helium3-baseStheno.IQ4XS.ggufIQ4XS4.18GB
L3-8B-Helium3-baseStheno.Q40.ggufQ404.34GB
L3-8B-Helium3-baseStheno.IQ4NL.ggufIQ4NL4.38GB
L3-8B-Helium3-baseStheno.Q4KS.ggufQ4K_S4.37GB
L3-8B-Helium3-baseStheno.Q4K.ggufQ4K4.58GB
L3-8B-Helium3-baseStheno.Q4KM.ggufQ4K_M4.58GB
L3-8B-Helium3-baseStheno.Q41.ggufQ414.78GB
L3-8B-Helium3-baseStheno.Q50.ggufQ505.21GB
L3-8B-Helium3-baseStheno.Q5KS.ggufQ5K_S5.21GB
L3-8B-Helium3-baseStheno.Q5K.ggufQ5K5.34GB
L3-8B-Helium3-baseStheno.Q5KM.ggufQ5K_M5.34GB
L3-8B-Helium3-baseStheno.Q51.ggufQ515.65GB
L3-8B-Helium3-baseStheno.Q6K.ggufQ6K6.14GB
L3-8B-Helium3-baseStheno.Q80.ggufQ807.95GB

Original model description:



base_model:
  • inflatebot/helide-beta-r0
  • inflatebot/helide-beta-r4
  • Sao10K/L3-8B-Stheno-v3.2
  • inflatebot/helide-beta-r1

library_name: transformers
tags:
  • mergekit
  • merge


helium-3-r5

This is a merge of pre-trained language models created using mergekit.

Merge Details

Helium3, but the base is Stheno. A bit stupid. If Helium3-baseLlama is too dry and regular Helium3 is too horny, this might be a good middle ground.
Emphasis on "might."

GGUFs by mradermacher

Merge Method

This model was merged using the Model Stock merge method using Sao10K/L3-8B-Stheno-v3.2 as a base.

Models Merged

The following models were included in the merge:

Configuration

The following YAML configuration was used to produce this model:

models:
  - model: inflatebot/helide-beta-r4
  - model: inflatebot/helide-beta-r1
  - model: inflatebot/helide-beta-r0

mergemethod: modelstock
base_model: Sao10K/L3-8B-Stheno-v3.2
dtype: bfloat16

πŸ“‚ GGUF File List

πŸ“ Filename πŸ“¦ Size ⚑ Download
L3-8B-Helium3-baseStheno.IQ3_M.gguf
LFS Q3
3.52 GB Download
L3-8B-Helium3-baseStheno.IQ3_S.gguf
LFS Q3
3.43 GB Download
L3-8B-Helium3-baseStheno.IQ3_XS.gguf
LFS Q3
3.28 GB Download
L3-8B-Helium3-baseStheno.IQ4_NL.gguf
LFS Q4
4.38 GB Download
L3-8B-Helium3-baseStheno.IQ4_XS.gguf
LFS Q4
4.18 GB Download
L3-8B-Helium3-baseStheno.Q2_K.gguf
LFS Q2
2.96 GB Download
L3-8B-Helium3-baseStheno.Q3_K.gguf
LFS Q3
3.74 GB Download
L3-8B-Helium3-baseStheno.Q3_K_L.gguf
LFS Q3
4.03 GB Download
L3-8B-Helium3-baseStheno.Q3_K_M.gguf
LFS Q3
3.74 GB Download
L3-8B-Helium3-baseStheno.Q3_K_S.gguf
LFS Q3
3.41 GB Download
L3-8B-Helium3-baseStheno.Q4_0.gguf
Recommended LFS Q4
4.34 GB Download
L3-8B-Helium3-baseStheno.Q4_1.gguf
LFS Q4
4.78 GB Download
L3-8B-Helium3-baseStheno.Q4_K.gguf
LFS Q4
4.58 GB Download
L3-8B-Helium3-baseStheno.Q4_K_M.gguf
LFS Q4
4.58 GB Download
L3-8B-Helium3-baseStheno.Q4_K_S.gguf
LFS Q4
4.37 GB Download
L3-8B-Helium3-baseStheno.Q5_0.gguf
LFS Q5
5.21 GB Download
L3-8B-Helium3-baseStheno.Q5_1.gguf
LFS Q5
5.65 GB Download
L3-8B-Helium3-baseStheno.Q5_K.gguf
LFS Q5
5.34 GB Download
L3-8B-Helium3-baseStheno.Q5_K_M.gguf
LFS Q5
5.34 GB Download
L3-8B-Helium3-baseStheno.Q5_K_S.gguf
LFS Q5
5.21 GB Download
L3-8B-Helium3-baseStheno.Q6_K.gguf
LFS Q6
6.14 GB Download
L3-8B-Helium3-baseStheno.Q8_0.gguf
LFS Q8
7.95 GB Download