πŸ“‹ Model Description

Quantization made by Richard Erkhov.

Github

Discord

Request more models

Llama3-KALE-LM-Chem-1.5-8B - GGUF

  • Model creator: https://huggingface.co/USTC-KnowledgeComputingLab/
  • Original model: https://huggingface.co/USTC-KnowledgeComputingLab/Llama3-KALE-LM-Chem-1.5-8B/

NameQuant methodSize
Llama3-KALE-LM-Chem-1.5-8B.Q2K.ggufQ2K2.96GB
Llama3-KALE-LM-Chem-1.5-8B.IQ3XS.ggufIQ3XS3.28GB
Llama3-KALE-LM-Chem-1.5-8B.IQ3S.ggufIQ3S3.43GB
Llama3-KALE-LM-Chem-1.5-8B.Q3KS.ggufQ3K_S3.41GB
Llama3-KALE-LM-Chem-1.5-8B.IQ3M.ggufIQ3M3.52GB
Llama3-KALE-LM-Chem-1.5-8B.Q3K.ggufQ3K3.74GB
Llama3-KALE-LM-Chem-1.5-8B.Q3KM.ggufQ3K_M3.74GB
Llama3-KALE-LM-Chem-1.5-8B.Q3KL.ggufQ3K_L4.03GB
Llama3-KALE-LM-Chem-1.5-8B.IQ4XS.ggufIQ4XS4.18GB
Llama3-KALE-LM-Chem-1.5-8B.Q40.ggufQ404.34GB
Llama3-KALE-LM-Chem-1.5-8B.IQ4NL.ggufIQ4NL1.49GB
Llama3-KALE-LM-Chem-1.5-8B.Q4KS.ggufQ4K_S4.37GB
Llama3-KALE-LM-Chem-1.5-8B.Q4K.ggufQ4K4.58GB
Llama3-KALE-LM-Chem-1.5-8B.Q4KM.ggufQ4K_M4.58GB
Llama3-KALE-LM-Chem-1.5-8B.Q41.ggufQ414.78GB
Llama3-KALE-LM-Chem-1.5-8B.Q50.ggufQ505.21GB
Llama3-KALE-LM-Chem-1.5-8B.Q5KS.ggufQ5K_S5.21GB
Llama3-KALE-LM-Chem-1.5-8B.Q5K.ggufQ5K5.34GB
Llama3-KALE-LM-Chem-1.5-8B.Q5KM.ggufQ5K_M5.34GB
Llama3-KALE-LM-Chem-1.5-8B.Q51.ggufQ515.65GB
Llama3-KALE-LM-Chem-1.5-8B.Q6K.ggufQ6K6.14GB
Llama3-KALE-LM-Chem-1.5-8B.Q80.ggufQ807.95GB

Original model description:



license: llama3
language:
  • en

base_model:
  • meta-llama/Meta-Llama-3-8B-Instruct

tags:
  • KALE-LM
  • science
  • chemistry

pipeline_tag: text-generation

Llama3-KALE-LM-Chem-1.5-8B

Introduction

We are thrilled to present Llama3-KALE-LM-Chem-1.5-8B, a new version of our open-source KALE-LM for science, which specializes in chemistry.

We have trained our model with a larger amount of data.

Benchmarks

Open Benchmarks

ModelsChemBenchMMLUMMLU-ChemSciQIE(Acc)IE(LS)
GPT-3.547.1569.7553.3289.652.9868.28
GPT-453.7278.6763.7094.1054.2069.74
Llama3-8B-Instruct46.0268.351.1093.3045.8361.22
LlaSMol28.4754.4733.2472.302.163.23
ChemDFM44.4458.1145.6086.707.6111.49
ChemLLM-7B-Chat34.1661.7948.3994.0029.6639.17
ChemLLM-7B-Chat-1.5-SFT42.7563.5649.6395.1014.9619.61
Llama3-KALE-LM-Chem-1.5-8B57.0168.0654.8391.6057.5364.16
#### ChemBench Details (Evaluated By OpenCompass)
ModelsNCPPM2CC2MPPRSYPTPSPAverage
GPT-3.546.9356.9885.2838.2543.6742.3330.3342.573847.15
GPT-454.8265.0292.6452.8862.6752.6742.3324.7535.6753.72
Llama3-8B-Instruct51.3127.7990.3040.8834.0030.0045.3360.8933.6746.02
LlaSMol27.7829.3431.4423.3825.6724.0037.3334.6522.6728.47
ChemDFM36.9255.5783.9542.0040.0037.3339.0033.1732.0044.44
ChemLLM-7B-Chat41.0529.7685.2826.1226.0024.0020.0024.2631.0034.16
ChemLLM-7B-Chat-1.5-SFT50.0649.5185.2838.7538.0026.6728.3331.6833.6742.44
Llama3-KALE-LM-Chem-1.5-8B61.3343.4490.3053.6272.6753.6746.0047.0345.0057.01

Cite This Work

@article{dai2024kale,
  title={KALE-LM: Unleash The Power Of AI For Science Via Knowledge And Logic Enhanced Large Model},
  author={Dai, Weichen and Chen, Yezeng and Dai, Zijie and Huang, Zhijie and Liu, Yubo and Pan, Yixuan and Song, Baiyang and Zhong, Chengli and Li, Xinhe and Wang, Zeyu and others},
  journal={arXiv preprint arXiv:2409.18695},
  year={2024}
}

πŸ“‚ GGUF File List

πŸ“ Filename πŸ“¦ Size ⚑ Download
Llama3-KALE-LM-Chem-1.5-8B.IQ3_M.gguf
LFS Q3
3.52 GB Download
Llama3-KALE-LM-Chem-1.5-8B.IQ3_S.gguf
LFS Q3
3.43 GB Download
Llama3-KALE-LM-Chem-1.5-8B.IQ3_XS.gguf
LFS Q3
3.28 GB Download
Llama3-KALE-LM-Chem-1.5-8B.IQ4_NL.gguf
LFS Q4
1.49 GB Download
Llama3-KALE-LM-Chem-1.5-8B.IQ4_XS.gguf
LFS Q4
4.18 GB Download
Llama3-KALE-LM-Chem-1.5-8B.Q2_K.gguf
LFS Q2
2.96 GB Download
Llama3-KALE-LM-Chem-1.5-8B.Q3_K.gguf
LFS Q3
3.74 GB Download
Llama3-KALE-LM-Chem-1.5-8B.Q3_K_L.gguf
LFS Q3
4.03 GB Download
Llama3-KALE-LM-Chem-1.5-8B.Q3_K_M.gguf
LFS Q3
3.74 GB Download
Llama3-KALE-LM-Chem-1.5-8B.Q3_K_S.gguf
LFS Q3
3.41 GB Download
Llama3-KALE-LM-Chem-1.5-8B.Q4_0.gguf
Recommended LFS Q4
4.34 GB Download
Llama3-KALE-LM-Chem-1.5-8B.Q4_1.gguf
LFS Q4
4.78 GB Download
Llama3-KALE-LM-Chem-1.5-8B.Q4_K.gguf
LFS Q4
4.58 GB Download
Llama3-KALE-LM-Chem-1.5-8B.Q4_K_M.gguf
LFS Q4
4.58 GB Download
Llama3-KALE-LM-Chem-1.5-8B.Q4_K_S.gguf
LFS Q4
4.37 GB Download
Llama3-KALE-LM-Chem-1.5-8B.Q5_0.gguf
LFS Q5
5.21 GB Download
Llama3-KALE-LM-Chem-1.5-8B.Q5_1.gguf
LFS Q5
5.65 GB Download
Llama3-KALE-LM-Chem-1.5-8B.Q5_K.gguf
LFS Q5
5.34 GB Download
Llama3-KALE-LM-Chem-1.5-8B.Q5_K_M.gguf
LFS Q5
5.34 GB Download
Llama3-KALE-LM-Chem-1.5-8B.Q5_K_S.gguf
LFS Q5
5.21 GB Download
Llama3-KALE-LM-Chem-1.5-8B.Q6_K.gguf
LFS Q6
6.14 GB Download
Llama3-KALE-LM-Chem-1.5-8B.Q8_0.gguf
LFS Q8
7.95 GB Download