Quantization made by Richard Erkhov.

Github

Discord

Request more models

Qwen2.5-0.5B-InstructMATHtrainingresponseQwen2.50.5Bonly_right - GGUF

• Model creator: https://huggingface.co/cutelemonlili/
• Original model: https://huggingface.co/cutelemonlili/Qwen2.5-0.5B-InstructMATHtrainingresponseQwen2.50.5Bonly_right/

Original model description:

• llama-factory
• full
• generatedfromtrainer

• name: MATHtrainingresponseQwen2.50.5Bonlyright

MATHtrainingresponseQwen2.50.5Bonlyright

This model is a fine-tuned version of Qwen/Qwen2.5-0.5B-Instruct on the MATHtrainingresponseQwen2.50.5Bonly_right dataset.
It achieves the following results on the evaluation set:

• Loss: 0.0828

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learningrate: 1e-05
• trainbatchsize: 2
• evalbatchsize: 1
• seed: 42
• distributedtype: multi-GPU
• numdevices: 4
• totaltrainbatchsize: 8
• totalevalbatchsize: 4
• optimizer: Use adamwtorch with betas=(0.9,0.999) and epsilon=1e-08 and optimizerargs=No additional optimizer arguments
• lrschedulertype: cosine
• numepochs: 2

Training results

Framework versions

• Transformers 4.46.1
• Pytorch 2.5.1+cu124
• Datasets 3.1.0
• Tokenizers 0.20.3