π Model Description
base_model: unsloth/qwen2.5-7b-instruct-bnb-4bit tags:
- text-generation-inference
- transformers
- unsloth
- qwen2
- trl
- en
Uploaded model
- Developed by: wittlesus
- License: apache-2.0
- Finetuned from model : unsloth/qwen2.5-7b-instruct-bnb-4bit
This qwen2 model was trained 2x faster with Unsloth
π GGUF File List
| π Filename | π¦ Size | β‘ Download |
|---|---|---|
|
Qwen2.5-7B-Instruct.Q4_K_M.gguf
Recommended
LFS
Q4
|
4.36 GB | Download |
|
Qwen3-4B-Instruct-2507.Q5_K_M.gguf
LFS
Q5
|
2.69 GB | Download |
|
ggml-vocab-aquila.gguf
LFS
|
4.6 MB | Download |
|
ggml-vocab-baichuan.gguf
LFS
|
1.28 MB | Download |
|
ggml-vocab-bert-bge.gguf
LFS
|
612.84 KB | Download |
|
ggml-vocab-command-r.gguf
LFS
|
10.37 MB | Download |
|
ggml-vocab-deepseek-coder.gguf
LFS
|
1.1 MB | Download |
|
ggml-vocab-deepseek-llm.gguf
LFS
|
3.79 MB | Download |
|
ggml-vocab-falcon.gguf
LFS
|
2.18 MB | Download |
|
ggml-vocab-gpt-2.gguf
LFS
|
1.68 MB | Download |
|
ggml-vocab-gpt-neox.gguf
LFS
|
1.69 MB | Download |
|
ggml-vocab-llama-bpe.gguf
LFS
|
7.46 MB | Download |
|
ggml-vocab-llama-spm.gguf
LFS
|
706.9 KB | Download |
|
ggml-vocab-mpt.gguf
LFS
|
1.69 MB | Download |
|
ggml-vocab-nomic-bert-moe.gguf
LFS
|
6.51 MB | Download |
|
ggml-vocab-phi-3.gguf
LFS
|
709 KB | Download |
|
ggml-vocab-qwen2.gguf
LFS
|
5.65 MB | Download |
|
ggml-vocab-refact.gguf
LFS
|
1.64 MB | Download |
|
ggml-vocab-starcoder.gguf
LFS
|
1.64 MB | Download |