πŸ“‹ Model Description


license: apache-2.0

Bamboo-base-v0.1-PowerInfer-GGUF

Citation

Please kindly cite using the following BibTeX:

@misc{bamboo,
    title={Bamboo: Harmonizing Sparsity and Performance in Large Language Models}, 
    author={Yixin Song, Haotong Xie, Zeyu Mi, Li Ma, Haibo Chen},
    year={2024}
}

πŸ“‚ GGUF File List

πŸ“ Filename πŸ“¦ Size ⚑ Download
bamboo-7b-v0.1.Q4_0.gguf
Recommended LFS Q4
3.97 GB Download
bamboo-7b-v0.1.Q4_0.powerinfer.gguf
LFS Q4
4.36 GB Download
bamboo-7b-v0.1.gguf
LFS
13.49 GB Download
bamboo-7b-v0.1.powerinfer.gguf
LFS
14.87 GB Download