📋 Model Description


library_name: llamacpp model_name: Vikhr-Gemma-2B-instruct base_model:
  • Vikhrmodels/Vikhr-Llama-3.2-1B
language:
  • ru
  • en
license: llama3.2 tags:
  • instruct
datasets:
  • Vikhrmodels/GrandMaster-PRO-MAX
pipeline_tag: text-generation

💨📱 Vikhr-Llama-3.2-1B-instruct

#### RU

Инструктивная модель на основе Llama-3.2-1B-Instruct, обученная на русскоязычном датасете GrandMaster-PRO-MAX. В 5 раз эффективнее базовой модели, и идеально подходит для запуска на слабых или мобильных устройствах.

#### EN

Instructive model based on Llama-3.2-1B-Instruct, trained on the Russian-language dataset GrandMaster-PRO-MAX. It is 5 times more efficient than the base model, making it perfect for deployment on low-power or mobile devices.

Рекомендуемая температура для генерации: 0.3 / Recommended generation temperature: 0.3.

Метрики на ruarenageneral / Metrics on ruarenageneral

ModelScore95% CIAvg TokensStd TokensLC Score
kolibri-vikhr-mistral-042722.41+1.6 / -1.6489.89566.2946.04
storm-7b20.62+2.0 / -1.6419.32190.8545.78
neural-chat-7b-v3-319.04+2.0 / -1.7927.211211.6245.56
Vikhrmodels-Vikhr-Llama-3.2-1B-instruct19.04+1.3 / -1.6958.631297.3345.56
gigachat_lite17.2+1.4 / -1.4276.81329.6645.29
Vikhrmodels-vikhr-qwen-1.5b-it13.19+1.4 / -1.62495.38741.4544.72
meta-llama-Llama-3.2-1B-Instruct4.04+0.8 / -0.61240.531783.0843.42

Авторы / Authors

``` @article{nikolich2024vikhr, title={Vikhr: The Family of Open-Source Instruction-Tuned Large Language Models for Russian}, author={Aleksandr Nikolich and Konstantin Korolev and Sergey Bratchikov and Nikolay Kompanets and Artem Shelmanov}, journal={arXiv preprint arXiv:2405.13929}, year={2024}, url={https://arxiv.org/pdf/2405.13929} }

📂 GGUF File List

📁 Filename 📦 Size ⚡ Download
Vikhr-Llama-3.2-1B-F16.gguf
LFS FP16
2.31 GB Download
Vikhr-Llama-3.2-1B-IQ1_M.gguf
LFS
394.45 MB Download
Vikhr-Llama-3.2-1B-IQ1_S.gguf
LFS
375.32 MB Download
Vikhr-Llama-3.2-1B-IQ2_M.gguf
LFS Q2
491.57 MB Download
Vikhr-Llama-3.2-1B-IQ2_S.gguf
LFS Q2
466.07 MB Download
Vikhr-Llama-3.2-1B-IQ2_XS.gguf
LFS Q2
453.82 MB Download
Vikhr-Llama-3.2-1B-IQ2_XXS.gguf
LFS Q2
426.32 MB Download
Vikhr-Llama-3.2-1B-IQ3_M.gguf
LFS Q3
626.84 MB Download
Vikhr-Llama-3.2-1B-IQ3_S.gguf
LFS Q3
614.09 MB Download
Vikhr-Llama-3.2-1B-IQ3_XS.gguf
LFS Q3
592.34 MB Download
Vikhr-Llama-3.2-1B-IQ3_XXS.gguf
LFS Q3
536.07 MB Download
Vikhr-Llama-3.2-1B-IQ4_NL.gguf
LFS Q4
737.22 MB Download
Vikhr-Llama-3.2-1B-IQ4_XS.gguf
LFS Q4
708.72 MB Download
Vikhr-Llama-3.2-1B-Q2_K.gguf
LFS Q2
553.96 MB Download
Vikhr-Llama-3.2-1B-Q3_K.gguf
LFS Q3
658.84 MB Download
Vikhr-Llama-3.2-1B-Q3_K_L.gguf
LFS Q3
698.59 MB Download
Vikhr-Llama-3.2-1B-Q3_K_M.gguf
LFS Q3
658.84 MB Download
Vikhr-Llama-3.2-1B-Q3_K_S.gguf
LFS Q3
611.96 MB Download
Vikhr-Llama-3.2-1B-Q4_0.gguf
Recommended LFS Q4
735.21 MB Download
Vikhr-Llama-3.2-1B-Q4_0_4_8.gguf
LFS Q4
735.21 MB Download
Vikhr-Llama-3.2-1B-Q4_1.gguf
LFS Q4
793.21 MB Download
Vikhr-Llama-3.2-1B-Q4_K.gguf
LFS Q4
770.28 MB Download
Vikhr-Llama-3.2-1B-Q4_K_M.gguf
LFS Q4
770.28 MB Download
Vikhr-Llama-3.2-1B-Q4_K_S.gguf
LFS Q4
739.71 MB Download
Vikhr-Llama-3.2-1B-Q5_0.gguf
LFS Q5
851.21 MB Download
Vikhr-Llama-3.2-1B-Q5_1.gguf
LFS Q5
909.21 MB Download
Vikhr-Llama-3.2-1B-Q5_K.gguf
LFS Q5
869.28 MB Download
Vikhr-Llama-3.2-1B-Q5_K_M.gguf
LFS Q5
869.28 MB Download
Vikhr-Llama-3.2-1B-Q5_K_S.gguf
LFS Q5
851.21 MB Download
Vikhr-Llama-3.2-1B-Q6_K.gguf
LFS Q6
974.46 MB Download
Vikhr-Llama-3.2-1B-Q8_0.gguf
LFS Q8
1.23 GB Download