πŸ“‹ Model Description

Quantization made by Richard Erkhov.

Github

Discord

Request more models

Super-phi-2-dpo - GGUF

  • Model creator: https://huggingface.co/rbgo/
  • Original model: https://huggingface.co/rbgo/Super-phi-2-dpo/

NameQuant methodSize
Super-phi-2-dpo.Q2K.ggufQ2K1.01GB
Super-phi-2-dpo.Q3KS.ggufQ3K_S1.16GB
Super-phi-2-dpo.Q3K.ggufQ3K1.38GB
Super-phi-2-dpo.Q3KM.ggufQ3K_M1.38GB
Super-phi-2-dpo.Q3KL.ggufQ3K_L1.49GB
Super-phi-2-dpo.IQ4XS.ggufIQ4XS1.43GB
Super-phi-2-dpo.Q40.ggufQ401.49GB
Super-phi-2-dpo.IQ4NL.ggufIQ4NL1.5GB
Super-phi-2-dpo.Q4KS.ggufQ4K_S1.5GB
Super-phi-2-dpo.Q4K.ggufQ4K1.67GB
Super-phi-2-dpo.Q4KM.ggufQ4K_M1.67GB
Super-phi-2-dpo.Q41.ggufQ411.65GB
Super-phi-2-dpo.Q50.ggufQ501.8GB
Super-phi-2-dpo.Q5KS.ggufQ5K_S1.8GB
Super-phi-2-dpo.Q5K.ggufQ5K1.93GB
Super-phi-2-dpo.Q5KM.ggufQ5K_M1.93GB
Super-phi-2-dpo.Q51.ggufQ511.95GB
Super-phi-2-dpo.Q6K.ggufQ6K2.13GB
Super-phi-2-dpo.Q80.ggufQ802.75GB

Original model description:



base_model: microsoft/phi-2
inference: false
language:
  • en

license: mit
model-index:
  • name: phi-2

results: []
model_creator: microsoft
model_name: phi-2
model_type: phi
prompt_template: |
<|im_start|>system
{systemmessage}<|imend|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant
finetuned_by: Inferless
tags:
  • finetune
  • rl
  • dpo
  • phi
  • nlp

pipeline_tag: text-generation
datasets:
  • argilla/distilabel-intel-orca-dpo-pairs






Inferless



Serverless GPUs to scale your machine learning inference without any hassle of managing servers, deploy complicated and custom models with ease.






Go through this tutorial, for quickly deploy of Phi-2 using Inferless




#


Description

This repo contains DPO Finetuned model files for Microsoft Phi-2.

πŸ“‚ GGUF File List

πŸ“ Filename πŸ“¦ Size ⚑ Download
Super-phi-2-dpo.IQ4_NL.gguf
LFS Q4
1.5 GB Download
Super-phi-2-dpo.IQ4_XS.gguf
LFS Q4
1.43 GB Download
Super-phi-2-dpo.Q2_K.gguf
LFS Q2
1.01 GB Download
Super-phi-2-dpo.Q3_K.gguf
LFS Q3
1.38 GB Download
Super-phi-2-dpo.Q3_K_L.gguf
LFS Q3
1.49 GB Download
Super-phi-2-dpo.Q3_K_M.gguf
LFS Q3
1.38 GB Download
Super-phi-2-dpo.Q3_K_S.gguf
LFS Q3
1.16 GB Download
Super-phi-2-dpo.Q4_0.gguf
Recommended LFS Q4
1.49 GB Download
Super-phi-2-dpo.Q4_1.gguf
LFS Q4
1.65 GB Download
Super-phi-2-dpo.Q4_K.gguf
LFS Q4
1.67 GB Download
Super-phi-2-dpo.Q4_K_M.gguf
LFS Q4
1.67 GB Download
Super-phi-2-dpo.Q4_K_S.gguf
LFS Q4
1.5 GB Download
Super-phi-2-dpo.Q5_0.gguf
LFS Q5
1.8 GB Download
Super-phi-2-dpo.Q5_1.gguf
LFS Q5
1.95 GB Download
Super-phi-2-dpo.Q5_K.gguf
LFS Q5
1.93 GB Download
Super-phi-2-dpo.Q5_K_M.gguf
LFS Q5
1.93 GB Download
Super-phi-2-dpo.Q5_K_S.gguf
LFS Q5
1.8 GB Download
Super-phi-2-dpo.Q6_K.gguf
LFS Q6
2.13 GB Download
Super-phi-2-dpo.Q8_0.gguf
LFS Q8
2.75 GB Download