πŸ“‹ Model Description

No documentation available

πŸ“‚ GGUF File List

πŸ“ Filename πŸ“¦ Size ⚑ Download
GRAM-RR-LLaMA-3.2-3B-RewardModel.i1-IQ1_M.gguf
LFS
881.38 MB Download
GRAM-RR-LLaMA-3.2-3B-RewardModel.i1-IQ1_S.gguf
LFS
827.94 MB Download
GRAM-RR-LLaMA-3.2-3B-RewardModel.i1-IQ2_M.gguf
LFS Q2
1.14 GB Download
GRAM-RR-LLaMA-3.2-3B-RewardModel.i1-IQ2_S.gguf
LFS Q2
1.08 GB Download
GRAM-RR-LLaMA-3.2-3B-RewardModel.i1-IQ2_XS.gguf
LFS Q2
1.02 GB Download
GRAM-RR-LLaMA-3.2-3B-RewardModel.i1-IQ2_XXS.gguf
LFS Q2
970.44 MB Download
GRAM-RR-LLaMA-3.2-3B-RewardModel.i1-IQ3_M.gguf
LFS Q3
1.49 GB Download
GRAM-RR-LLaMA-3.2-3B-RewardModel.i1-IQ3_S.gguf
LFS Q3
1.44 GB Download
GRAM-RR-LLaMA-3.2-3B-RewardModel.i1-IQ3_XS.gguf
LFS Q3
1.38 GB Download
GRAM-RR-LLaMA-3.2-3B-RewardModel.i1-IQ3_XXS.gguf
LFS Q3
1.26 GB Download
GRAM-RR-LLaMA-3.2-3B-RewardModel.i1-IQ4_NL.gguf
LFS Q4
1.79 GB Download
GRAM-RR-LLaMA-3.2-3B-RewardModel.i1-IQ4_XS.gguf
LFS Q4
1.7 GB Download
GRAM-RR-LLaMA-3.2-3B-RewardModel.i1-Q2_K.gguf
LFS Q2
1.27 GB Download
GRAM-RR-LLaMA-3.2-3B-RewardModel.i1-Q2_K_S.gguf
LFS Q2
1.19 GB Download
GRAM-RR-LLaMA-3.2-3B-RewardModel.i1-Q3_K_L.gguf
LFS Q3
1.69 GB Download
GRAM-RR-LLaMA-3.2-3B-RewardModel.i1-Q3_K_M.gguf
LFS Q3
1.57 GB Download
GRAM-RR-LLaMA-3.2-3B-RewardModel.i1-Q3_K_S.gguf
LFS Q3
1.44 GB Download
GRAM-RR-LLaMA-3.2-3B-RewardModel.i1-Q4_0.gguf
Recommended LFS Q4
1.79 GB Download
GRAM-RR-LLaMA-3.2-3B-RewardModel.i1-Q4_1.gguf
LFS Q4
1.95 GB Download
GRAM-RR-LLaMA-3.2-3B-RewardModel.i1-Q4_K_M.gguf
LFS Q4
1.88 GB Download
GRAM-RR-LLaMA-3.2-3B-RewardModel.i1-Q4_K_S.gguf
LFS Q4
1.8 GB Download
GRAM-RR-LLaMA-3.2-3B-RewardModel.i1-Q5_K_M.gguf
LFS Q5
2.16 GB Download
GRAM-RR-LLaMA-3.2-3B-RewardModel.i1-Q5_K_S.gguf
LFS Q5
2.11 GB Download
GRAM-RR-LLaMA-3.2-3B-RewardModel.i1-Q6_K.gguf
LFS Q6
2.46 GB Download
GRAM-RR-LLaMA-3.2-3B-RewardModel.imatrix.gguf
LFS
2.87 MB Download