πŸ“‹ Model Description

The models used by Emeltal in GGUF form.

You can find a list of the models used by following the above link.

This repo exists to ensure that model files do not dissappear over time and are available for use in Emeltal. You are strongly encouraged not to use these models directly and instead visit the repos of the original models.

Use of each model is subject to the terms and conditions outlined in their original repo.

πŸ“‚ GGUF File List

πŸ“ Filename πŸ“¦ Size ⚑ Download
AM-Thinking-v1.Q5_K_M.gguf
LFS Q5
21.66 GB Download
Athene-V2-Chat-Q4_K_L.gguf
LFS Q4
45.02 GB Download
CodeLlama-70b-Instruct-hf-Q5_K_M.gguf
LFS Q5
45.41 GB Download
Codestral-22B-v0.1-Q6_K.gguf
LFS Q6
17 GB Download
DeepSeek-R1-Distill-Llama-70B-Q4_K_M.gguf
Recommended LFS Q4
39.6 GB Download
Devstral-2-123B-Instruct-2512-UD-IQ3_XXS.gguf
LFS Q3
45.6 GB Download
Devstral-Small-2-24B-Instruct-2512-UD-Q6_K_XL.gguf
LFS Q6
19.36 GB Download
Dolphin3.0-Llama3.1-8B-Q5_K_M.gguf
LFS Q5
5.34 GB Download
Dolphin3.0-Qwen2.5-1.5B-Q6_K_L.gguf
LFS Q6
1.24 GB Download
Dolphin3.0-Qwen2.5-3b-Q6_K_L.gguf
LFS Q6
2.43 GB Download
Everyone-Coder-33b-v2-Base-Q6_K.gguf
LFS Q6
25.48 GB Download
Llama-3.1-Nemotron-70B-Instruct-HF-Q5_K_S.gguf
LFS Q5
45.32 GB Download
Llama-3.2-1B-Instruct-Q6_K_L.gguf
LFS Q6
1.01 GB Download
Llama-3.2-3B-Instruct-Q6_K_L.gguf
LFS Q6
2.55 GB Download
Llama-3.3-70B-Instruct-Q5_K_S.gguf
LFS Q5
45.32 GB Download
Llama-4-Scout-17B-16E-Instruct-UD-Q2_K_XL.gguf
LFS Q2
39.67 GB Download
Meta-Llama-3.1-70B-Instruct.Q5_K_M.gguf
LFS Q5
46.52 GB Download
Meta-Llama-3.1-8B-Instruct-Q6_K.gguf
LFS Q6
6.14 GB Download
Mistral-7B-Instruct-v0.2-Neural-Story_Q6_K.gguf
LFS Q6
5.53 GB Download
Qwen2.5-14B-Instruct-Q5_K_L.gguf
LFS Q5
10.23 GB Download
Qwen2.5-32B-Instruct-Q4_K_M.gguf
LFS Q4
18.49 GB Download
Qwen2.5-72B-Instruct-Q4_K_M.gguf
LFS Q4
44.16 GB Download
Qwen2.5-7B-Instruct-Q4_K_M.gguf
LFS Q4
4.36 GB Download
Qwen2.5-Coder-32B-Instruct-Q6_K_L.gguf
LFS Q6
25.39 GB Download
Qwen3-Coder-30B-A3B-Instruct-UD-Q6_K_XL.gguf
LFS Q6
24.53 GB Download
Qwen_QwQ-32B-Q5_K_L.gguf
LFS Q5
22.11 GB Download
Qwen_Qwen3-0.6B-Q8_0.gguf
LFS Q8
767.47 MB Download
Qwen_Qwen3-32B-Q5_K_L.gguf
LFS Q5
22.07 GB Download
Qwen_Qwen3-8B-Q5_K_L.gguf
LFS Q5
5.81 GB Download
SmolLM2-1.7B-Instruct-Q6_K_L.gguf
LFS Q6
1.33 GB Download
SuperNova-Medius-Q5_K_M.gguf
LFS Q5
9.79 GB Download
THUDM_GLM-4-32B-0414-Q5_K_L.gguf
LFS Q5
22.05 GB Download
THUDM_GLM-Z1-32B-0414-Q5_K_L.gguf
LFS Q5
22.05 GB Download
calme-2.4-rys-78b.i1-Q4_K_S.gguf
LFS Q4
43.72 GB Download
codellama-70b-instruct.Q5_K_M.gguf
LFS Q5
45.41 GB Download
cognitivecomputations_Dolphin3.0-R1-Mistral-24B-Q5_K_L.gguf
LFS Q5
16 GB Download
deepseek-coder-33b-instruct.Q6_K.gguf
LFS Q6
25.48 GB Download
deepseek-coder-7b-instruct-v1.5-Q6_K.gguf
LFS Q6
5.28 GB Download
dolphin-2.2-70b.Q5_K_M.gguf
LFS Q5
45.41 GB Download
dolphin-2.7-mixtral-8x7b.Q5_K_M.gguf
LFS Q5
30.02 GB Download
dolphin-2.9.2-qwen2-72b.i1-Q4_K_M.gguf
LFS Q4
44.16 GB Download
dolphin-2.9.3-mistral-nemo-12b.Q5_K_M.gguf
LFS Q5
8.13 GB Download
dolphincoder-starcoder2-15b.Q6_K.gguf
LFS Q6
12.2 GB Download
gemma-3-12b-it-Q4_K_M.gguf
LFS Q4
6.8 GB Download
gemma-3-1b-it-Q4_K_M.gguf
LFS Q4
768.72 MB Download
gemma-3-27b-it-Q4_K_M.gguf
LFS Q4
15.41 GB Download
gemma-3-4b-it-Q4_K_M.gguf
LFS Q4
2.32 GB Download
gpt-oss-20b-MXFP4.gguf
LFS
11.28 GB Download
mistralai_Magistral-Small-2506-Q6_K_L.gguf
LFS Q6
18.32 GB Download
mistralai_Mistral-Small-3.1-24B-Instruct-2503-Q6_K_L.gguf
LFS Q6
18.32 GB Download
mythomax-l2-13b.Q6_K.gguf
LFS Q6
9.95 GB Download
nvidia_Llama-3_3-Nemotron-Super-49B-v1-Q6_K.gguf
LFS Q6
38.11 GB Download
open-r1_OlympicCoder-32B-Q5_K_L.gguf
LFS Q5
22.11 GB Download
qwen2-72b-instruct-q4_k_m.gguf
LFS Q4
44.16 GB Download
qwen2-7b-instruct-q5_k_m.gguf
LFS Q5
5.07 GB Download
sage-ft-mixtral-8x7b-q4_k_m.gguf
LFS Q4
26.49 GB Download
samantha-1.1-westlake-7b.Q5_K_M.gguf
LFS Q5
4.78 GB Download
samantha-1.11-70b.Q5_K_M.gguf
LFS Q5
45.41 GB Download
shuttle-3-Q4_K_M.gguf
LFS Q4
44.16 GB Download
tinydolphin-2.8-1.1b.Q6_K.gguf
LFS Q6
861.57 MB Download