π Model Description
tags:
- gguf
- llama.cpp
- unsloth
- TeichAI/deepseek-v3.2-speciale-1000x
- TeichAI/Nemotron-Orchestrator-8B-DeepSeek-v3.2-Speciale-Distill
Nemotron-Orchestrator-8B-DeepSeek-v3.2-Speciale-Distill-GGUF - GGUF
This model was finetuned and converted to GGUF format using Unsloth.
Example usage:
- For text only LLMs: llama-cli --hf repoid/modelname -p "why is the sky blue?"
- For multimodal models: llama-mtmd-cli -m modelname.gguf --mmproj mmprojfile.gguf
Available Model files:
Nemotron-Orchestrator-8B.Q8_0.ggufNemotron-Orchestrator-8B.F16.gguf
π GGUF File List
| π Filename | π¦ Size | β‘ Download |
|---|---|---|
|
Nemotron-Orchestrator-8B-DeepSeek-v3.2-Speciale-Distill.bf16.gguf
LFS
FP16
|
15.26 GB | Download |
|
Nemotron-Orchestrator-8B-DeepSeek-v3.2-Speciale-Distill.iq4_nl.gguf
LFS
Q4
|
4.49 GB | Download |
|
Nemotron-Orchestrator-8B-DeepSeek-v3.2-Speciale-Distill.q3_k_m.gguf
LFS
Q3
|
3.84 GB | Download |
|
Nemotron-Orchestrator-8B-DeepSeek-v3.2-Speciale-Distill.q3_k_s.gguf
LFS
Q3
|
3.51 GB | Download |
|
Nemotron-Orchestrator-8B-DeepSeek-v3.2-Speciale-Distill.q4_k_m.gguf
Recommended
LFS
Q4
|
4.68 GB | Download |
|
Nemotron-Orchestrator-8B-DeepSeek-v3.2-Speciale-Distill.q8_0.gguf
LFS
Q8
|
8.11 GB | Download |
|
Nemotron-Orchestrator-8B.F16.gguf
LFS
FP16
|
15.26 GB | Download |
|
Nemotron-Orchestrator-8B.Q8_0.gguf
LFS
Q8
|
8.11 GB | Download |
|
orchestrator-8b-deepseek-v3.2-speciale-distill.bf16.gguf
LFS
FP16
|
15.26 GB | Download |
|
orchestrator-8b-deepseek-v3.2-speciale-distill.iq4_nl.gguf
LFS
Q4
|
4.49 GB | Download |
|
orchestrator-8b-deepseek-v3.2-speciale-distill.q3_k_m.gguf
LFS
Q3
|
3.84 GB | Download |
|
orchestrator-8b-deepseek-v3.2-speciale-distill.q3_k_s.gguf
LFS
Q3
|
3.51 GB | Download |
|
orchestrator-8b-deepseek-v3.2-speciale-distill.q4_k_m.gguf
LFS
Q4
|
4.68 GB | Download |
|
orchestrator-8b-deepseek-v3.2-speciale-distill.q8_0.gguf
LFS
Q8
|
8.11 GB | Download |