πŸ“‹ Model Description


tags:
  • gguf
  • llama.cpp
  • unsloth
datasets:
  • TeichAI/deepseek-v3.2-speciale-1000x
base_model:
  • TeichAI/Nemotron-Orchestrator-8B-DeepSeek-v3.2-Speciale-Distill

Nemotron-Orchestrator-8B-DeepSeek-v3.2-Speciale-Distill-GGUF - GGUF

This model was finetuned and converted to GGUF format using Unsloth.

Example usage:

  • For text only LLMs: llama-cli --hf repoid/modelname -p "why is the sky blue?"
  • For multimodal models: llama-mtmd-cli -m modelname.gguf --mmproj mmprojfile.gguf

Available Model files:

  • Nemotron-Orchestrator-8B.Q8_0.gguf
  • Nemotron-Orchestrator-8B.F16.gguf

πŸ“‚ GGUF File List

πŸ“ Filename πŸ“¦ Size ⚑ Download
Nemotron-Orchestrator-8B-DeepSeek-v3.2-Speciale-Distill.bf16.gguf
LFS FP16
15.26 GB Download
Nemotron-Orchestrator-8B-DeepSeek-v3.2-Speciale-Distill.iq4_nl.gguf
LFS Q4
4.49 GB Download
Nemotron-Orchestrator-8B-DeepSeek-v3.2-Speciale-Distill.q3_k_m.gguf
LFS Q3
3.84 GB Download
Nemotron-Orchestrator-8B-DeepSeek-v3.2-Speciale-Distill.q3_k_s.gguf
LFS Q3
3.51 GB Download
Nemotron-Orchestrator-8B-DeepSeek-v3.2-Speciale-Distill.q4_k_m.gguf
Recommended LFS Q4
4.68 GB Download
Nemotron-Orchestrator-8B-DeepSeek-v3.2-Speciale-Distill.q8_0.gguf
LFS Q8
8.11 GB Download
Nemotron-Orchestrator-8B.F16.gguf
LFS FP16
15.26 GB Download
Nemotron-Orchestrator-8B.Q8_0.gguf
LFS Q8
8.11 GB Download
orchestrator-8b-deepseek-v3.2-speciale-distill.bf16.gguf
LFS FP16
15.26 GB Download
orchestrator-8b-deepseek-v3.2-speciale-distill.iq4_nl.gguf
LFS Q4
4.49 GB Download
orchestrator-8b-deepseek-v3.2-speciale-distill.q3_k_m.gguf
LFS Q3
3.84 GB Download
orchestrator-8b-deepseek-v3.2-speciale-distill.q3_k_s.gguf
LFS Q3
3.51 GB Download
orchestrator-8b-deepseek-v3.2-speciale-distill.q4_k_m.gguf
LFS Q4
4.68 GB Download
orchestrator-8b-deepseek-v3.2-speciale-distill.q8_0.gguf
LFS Q8
8.11 GB Download