πŸ“‹ Model Description


tags:
  • gguf
  • llama.cpp
  • unsloth
  • unsloth
  • qwen3
datasets:
  • TeichAI/gemini-3-pro-preview-high-reasoning-1000x
base_model:
  • TeichAI/Qwen3-4B-Instruct-2507-Gemini-3-Pro-Preview-Distill

Qwen3 4B Instruct 2507 - Gemini 3 Pro Preview (No Reasoning) Distill

This model was trained on a Gemini 3 Pro Preview dataset with a high reasoning effort.

The reasoning summaries were then formatted out of the dataset and the model was finetuned on the final answers only.

  • 🧬 Datasets:
- TeichAI/gemini-3-pro-preview-high-reasoning-1000x
  • πŸ— Base Model:
- unsloth/Qwen3-4B-Instruct-2507
  • ⚡ Use cases:
- Coding - Science
  • ∑ Stats (Dataset)
- Costs: $ 32.7 (USD) - Total tokens (input + output): 2.73 M

This qwen3 model was trained 2x faster with Unsloth and Huggingface's TRL library.

Ollama

An Ollama Modelfile is included for easy deployment.

πŸ“‚ GGUF File List

πŸ“ Filename πŸ“¦ Size ⚑ Download
Qwen3-4B-Instruct-2507-Gemini-3-Pro-Preview-Distill.bf16.gguf
LFS FP16
7.5 GB Download
Qwen3-4B-Instruct-2507-Gemini-3-Pro-Preview-Distill.iq2_m.gguf
LFS Q2
1.41 GB Download
Qwen3-4B-Instruct-2507-Gemini-3-Pro-Preview-Distill.iq2_xs.gguf
LFS Q2
1.26 GB Download
Qwen3-4B-Instruct-2507-Gemini-3-Pro-Preview-Distill.iq3_m.gguf
LFS Q3
1.83 GB Download
Qwen3-4B-Instruct-2507-Gemini-3-Pro-Preview-Distill.iq3_xs.gguf
LFS Q3
1.69 GB Download
Qwen3-4B-Instruct-2507-Gemini-3-Pro-Preview-Distill.iq4_nl.gguf
LFS Q4
2.22 GB Download
Qwen3-4B-Instruct-2507-Gemini-3-Pro-Preview-Distill.iq4_xs.gguf
LFS Q4
2.11 GB Download
Qwen3-4B-Instruct-2507-Gemini-3-Pro-Preview-Distill.q3_k_m.gguf
LFS Q3
1.93 GB Download
Qwen3-4B-Instruct-2507-Gemini-3-Pro-Preview-Distill.q3_k_s.gguf
LFS Q3
1.76 GB Download
Qwen3-4B-Instruct-2507-Gemini-3-Pro-Preview-Distill.q4_k_m.gguf
Recommended LFS Q4
2.33 GB Download
Qwen3-4B-Instruct-2507-Gemini-3-Pro-Preview-Distill.q5_k_m.gguf
LFS Q5
2.69 GB Download
Qwen3-4B-Instruct-2507-Gemini-3-Pro-Preview-Distill.q6_k.gguf
LFS Q6
3.08 GB Download
Qwen3-4B-Instruct-2507-Gemini-3-Pro-Preview-Distill.q8_0.gguf
LFS Q8
3.99 GB Download
qwen3-4b-instruct-2507.F16.gguf
LFS FP16
7.5 GB Download
qwen3-4b-instruct-2507.Q8_0.gguf
LFS Q8
3.99 GB Download