π Model Description
license: gemma base_model:
- google/gemma-3-270m
- gguf-connector
gemma-3-270m-gguf
- base model from google
- tested on gguf-connector with nightly llama-cpp-python
π GGUF File List
| π Filename | π¦ Size | β‘ Download |
|---|---|---|
|
gemma-3-270m-bf16.gguf
LFS
FP16
|
517.69 MB | Download |
|
gemma-3-270m-f16.gguf
LFS
FP16
|
517.69 MB | Download |
|
gemma-3-270m-f32.gguf
LFS
|
1 GB | Download |
|
gemma-3-270m-iq1_m.gguf
LFS
|
226.09 MB | Download |
|
gemma-3-270m-iq1_s.gguf
LFS
|
226.09 MB | Download |
|
gemma-3-270m-iq2_s.gguf
LFS
Q2
|
226.09 MB | Download |
|
gemma-3-270m-iq2_xs.gguf
LFS
Q2
|
226.09 MB | Download |
|
gemma-3-270m-iq2_xxs.gguf
LFS
Q2
|
226.09 MB | Download |
|
gemma-3-270m-iq3_s.gguf
LFS
Q3
|
226.09 MB | Download |
|
gemma-3-270m-iq3_xxs.gguf
LFS
Q3
|
226.43 MB | Download |
|
gemma-3-270m-iq4_nl.gguf
LFS
Q4
|
231.07 MB | Download |
|
gemma-3-270m-iq4_xs.gguf
LFS
Q4
|
230.09 MB | Download |
|
gemma-3-270m-mxfp4_moe.gguf
LFS
|
278.04 MB | Download |
|
gemma-3-270m-q2_k.gguf
LFS
Q2
|
226.09 MB | Download |
|
gemma-3-270m-q2_k_s.gguf
LFS
Q2
|
226.09 MB | Download |
|
gemma-3-270m-q3_k_l.gguf
LFS
Q3
|
234.97 MB | Download |
|
gemma-3-270m-q3_k_m.gguf
LFS
Q3
|
230.75 MB | Download |
|
gemma-3-270m-q3_k_s.gguf
LFS
Q3
|
225.74 MB | Download |
|
gemma-3-270m-q4_0.gguf
Recommended
LFS
Q4
|
230.23 MB | Download |
|
gemma-3-270m-q4_1.gguf
LFS
Q4
|
236.2 MB | Download |
|
gemma-3-270m-q4_k_m.gguf
LFS
Q4
|
241.39 MB | Download |
|
gemma-3-270m-q4_k_s.gguf
LFS
Q4
|
238.31 MB | Download |
|
gemma-3-270m-q5_0.gguf
LFS
Q5
|
242.18 MB | Download |
|
gemma-3-270m-q5_1.gguf
LFS
Q5
|
248.16 MB | Download |
|
gemma-3-270m-q5_k_m.gguf
LFS
Q5
|
247.98 MB | Download |
|
gemma-3-270m-q5_k_s.gguf
LFS
Q5
|
246.05 MB | Download |
|
gemma-3-270m-q6_k.gguf
LFS
Q6
|
269.86 MB | Download |
|
gemma-3-270m-q8_0.gguf
LFS
Q8
|
278.04 MB | Download |
|
gemma-3-survival-270m-bf16.gguf
LFS
FP16
|
517.69 MB | Download |
|
gemma-3-survival-270m-f16.gguf
LFS
FP16
|
517.69 MB | Download |
|
gemma-3-survival-270m-f32.gguf
LFS
|
1 GB | Download |
|
gemma-3-survival-270m-iq3_s.gguf
LFS
Q3
|
226.1 MB | Download |
|
gemma-3-survival-270m-iq3_xxs.gguf
LFS
Q3
|
226.43 MB | Download |
|
gemma-3-survival-270m-iq4_nl.gguf
LFS
Q4
|
231.07 MB | Download |
|
gemma-3-survival-270m-iq4_xs.gguf
LFS
Q4
|
230.09 MB | Download |
|
gemma-3-survival-270m-mxfp4_moe.gguf
LFS
|
278.04 MB | Download |
|
gemma-3-survival-270m-q2_k.gguf
LFS
Q2
|
226.1 MB | Download |
|
gemma-3-survival-270m-q2_k_s.gguf
LFS
Q2
|
226.1 MB | Download |
|
gemma-3-survival-270m-q3_k_l.gguf
LFS
Q3
|
234.97 MB | Download |
|
gemma-3-survival-270m-q3_k_m.gguf
LFS
Q3
|
230.75 MB | Download |
|
gemma-3-survival-270m-q3_k_s.gguf
LFS
Q3
|
225.74 MB | Download |
|
gemma-3-survival-270m-q4_0.gguf
LFS
Q4
|
230.23 MB | Download |
|
gemma-3-survival-270m-q4_1.gguf
LFS
Q4
|
236.2 MB | Download |
|
gemma-3-survival-270m-q4_k_m.gguf
LFS
Q4
|
241.39 MB | Download |
|
gemma-3-survival-270m-q4_k_s.gguf
LFS
Q4
|
238.31 MB | Download |
|
gemma-3-survival-270m-q5_0.gguf
LFS
Q5
|
242.18 MB | Download |
|
gemma-3-survival-270m-q5_1.gguf
LFS
Q5
|
248.16 MB | Download |
|
gemma-3-survival-270m-q5_k_m.gguf
LFS
Q5
|
247.98 MB | Download |
|
gemma-3-survival-270m-q5_k_s.gguf
LFS
Q5
|
246.05 MB | Download |
|
gemma-3-survival-270m-q6_k.gguf
LFS
Q6
|
269.87 MB | Download |
|
gemma-3-survival-270m-q8_0.gguf
LFS
Q8
|
278.04 MB | Download |