๐ Model Description
license: mit widget:
- text: a conversation between cgg and connector
- cow
- gguf-node
๐ฎcow architecture gguf encoder
- don't need to rebuild tokenizer from metadata โณ๐ฅ
- don't need separate tokenizer file ๐ฑ๐ฅ
- no more oom issues (possibly) ๐ซ๐ป๐ฅ
eligible model example
- use cow-mistral3small 7.73GB for flux2-dev
- use cow-gemma2 2.33GB for lumina
- use cow-umt5base 451MB for ace-audio
- use cow-umt5xxl 3.67GB for wan-s2v or any wan video model
the example workflow above is from wan-s2v-gguf; cow encoder is a special designed clip, even the lowest q2 quant still working very good; upgrade your node for cow-encoder support๐ฅ๐ฎ and do drink more milk
reference
๐ GGUF File List
| ๐ Filename | ๐ฆ Size | โก Download |
|---|---|---|
|
cow-gemma2-2b-iq4_nl.gguf
LFS
Q4
|
2.17 GB | Download |
|
cow-gemma2-2b-q2_k.gguf
LFS
Q2
|
1.73 GB | Download |
|
cow-gemma2-2b-q4_0.gguf
Recommended
LFS
Q4
|
2.17 GB | Download |
|
cow-gemma2-2b-q8_0.gguf
LFS
Q8
|
3.11 GB | Download |
|
cow-umt5base-iq4_nl.gguf
LFS
Q4
|
429.86 MB | Download |
|
cow-umt5base-q2_k.gguf
LFS
Q2
|
411.56 MB | Download |
|
cow-umt5base-q4_0.gguf
LFS
Q4
|
429.86 MB | Download |
|
cow-umt5base-q8_0.gguf
LFS
Q8
|
470.36 MB | Download |
|
cow-umt5xxl-iq4_nl.gguf
LFS
Q4
|
4.39 GB | Download |
|
cow-umt5xxl-q2_k.gguf
LFS
Q2
|
3.42 GB | Download |
|
cow-umt5xxl-q4_0.gguf
LFS
Q4
|
4.39 GB | Download |
|
cow-umt5xxl-q8_0.gguf
LFS
Q8
|
6.55 GB | Download |