EXL3 models
Collection
65 items • Updated • 64
EXL3 quants of gemma-4-26B-A4B-it
⚠️ Requires ExLlamaV3 v0.0.29 (or v0.0.28 dev branch)
2.10 bits per weight
2.54 bits per weight
3.10 bits per weight
3.54 bits per weight
4.10 bits per weight
5.10 bits per weight
6.10 bits per weight