Do you plan to offer this model in GGUF?
#1
by Nerdsking - opened
... so we, the tinny mortals can use your nice work? 😃
I didn't before, I'll look into it today. Thank you for the feedback! Would you like a Q2 quant? Or something else in addition
I would like to ask if we can get Q4.
I know that DS originally has it in Q4, but the objective is GGUF, so we can run it in llama.cpp
I would like to ask if we can get Q4.
I know that DS originally has it in Q4, but the objective is GGUF, so we can run it in llama.cpp
Try with this llama.cpp gguf lora Sabomako/DeepSeek-V4-Flash-Abliterated-lora-GGUF with any quant you like.