Quantize model
#43
by
Kunalbhagat88
- opened
I want to convert my fine tune model into gguf format. i dont know how to do that. i research on google and youtube but didnt get any relevent reponse.
This can help you https://github.com/ggerganov/llama.cpp/discussions/2948
i try with this but not able to do this