How do I GGUF?

#1
by TheDrummer - opened

Wassup again, homie.

I tried quanting this myself yesterday but encountered an error. I'm in the process of finetuning the model and I'd like to avoid any headaches. Is there anything I need to know/do?

Do you have the error message? I didn't have to do anything special

Oh ok, works now

Sign up or log in to comment