GGML

#2
by marella - opened

Hi, do you have a GGML version of this?

Based on Open LLM Leaderboard it looks like this is the best model under 7B. Is that correct?

No I never did GGMLs for this. In the README I link to eachadea's GGMLs

I'm not sure it's the best 7B though. I'd look at WizardLM-7B-Uncensored-GGML

Thanks. I'm guessing Wizard-Vicuna-7B-Uncensored-GGML would also be good as the 13B version of it appears to be really good on Leaderboard.

Yeah that's a good one for sure.

marella changed discussion status to closed

Sign up or log in to comment