fp16 version?
#2
by
Tycho-S
- opened
Thanks very much, this one works very well!
Would it be possible to post an fp16 version too please? That would be really helpful for maximum accuracy.
I assume the fp16 version was abliterated and then quantised to generate the posted versions here?
These are the original BF16 weights. There was no FP16 version.
https://huggingface.co/grimjim/Llama-3.1-8B-Instruct-abliterated_via_adapter
Thank you!