File size: 1,078 Bytes
37418f4 931674e c4fced5 931674e 37418f4 2b7d24a |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 |
---
base_model: google/gemma-2-27b-it
pipeline_tag: text-generation
license: apache-2.0
language:
- en
tags:
- gemma
- gemma-2
- chat
- it
- abliterated
library_name: transformers
---
NOTE: This is a current WIP (work in progress).
This abliteration was 1/2 performed with llama-cpp-python (obtain direction vector) and 1/2 performed with torch (modify .safetensors one at a time).
It is a rather larger model so it may take me another day or two to figure out which layer I should be using for the direction vector.
This is round 1, layer 20 was used for the direction vector.
I have not tested it yet and cannot test it until I can make a GGUF of this repo.
From there I will determine if I need to change the layer used, etc.
# gemma-2-27b-it-abliterated
Check out the <a href="https://huggingface.co/byroneverson/gemma-2-27b-it-abliterated/blob/main/abliterate-gemma-2-27b-it.ipynb">jupyter notebook</a> for details of how this model was abliterated from glm-4-9b-chat.
 |