metadata

base_model: google/gemma-2-27b-it
pipeline_tag: text-generation
license: apache-2.0
language:
  - en
tags:
  - gemma
  - gemma-2
  - chat
  - it
  - abliterated
library_name: transformers

NOTE: This is a current WIP (work in progress). This abliteration was 1/2 performed with llama-cpp-python (obtain direction vector) and 1/2 performed with torch (modify .safetensors one at a time). It is a rather larger model so it may take me another day or two to figure out which layer I should be using for the direction vector. This is round 1, layer 20 was used for the direction vector. I have not tested it yet and cannot test it until I can make a GGUF of this repo. From there I will determine if I need to change the layer used, etc.

gemma-2-27b-it-abliterated

Check out the jupyter notebook for details of how this model was abliterated from glm-4-9b-chat.