byroneverson
/

gemma-2-27b-it-abliterated

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

byroneverson commited on Aug 29

Commit

a007edf

•

1 Parent(s): 4da0890

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -17,7 +17,7 @@ library_name: transformers
 # gemma-2-27b-it-abliterated
-This is a novel approach to abliterating a model on CPU only.
 1. Obtain refusal direction vector using a quant model with llama.cpp (llama-cpp-python and ggml-python).
 2. Orthogonalize each .safetensors files directly from original repo and upload to a new repo. (one at a time)

 # gemma-2-27b-it-abliterated
+This is a new approach for abliterating models using CPU only. I was able to abliterate this model using free kaggle processing with no accelerator.
 1. Obtain refusal direction vector using a quant model with llama.cpp (llama-cpp-python and ggml-python).
 2. Orthogonalize each .safetensors files directly from original repo and upload to a new repo. (one at a time)