Steelskull commited on
Commit
7c0ea99
1 Parent(s): 25ef053

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -0
README.md CHANGED
@@ -115,6 +115,7 @@ code {
115
  <pre><code> L3 = Llama3 </code></pre>
116
  <p>L3-Aethora-15B was crafted through using the abilteration method to adjust model responses. The model's refusal is inhibited, focusing on yielding more compliant and facilitative dialogue interactions. It then underwent a modified DUS (Depth Up Scale) merge (originally used by @Elias) by using passthrough merge to create a 15b model, with specific adjustments (zeroing) to 'o_proj' and 'down_proj', enhancing its efficiency and reducing perplexity. This created AbL3In-15b.<br>
117
  <p>AbL3In-15b was then trained for 4 epochs using Rslora & DORA training methods on the Aether-Lite-V1 dataset, containing ~82000 high quality samples, designed to strike a fine balance between creativity, slop, and intelligence at about a 60/40 split</p>
 
118
  <p>Filtered Phrases: GPTslop, Claudism's</p>
119
  <h2>Dataset Summary: (Filtered)</h2>
120
  <ul>
 
115
  <pre><code> L3 = Llama3 </code></pre>
116
  <p>L3-Aethora-15B was crafted through using the abilteration method to adjust model responses. The model's refusal is inhibited, focusing on yielding more compliant and facilitative dialogue interactions. It then underwent a modified DUS (Depth Up Scale) merge (originally used by @Elias) by using passthrough merge to create a 15b model, with specific adjustments (zeroing) to 'o_proj' and 'down_proj', enhancing its efficiency and reducing perplexity. This created AbL3In-15b.<br>
117
  <p>AbL3In-15b was then trained for 4 epochs using Rslora & DORA training methods on the Aether-Lite-V1 dataset, containing ~82000 high quality samples, designed to strike a fine balance between creativity, slop, and intelligence at about a 60/40 split</p>
118
+ <p>This model is trained on the L3 prompt format.</p>
119
  <p>Filtered Phrases: GPTslop, Claudism's</p>
120
  <h2>Dataset Summary: (Filtered)</h2>
121
  <ul>