v000000 commited on
Commit
bf2faaf
1 Parent(s): 23e8527

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +44 -0
README.md ADDED
@@ -0,0 +1,44 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - llama
4
+ - merge
5
+ ---
6
+
7
+ in progress
8
+
9
+ The full name is:
10
+ # Llama-3-15B-EtherealMaid-t0.0001-Inverted
11
+
12
+ ## A merge of the following models using a custom NearSwap(t0.0001) algorithm (inverted):
13
+
14
+ * [ZeusLabs/L3-Aethora-15B-V2](https://huggingface.co/ZeusLabs/L3-Aethora-15B-V2)
15
+ * [v000000/HaloMaidRP-v1.33-15B-L3](https://huggingface.co/v000000/HaloMaidRP-v1.33-15B-L3)
16
+
17
+ With [ZeusLabs/L3-Aethora-15B-V2](https://huggingface.co/ZeusLabs/L3-Aethora-15B-V2) as the base model.
18
+
19
+ ```python
20
+ #Fixed
21
+ def lerp(a, b, t):
22
+ return a * (1 - t) + b * t
23
+
24
+ def nearswap(v0, v1, t):
25
+ lweight = np.abs(v0 - v1)
26
+ with np.errstate(divide='ignore', invalid='ignore'):
27
+ lweight = np.where(lweight != 0, t / lweight, 1.0)
28
+ lweight = np.nan_to_num(lweight, nan=1.0, posinf=1.0, neginf=1.0)
29
+ np.clip(lweight, a_min=0.0, a_max=1.0, out=lweight)
30
+ return lerp(v0, v1, lweight)
31
+ ```
32
+ Credit Alchemonaut
33
+
34
+ <b>Prompt Template</b>
35
+ ```bash
36
+ <|begin_of_text|><|start_header_id|>system<|end_header_id|>
37
+
38
+ {system_prompt}<|eot_id|><|start_header_id|>user<|end_header_id|>
39
+
40
+ {input}<|eot_id|><|start_header_id|>assistant<|end_header_id|>
41
+
42
+ {output}<|eot_id|>
43
+
44
+ ```