Update README.md
Browse files
README.md
CHANGED
|
@@ -14,7 +14,7 @@ This is a merge of pre-trained language models created using [mergekit](https://
|
|
| 14 |
|
| 15 |
## Merge Details
|
| 16 |
|
| 17 |
-
Extracted an approximate LoRA of v000000/Qwen2.5-Lumen-14B, rank 128 difference between that and
|
| 18 |
and first applied this to Lambent/qwen2.5-14B-alternate-instruct-slerp which had no issues with EQ-Bench.
|
| 19 |
|
| 20 |
Then, here, re-applied a density and weight of original Instruct which in previous merges gave me no issues with EQ-Bench.
|
|
|
|
| 14 |
|
| 15 |
## Merge Details
|
| 16 |
|
| 17 |
+
Extracted an approximate LoRA of v000000/Qwen2.5-Lumen-14B, rank 128 difference between that and Instruct,
|
| 18 |
and first applied this to Lambent/qwen2.5-14B-alternate-instruct-slerp which had no issues with EQ-Bench.
|
| 19 |
|
| 20 |
Then, here, re-applied a density and weight of original Instruct which in previous merges gave me no issues with EQ-Bench.
|