MaziyarPanahi commited on
Commit
d7a439c
1 Parent(s): a19262f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -1
README.md CHANGED
@@ -6,4 +6,6 @@ tags:
6
  - merge
7
  ---
8
 
9
- Merge of top 7B models with DARE method
 
 
 
6
  - merge
7
  ---
8
 
9
+ Merge of top 7B models with DARE method
10
+
11
+ > mergekit is a toolkit for merging pre-trained language models. mergekit uses an out-of-core approach to perform unreasonably elaborate merges in resource-constrained situations. Merges can be run entirely on CPU or accelerated with as little as 8 GB of VRAM. Many merging algorithms are supported, with more coming as they catch my attention.