Update README.md
Browse files
README.md
CHANGED
@@ -4,4 +4,6 @@ license: apache-2.0
|
|
4 |
![image/png](https://cdn-uploads.huggingface.co/production/uploads/6589d7e6586088fd2784a12c/IPxdU9JFGcrEmqzOdV46Z.png)
|
5 |
# It will run...but on what hardware?
|
6 |
|
7 |
-
## 512 experts in one MoE
|
|
|
|
|
|
4 |
![image/png](https://cdn-uploads.huggingface.co/production/uploads/6589d7e6586088fd2784a12c/IPxdU9JFGcrEmqzOdV46Z.png)
|
5 |
# It will run...but on what hardware?
|
6 |
|
7 |
+
## 512 experts in one MoE
|
8 |
+
|
9 |
+
[A giant merge of all the same model](https://huggingface.co/ahxt/LiteLlama-460M-1T)
|