Severian commited on
Commit
d5d89c2
1 Parent(s): 3c35cf9

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -0
README.md CHANGED
@@ -56,6 +56,7 @@ The model was trained on a subset of the I.M.P.A.C.T. dataset, utilizing 35,000
56
 
57
  - **Type:** Llama-3
58
  - **Parameters:** 8 billion
 
59
  - **Training Epochs:** 1 (35K Examples)
60
  - **Context Limit:** 64K
61
 
 
56
 
57
  - **Type:** Llama-3
58
  - **Parameters:** 8 billion
59
+ - **MoE:** 2 Experts
60
  - **Training Epochs:** 1 (35K Examples)
61
  - **Context Limit:** 64K
62