Text Generation
MLX
English
mixtral
climate change
biomimicry
theoretical astrobiology
environmental simulations
predictive modeling
life origins
ecological impacts
sustainable technologies
cross-disciplinary learning
artificial intelligence
machine learning
data integration
complex systems
scenario analysis
speculative science
universe exploration
biodiversity
planetary studies
innovation in science
role playing scenarios
conversational
Update README.md
Browse files
README.md
CHANGED
|
@@ -57,7 +57,11 @@ The model was trained on a subset of the I.M.P.A.C.T. dataset, utilizing 35,000
|
|
| 57 |
- **Type:** Llama-3
|
| 58 |
- **Parameters:** 8 billion
|
| 59 |
- **MoE:** 2 Experts
|
| 60 |
-
- **Training
|
|
|
|
|
|
|
|
|
|
|
|
|
| 61 |
- **Context Limit:** 64K
|
| 62 |
|
| 63 |
## Intended Uses
|
|
|
|
| 57 |
- **Type:** Llama-3
|
| 58 |
- **Parameters:** 8 billion
|
| 59 |
- **MoE:** 2 Experts
|
| 60 |
+
- **Training:**
|
| 61 |
+
- Epochs: 1 (35K Examples)
|
| 62 |
+
- R = 64
|
| 63 |
+
- Alpha = 128
|
| 64 |
+
- Lr = 1e-7
|
| 65 |
- **Context Limit:** 64K
|
| 66 |
|
| 67 |
## Intended Uses
|