File size: 673 Bytes
5fe780f
 
 
 
 
 
 
 
 
 
 
62a3817
a07fa13
 
 
 
 
 
32ef01c
a07fa13
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
---
title: Compute Optimal Model Estimator
emoji: 🐢
colorFrom: purple
colorTo: yellow
sdk: gradio
sdk_version: 3.28.3
app_file: app.py
pinned: false
---

# Compute-Optimal Model Estimator

<a target="_blank" href="https://huggingface.co/spaces/p208p2002/Compute-Optimal-Model-Estimator">
<img src="https://img.shields.io/badge/🤗 Live Demo-ffea00?style=for-the-badge&logoColor=white">
</a>


##### References
- [Training Compute-Optimal Large Language Models](https://arxiv.org/pdf/2203.15556.pdf)
- [Scaling Laws for Neural Language Models](https://arxiv.org/pdf/2001.08361.pdf)
- [karpathy/nanoGPT](https://github.com/karpathy/nanoGPT/blob/master/scaling_laws.ipynb)