Update README.md

README.md

@@ -9,9 +9,9 @@ model-index:
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 should probably proofread and complete it, then remove this comment. -->
 
-# out
+# TinyStories-GPT2-3M
 
-This model is a fine-tuned version of [](https://huggingface.co/) on the None dataset.
+This model is a tiny (3M trainable parameters) GPT-2 model pre-trained for 3 epochs on the [TinyStories](https://huggingface.co/datasets/roneneldan/TinyStories) V2 dataset.
 
 ## Model description
 
@@ -26,6 +26,7 @@ More information needed
 More information needed
 
 ## Training procedure
+Trained for 400k steps (~7 hours) on 2xH100 80GB PCIe with 32vCPU and 500GB RAM on Runpod.
 
 ### Training hyperparameters