README.md

ruDialoGpt3 colab for finetuning on telegram chat

This is a ready-for-use-colab tutorial for finetuning ruDialoGpt3 model on your telegram chat using HuggingFace and PyTorch.

• 🤗 Model page

• Colab tutorial

I used RuDialoGPT-3 trained on forums to fine tune. It was trained by @Grossmend on Russian forums. The training procedure of the model for dialogue is described in Grossmend's blogpost (in Russian). I have created a simple pipeline and fine tuned that model on my own exported telegram chat (~30mb json, 3 hours of fine tuning). It is in fact very easy to get the data from telegram and fine tune a model:

1. Export your telegram chat as JSON

2. Upload it to colab

3. The code will create a dataset for you

4. Wait a bit!

5. :tada: (Inference and smile)

Or you can just go to google colab and play with my finetuned model!:

A couple of dialogue samples:

Inference part