# 🐕 Supervised finetuning (SFT)

This code is from [DeepSpeed-Chat](https://github.com/microsoft/DeepSpeedExamples/tree/master/applications/DeepSpeed-Chat/training/step1_supervised_finetuning) with some modifications:

- Use the EOS token from the tokenizer as the PAD token.