## Schedulers

A scheduler dictates how the model's learning rate changes as a function of training steps.

## How to add a new scheduler
1. Add the code for the scheduler to this subdirectory under the name _schedulername_.py. Take a look at the exemplar schedulers already implemented to get an idea of what components are necessary in a scheduler. You may also need to modify the task as discussed [here](https://lightning.ai/docs/pytorch/stable/common/optimization.html)
2. Add the configuration file of the model to [`./config/scheduler`](https://github.com/ofsoundof/TimeFM/tree/split_attention_foundation_model/config/scheduler).

