This zip file serves as supplemental code for neurips 2024 submission "Spectral Adapter: Fine-Tuning in Spectral Space".

mistral.py contains main training code.

peft folder is a drop-in replacement of HuggingFace PEFT library.

Evaluation is done via lm-evaluation-harness (https://github.com/EleutherAI/lm-evaluation-harness).



