# Scaling Verification

[![Run Tests](https://github.com/anonymous-lab/scaling-verification/actions/workflows/tests.yml/badge.svg)](https://github.com/anonymous-lab/scaling-verification/actions/workflows/tests.yml)

This repository contains code for scaling verification of language models.

```
conda create -n verifiers2 python=3.11
conda activate verifiers2
pip3 install torch torchvision torchaudio
pip3 install -r requirements.txt

git clone https://github.com/anonymous_lab/metal-ama.git
cd metal-ama/
python setup.py install
cd ../
pip install pytest tensorboardX gputil
pip install loguru datasets tabulate ipython
```

## Usage

```
cd scripts/supervised_analysis
python run.py --config-name {yaml file in scripts/configs} 
```
