# Project README

## Building vLLM for Mixture of Inputs

1. Change directory to `vllm-moi`:
   ```bash
   cd ./vllm-moi
   ```
2. Run the bash install script:
   ```bash
   bash install
   ```

## Running Experiments

Once vLLM is installed, you can run experiments for AIME and TinyZero Count Down 4.

1. Change directory to `moi/base_scripts`:
   ```bash
   cd ./moi/base_scripts
   ```
2. Execute the desired experiment scripts.

## Setting up lm-evaluation-harness and LiveCodeBench

### LiveCodeBench

1. Clone the repository:
   ```bash
   git clone https://github.com/LiveCodeBench/LiveCodeBench.git
   ```
2. Change directory:
   ```bash
   cd LiveCodeBench
   ```
3. Install dependencies:
   ```bash
   pip install .
   ```

### lm-evaluation-harness

1. Clone the repository (shallow clone):
   ```bash
   git clone --depth 1 https://github.com/EleutherAI/lm-evaluation-harness
   ```
2. Change directory:
   ```bash
   cd lm-evaluation-harness
   ```
3. Install in editable mode:
   ```bash
   pip install -e .
   ```

After setting up both, you can run evaluations using vLLM as the backbone.
