# MLE-Bench for AB-MCTS

## Competition installation
Follow this page: https://github.com/openai/mle-bench 

## Dependency
1. To build an image, follow this page. https://github.com/openai/mle-bench/blob/main/agents/README.md
2. After that, execute the following.
```bash
bash aide_docker.sh 
```

## Running the Agent

1. Edit the configuration
Open `agents/aide/config.yaml` and adjust the settings (e.g., model paths, hyper‑parameters) to suit your experiment.
2. Before running any experiments that require an OpenAI API connection, set your environment variable. For example:
```bash
export OPENAI_API_KEY=""
```
3. Start a run
To launch a run, change the `competition-set` and `inference-type` as desired. For example:
```bash
python run_agent.py \
    --agent-id aide \
    --competition-set "experiments/splits/nomad2018-predict-transparent-conductors.txt" \
    --inference-type "parallel-llm-mcts-pymc"
```

Supported inference types include:
- parallel-llm-mcts-pymc
- parallel-llm-mcts-thompson
- parallel-monkey
- parallel-sequential
- parallel-llm-mcts-standard



