# Math Vista

## Run MCTS
```sh
# Load environmental variables
set -a
source .env
set +a

# Inference (for `--idx` option, 0-999 can be used for the testmini subset.)
PYTHONPATH="$PYTHONPATH:.." python scripts/math_vista/run_math_vista.py --experiment_name gpt4o20240806-ns0-ne1-t0 --idx 0 --answer_models gpt-4o-2024-08-06 --answer_temperatures 0.0 --num_simulations 0 --num_expand_samples 0 --initial_expand_samples 1 --judge_model gpt-4o-2024-08-06 --judge_temperature 0.0

# Choose a node for submission
PYTHONPATH="$PYTHONPATH:.." python scripts/math_vista/make_submission_math_vista.py --experiment_name gpt4o20240806-ns0-ne1-t0 --idx 0 --judge_model gpt-4o-2024-08-06 --judge_temperature 0.0

# Gather the results
PYTHONPATH="$PYTHONPATH:.." python scripts/math_vista/gather_results_math_vista.py --experiment_name gpt4o20240806-ns0-ne1-t0

# Old flow
## Evaluate the results on the nodes
PYTHONPATH="$PYTHONPATH:.." python scripts/math_vista/evaluate_math_vista.py --experiment_name gpt4o20240806-ns0-ne1-t0 --idx 0 --judge_model gpt-4o-2024-08-06 --judge_temperature 0.0

## Aggregate the score
PYTHONPATH="$PYTHONPATH:.." python scripts/math_vista/calculate_score_math_vista.py --experiment_name gpt4o20240806-ns0-ne1-t0
```
