The reviewers concluded that this paper offers valuable contributions and addresses an important practical problem. The authors also conduct an extensive set of experiments. However, I would strongly encourage the authors to consider the baseline suggested by R2, which is simple and requested by all other reviewers. A second baseline worth considering is to phantasize evaluation, akin what folks to do in Bayesian optmization. While this would not be attractive computationally, it encourages diverse batches. It would be interesting to see how the proposed method compares to this. Finally,a discussion of the computational complexity and/or limitations of current and competing techniques would also improve the paper.