The reviewers agreed that this paper provided a nice analysis of double Q-learning, thereby filling an open gap in the theoretical understanding of such algorithms, and unanimously recommended acceptance.