While there was consensus on acceptance, reviewers made several important requests to add detail, including material from the author response; please see the updated reviews. In brief, please add a discussion of challenges in higher dimensions, an explanation of Lemma 6, and a discussion of other FTRL algorithms.