NeurIPS 2020

Just Pick a Sign: Optimizing Deep Multitask Models with Gradient Sign Dropout

Meta Review

The reviewers generally agree that this paper presents a simple, intuitive and interesting idea. The nature of the method (being a generally applicable optimization enhancement) means that a very thorough experimental evaluation is desirable to convince the reader. However, the rebuttal helped to alleviate the corresponding concerns, and overall this looks like a paper that the community would appreciate.