NeurIPS 2020

O(n) Connections are Expressive Enough: Universal Approximability of Sparse Transformers

Meta Review

The AC and reviewers appreciate the author feedback and thoroughly discussed the paper. The author response brings in important clarifications on how at the approximation is being built and on the terminology (e.g regarding the use of sequences of fixed length for both input and output). We urge the authors to incorporate them in their manuscript.