NeurIPS 2020

Spectra of the Conjugate Kernel and Neural Tangent Kernel for linear-width neural networks

Meta Review

The reviewers and I are all confident that this paper will be interesting to the NeurIPS community and should be accepted. In addition to the improvements suggested by the reviewers, I would encourage the authors to expand the description of how to unfold the recursion in Theorem 3.7. The discussion in Appendix A helps, but it is insufficient as it is missing crucial details that would clarify how to interpret some of the ambiguous notation. I think including a detailed worked example would be an important addition.