Comment on "Why does deep and cheap learning work so well?" [arXiv:1608.08225]
Disordered Systems and Neural Networks
2016-09-13 v1 Machine Learning
Machine Learning
Abstract
In a recent paper, "Why does deep and cheap learning work so well?", Lin and Tegmark claim to show that the mapping between deep belief networks and the variational renormalization group derived in [arXiv:1410.3831] is invalid, and present a "counterexample" that claims to show that this mapping does not hold. In this comment, we show that these claims are incorrect and stem from a misunderstanding of the variational RG procedure proposed by Kadanoff. We also explain why the "counterexample" of Lin and Tegmark is compatible with the mapping proposed in [arXiv:1410.3831].
Cite
@article{arxiv.1609.03541,
title = {Comment on "Why does deep and cheap learning work so well?" [arXiv:1608.08225]},
author = {David J. Schwab and Pankaj Mehta},
journal= {arXiv preprint arXiv:1609.03541},
year = {2016}
}
Comments
Comment on arXiv:1608.08225