On implicit regularization: Morse functions and applications to matrix factorization
Machine Learning
2020-02-04 v2 Machine Learning
Abstract
In this paper, we revisit implicit regularization from the ground up using notions from dynamical systems and invariant subspaces of Morse functions. The key contributions are a new criterion for implicit regularization---a leading contender to explain the generalization power of deep models such as neural networks---and a general blueprint to study it. We apply these techniques to settle a conjecture on implicit regularization in matrix factorization.
Cite
@article{arxiv.2001.04264,
title = {On implicit regularization: Morse functions and applications to matrix factorization},
author = {Mohamed Ali Belabbas},
journal= {arXiv preprint arXiv:2001.04264},
year = {2020}
}