In this work we compute lower Lipschitz bounds of ℓp pooling operators for p=1,2,∞ as well as ℓp pooling operators preceded by half-rectification layers. These give sufficient conditions for the design of invertible neural network layers. Numerical experiments on MNIST and image patches confirm that pooling layers can be inverted with phase recovery algorithms. Moreover, the regularity of the inverse pooling, controlled by the lower Lipschitz constant, is empirically verified with a nearest neighbor regression.
Cite
@article{arxiv.1311.4025,
title = {Signal Recovery from Pooling Representations},
author = {Joan Bruna and Arthur Szlam and Yann LeCun},
journal= {arXiv preprint arXiv:1311.4025},
year = {2014}
}