Embedding of FRPN in CNN architecture
Abstract
This paper extends the fully recursive perceptron network (FRPN) model for vectorial inputs to include deep convolutional neural networks (CNNs) which can accept multi-dimensional inputs. A FRPN consists of a recursive layer, which, given a fixed input, iteratively computes an equilibrium state. The unfolding realized with this kind of iterative mechanism allows to simulate a deep neural network with any number of layers. The extension of the FRPN to CNN results in an architecture, which we call convolutional-FRPN (C-FRPN), where the convolutional layers are recursive. The method is evaluated on several image classification benchmarks. It is shown that the C-FRPN consistently outperforms standard CNNs having the same number of parameters. The gap in performance is particularly large for small networks, showing that the C-FRPN is a very powerful architecture, since it allows to obtain equivalent performance with fewer parameters when compared with deep CNNs.
Cite
@article{arxiv.2001.05851,
title = {Embedding of FRPN in CNN architecture},
author = {Alberto Rossi and Markus Hagenbuchner and Franco Scarselli and Ah Chung Tsoi},
journal= {arXiv preprint arXiv:2001.05851},
year = {2020}
}