Hierarchical Temporal Representation in Linear Reservoir Computing
Machine Learning
2017-07-11 v5 Machine Learning
Abstract
Recently, studies on deep Reservoir Computing (RC) highlighted the role of layering in deep recurrent neural networks (RNNs). In this paper, the use of linear recurrent units allows us to bring more evidence on the intrinsic hierarchical temporal representation in deep RNNs through frequency analysis applied to the state signals. The potentiality of our approach is assessed on the class of Multiple Superimposed Oscillator tasks. Furthermore, our investigation provides useful insights to open a discussion on the main aspects that characterize the deep learning framework in the temporal domain.
Cite
@article{arxiv.1705.05782,
title = {Hierarchical Temporal Representation in Linear Reservoir Computing},
author = {Claudio Gallicchio and Alessio Micheli and Luca Pedrelli},
journal= {arXiv preprint arXiv:1705.05782},
year = {2017}
}
Comments
This is a pre-print of the paper submitted to the 27th Italian Workshop on Neural Networks, WIRN 2017