English

Learning Stochastic Recurrent Networks

Machine Learning 2015-03-09 v3 Machine Learning

Abstract

Leveraging advances in variational inference, we propose to enhance recurrent neural networks with latent variables, resulting in Stochastic Recurrent Networks (STORNs). The model i) can be trained with stochastic gradient methods, ii) allows structured and multi-modal conditionals at each time step, iii) features a reliable estimator of the marginal likelihood and iv) is a generalisation of deterministic recurrent neural networks. We evaluate the method on four polyphonic musical data sets and motion capture data.

Keywords

Cite

@article{arxiv.1411.7610,
  title  = {Learning Stochastic Recurrent Networks},
  author = {Justin Bayer and Christian Osendorfer},
  journal= {arXiv preprint arXiv:1411.7610},
  year   = {2015}
}

Comments

Submitted to conference track of ICLR 2015

R2 v1 2026-06-22T07:14:28.986Z