English

On the Information Theoretic Distance Measures and Bidirectional Helmholtz Machines

Machine Learning 2018-07-18 v1 Information Theory math.IT Machine Learning

Abstract

By establishing a connection between bi-directional Helmholtz machines and information theory, we propose a generalized Helmholtz machine. Theoretical and experimental results show that given \textit{shallow} architectures, the generalized model outperforms the previous ones substantially.

Keywords

Cite

@article{arxiv.1807.06054,
  title  = {On the Information Theoretic Distance Measures and Bidirectional Helmholtz Machines},
  author = {Mahdi Azarafrooz and Xuan Zhao and Sepehr Akhavan-Masouleh},
  journal= {arXiv preprint arXiv:1807.06054},
  year   = {2018}
}