English

Enhanced Variational Inference with Dyadic Transformation

Machine Learning 2019-03-11 v2 Machine Learning

Abstract

Variational autoencoder is a powerful deep generative model with variational inference. The practice of modeling latent variables in the VAE's original formulation as normal distributions with a diagonal covariance matrix limits the flexibility to match the true posterior distribution. We propose a new transformation, dyadic transformation (DT), that can model a multivariate normal distribution. DT is a single-stage transformation with low computational requirements. We demonstrate empirically on MNIST dataset that DT enhances the posterior flexibility and attains competitive results compared to other VAE enhancements.

Keywords

Cite

@article{arxiv.1901.10621,
  title  = {Enhanced Variational Inference with Dyadic Transformation},
  author = {Sarin Chandy and Amin Rasekh},
  journal= {arXiv preprint arXiv:1901.10621},
  year   = {2019}
}
R2 v1 2026-06-23T07:26:29.720Z