English

PixelGAN Autoencoders

Machine Learning 2017-06-05 v1

Abstract

In this paper, we describe the "PixelGAN autoencoder", a generative autoencoder in which the generative path is a convolutional autoregressive neural network on pixels (PixelCNN) that is conditioned on a latent code, and the recognition path uses a generative adversarial network (GAN) to impose a prior distribution on the latent code. We show that different priors result in different decompositions of information between the latent code and the autoregressive decoder. For example, by imposing a Gaussian distribution as the prior, we can achieve a global vs. local decomposition, or by imposing a categorical distribution as the prior, we can disentangle the style and content information of images in an unsupervised fashion. We further show how the PixelGAN autoencoder with a categorical prior can be directly used in semi-supervised settings and achieve competitive semi-supervised classification results on the MNIST, SVHN and NORB datasets.

Keywords

Cite

@article{arxiv.1706.00531,
  title  = {PixelGAN Autoencoders},
  author = {Alireza Makhzani and Brendan Frey},
  journal= {arXiv preprint arXiv:1706.00531},
  year   = {2017}
}
R2 v1 2026-06-22T20:07:05.015Z