English

Balancing reconstruction error and Kullback-Leibler divergence in Variational Autoencoders

Neural and Evolutionary Computing 2020-02-19 v1 Machine Learning

Abstract

In the loss function of Variational Autoencoders there is a well known tension between two components: the reconstruction loss, improving the quality of the resulting images, and the Kullback-Leibler divergence, acting as a regularizer of the latent space. Correctly balancing these two components is a delicate issue, easily resulting in poor generative behaviours. In a recent work, Dai and Wipf obtained a sensible improvement by allowing the network to learn the balancing factor during training, according to a suitable loss function. In this article, we show that learning can be replaced by a simple deterministic computation, helping to understand the underlying mechanism, and resulting in a faster and more accurate behaviour. On typical datasets such as Cifar and Celeba, our technique sensibly outperforms all previous VAE architectures.

Keywords

Cite

@article{arxiv.2002.07514,
  title  = {Balancing reconstruction error and Kullback-Leibler divergence in Variational Autoencoders},
  author = {Andrea Asperti and Matteo Trentin},
  journal= {arXiv preprint arXiv:2002.07514},
  year   = {2020}
}
R2 v1 2026-06-23T13:45:12.175Z