English
Related papers

Related papers: A Batch Normalized Inference Network Keeps the KL …

200 papers

This paper introduces a modified variational autoencoder (VAEs) that contains an additional neural network branch. The resulting branched VAE (BVAE) contributes a classification component based on the class labels to the total loss and…

Machine Learning · Computer Science 2024-01-08 Ahmed Salah , David Yevick

We investigate a fully Latent AutoRegressive scheme based on a Gaussian Process (GP) integrated into a Variational Autoencoder (VAE). In this setting, sequential dynamics are transferred from the observation space to a continuous latent…

Machine Learning · Computer Science 2025-12-16 Yves Ruffenach

With the introduction of the variational autoencoder (VAE), probabilistic latent variable models have received renewed attention as powerful generative models. However, their performance in terms of test likelihood and quality of generated…

Machine Learning · Statistics 2020-01-13 Lars Maaløe , Marco Fraccaro , Valentin Liévin , Ole Winther

We propose a quantum implicit neural representation (QINR)-based autoencoder (AE) and variational autoencoder (VAE) for image reconstruction and generation tasks. Our purpose is to demonstrate that the QINR in VAEs and AEs can transform…

Machine Learning · Computer Science 2026-03-17 Saadet Müzehher Eren

In narrow asymptotic settings Gaussian VAE models of continuous data have been shown to possess global optima aligned with ground-truth distributions. Even so, it is well known that poor solutions whereby the latent posterior collapses to…

Machine Learning · Computer Science 2019-12-24 Bin Dai , Ziyu Wang , David Wipf

Despite recent successes in synthesizing faces and bedrooms, existing generative models struggle to capture more complex image types, potentially due to the oversimplification of their latent space constructions. To tackle this issue,…

Machine Learning · Computer Science 2018-03-13 Wenling Shang , Kihyuk Sohn , Yuandong Tian

Posterior collapse in Variational Autoencoders (VAEs) arises when the variational posterior distribution closely matches the prior for a subset of latent variables. This paper presents a simple and intuitive explanation for posterior…

Machine Learning · Computer Science 2019-11-07 James Lucas , George Tucker , Roger Grosse , Mohammad Norouzi

Variational autoencoders were proven successful in domains such as computer vision and speech processing. Their adoption for modeling user preferences is still unexplored, although recently it is starting to gain attention in the current…

Machine Learning · Computer Science 2018-11-27 Noveen Sachdeva , Giuseppe Manco , Ettore Ritacco , Vikram Pudi

An implicit goal in works on deep generative models is that such models should be able to generate novel examples that were not previously seen in the training data. In this paper, we investigate to what extent this property holds for…

Machine Learning · Computer Science 2018-12-27 Alican Bozkurt , Babak Esmaeili , Dana H. Brooks , Jennifer G. Dy , Jan-Willem van de Meent

It has been previously observed that training Variational Recurrent Autoencoders (VRAE) for text generation suffers from serious uninformative latent variables problem. The model would collapse into a plain language model that totally…

Computation and Language · Computer Science 2019-11-20 Dayiheng Liu , Xu Yang , Feng He , Yuanyuan Chen , Jiancheng Lv

Learning interpretable and disentangled representations of data is a key topic in machine learning research. Variational Autoencoder (VAE) is a scalable method for learning directed latent variable models of complex data. It employs a clear…

Machine Learning · Computer Science 2020-06-04 Andriy Serdega , Dae-Shik Kim

Conditional variational autoencoders (CVAEs) are versatile deep generative models that extend the standard VAE framework by conditioning the generative model with auxiliary covariates. The original CVAE model assumes that the data samples…

Machine Learning · Statistics 2022-03-03 Siddharth Ramchandran , Gleb Tikhonov , Otto Lönnroth , Pekka Tiikkainen , Harri Lähdesmäki

Density estimation, compression and data generation are crucial tasks in artificial intelligence. Variational Auto-Encoders (VAEs) constitute a single framework to achieve these goals. Here, we present a novel class of generative models,…

Machine Learning · Statistics 2021-07-07 Ioannis Gatopoulos , Jakub M. Tomczak

We extend variational autoencoders (VAEs) to collaborative filtering for implicit feedback. This non-linear probabilistic model enables us to go beyond the limited modeling capacity of linear factor models which still largely dominate…

Machine Learning · Statistics 2018-02-19 Dawen Liang , Rahul G. Krishnan , Matthew D. Hoffman , Tony Jebara

Variational autoencoders (VAEs) often suffer from posterior collapse, which is a phenomenon in which the learned latent space becomes uninformative. This is often related to the hyperparameter resembling the data variance. It can be shown…

Machine Learning · Computer Science 2022-08-23 Yuhta Takida , Wei-Hsiang Liao , Chieh-Hsin Lai , Toshimitsu Uesaka , Shusuke Takahashi , Yuki Mitsufuji

Variational Inference (VI) is a popular alternative to asymptotically exact sampling in Bayesian inference. Its main workhorse is optimization over a reverse Kullback-Leibler divergence (RKL), which typically underestimates the tail of the…

Machine Learning · Statistics 2021-07-01 Ghassen Jerfel , Serena Wang , Clara Fannjiang , Katherine A. Heller , Yian Ma , Michael I. Jordan

Variational autoencoders (VAEs) are one class of generative probabilistic latent-variable models designed for inference based on known data. We develop three variations on VAEs by introducing a second parameterized encoder/decoder pair and,…

Machine Learning · Computer Science 2023-04-06 R. I. Cukier

Variational Autoencoders (VAEs) are expressive latent variable models that can be used to learn complex probability distributions from training data. However, the quality of the resulting model crucially relies on the expressiveness of the…

Machine Learning · Computer Science 2018-06-12 Lars Mescheder , Sebastian Nowozin , Andreas Geiger

We propose a robust and scalable variational Bayes (VB) framework designed to effectively handle contamination and outliers in dataset. Our approach partitions the data into $m$ disjoint subsets and formulates a joint optimization problem…

Methodology · Statistics 2025-12-16 Jiawei Yan , Ju Liu , Weidong Liu , Jiyuan Tu

While hierarchical variational autoencoders (VAEs) have achieved great density estimation on image modeling tasks, samples from their prior tend to look less convincing than models with similar log-likelihood. We attribute this to learned…

Machine Learning · Computer Science 2022-10-20 Eric Luhman , Troy Luhman