English
Related papers

Related papers: Optimizing Hierarchical Image VAEs for Sample Qual…

200 papers

In this paper, we study two aspects of the variational autoencoder (VAE): the prior distribution over the latent variables and its corresponding posterior. First, we decompose the learning of VAEs into layerwise density estimation, and…

Machine Learning · Computer Science 2017-10-09 Chin-Wei Huang , Ahmed Touati , Laurent Dinh , Michal Drozdzal , Mohammad Havaei , Laurent Charlin , Aaron Courville

We present a coupled Variational Auto-Encoder (VAE) method that improves the accuracy and robustness of the probabilistic inferences on represented data. The new method models the dependency between input feature vectors (images) and weighs…

Machine Learning · Computer Science 2025-11-25 Shichen Cao , Jingjing Li , Kenric P. Nelson , Mark A. Kon

Discrete latent bottlenecks in variational autoencoders (VAEs) offer high bit efficiency and can be modeled with autoregressive discrete distributions, enabling parameter-efficient multimodal search with transformers. However, discrete…

Machine Learning · Computer Science 2026-02-12 Michael Drolet , Firas Al-Hafez , Aditya Bhatt , Jan Peters , Oleg Arenz

Optimal computations under uncertainty require an adequate probabilistic representation about beliefs. Deep generative models, and specifically Variational Autoencoders (VAEs), have the potential to meet this demand by building latent…

Traditional transformer-based semantic segmentation relies on quantized embeddings. However, our analysis reveals that autoencoder accuracy on segmentation mask using quantized embeddings (e.g. VQ-VAE) is 8% lower than continuous-valued…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Masud Ahmed , Zahid Hasan , Syed Arefinul Haque , Abu Zaher Md Faridee , Sanjay Purushotham , Suya You , Nirmalya Roy

The variational autoencoder (VAE) framework is a popular option for training unsupervised generative models, featuring ease of training and latent representation of data. The objective function of VAE does not guarantee to achieve the…

Machine Learning · Computer Science 2019-04-25 Jason Chou

Although semi-supervised variational autoencoder (SemiVAE) works in image classification task, it fails in text classification task if using vanilla LSTM as its decoder. From a perspective of reinforcement learning, it is verified that the…

Computation and Language · Computer Science 2016-11-28 Weidi Xu , Haoze Sun , Chao Deng , Ying Tan

Variational autoencoders (VAEs) are popular likelihood-based generative models which can be efficiently trained by maximizing an Evidence Lower Bound (ELBO). There has been much progress in improving the expressiveness of the variational…

Machine Learning · Statistics 2023-08-29 Marcel Hirt , Vasileios Kreouzis , Petros Dellaportas

The Variational Autoencoder (VAE) is a popular and powerful model applied to text modelling to generate diverse sentences. However, an issue known as posterior collapse (or KL loss vanishing) happens when the VAE is used in text modelling,…

Computation and Language · Computer Science 2020-11-04 Ruizhe Li , Xiao Li , Guanyi Chen , Chenghua Lin

Variational Autoencoders (VAEs) have become a cornerstone in generative modeling and representation learning within machine learning. This paper explores a nuanced aspect of VAEs, focusing on interpreting the Kullback-Leibler (KL)…

Machine Learning · Computer Science 2024-06-25 Mariano Rivera

Variational Autoencoders (VAEs) have been a pioneering force in the realm of deep generative models. Amongst its legions of progenies, Wasserstein Autoencoders (WAEs) stand out in particular due to the dual offering of heightened generative…

Machine Learning · Statistics 2023-12-12 Anish Chakrabarty , Arkaprabha Basu , Swagatam Das

Vector-Quantized Variational Autoencoders (VQ-VAE)[1] provide an unsupervised model for learning discrete representations by combining vector quantization and autoencoders. In this paper, we study the use of VQ-VAE for representation…

Image and Video Processing · Electrical Eng. & Systems 2019-03-05 Hanwei Wu , Markus Flierl

We propose a new structure for the variational auto-encoders (VAEs) prior, with the weakly informative multivariate Student's t-distribution. In the proposed model all distribution parameters are trained, thereby allowing for a more robust…

Machine Learning · Computer Science 2020-04-07 Najmeh Abiri , Mattias Ohlsson

The volume of remote sensing data is experiencing rapid growth, primarily due to the plethora of space and air platforms equipped with an array of sensors. Due to limited hardware and battery constraints the data is transmitted back to…

Image and Video Processing · Electrical Eng. & Systems 2024-04-18 Alessandro Giuliano , S. Andrew Gadsden , Waleed Hilal , John Yawney

Understanding relationships across multiple imaging modalities is central to neuroimaging research. We introduce the Integrative Variational Autoencoder (InVA), the first hierarchical VAE framework for image-on-image regression in…

Image and Video Processing · Electrical Eng. & Systems 2025-09-15 Bowen Lei , Yeseul Jeon , Rajarshi Guhaniyogi , Aaron Scheffler , Bani Mallick , Alzheimer's Disease Neuroimaging Initiatives

Variational autoencoders (VAEs) are one of the powerful unsupervised learning frameworks in NLP for latent representation learning and latent-directed generation. The classic optimization goal of VAEs is to maximize the Evidence Lower Bound…

Machine Learning · Computer Science 2022-11-02 Jianfei Zhang , Jun Bai , Chenghua Lin , Yanmeng Wang , Wenge Rong

The variational auto-encoder (VAE) is a deep latent variable model that has two neural networks in an autoencoder-like architecture; one of them parameterizes the model's likelihood. Fitting its parameters via maximum likelihood (ML) is…

Machine Learning · Computer Science 2021-06-03 Francisco J. R. Ruiz , Michalis K. Titsias , Taylan Cemgil , Arnaud Doucet

Machine learning methods often need a large amount of labeled training data. Since the training data is assumed to be the ground truth, outliers can severely degrade learned representations and performance of trained models. Here we apply…

Machine Learning · Statistics 2019-12-24 Haleh Akrami , Anand A. Joshi , Jian Li , Sergul Aydore , Richard M. Leahy

Variational Autoencoders (VAEs) remain a cornerstone of generative computer vision, yet their training is often plagued by artifacts that degrade reconstruction and generation quality. This paper introduces VIVAT, a systematic approach to…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Lev Novitskiy , Viacheslav Vasilev , Maria Kovaleva , Vladimir Arkhipkin , Denis Dimitrov

$\beta$-VAE is a follow-up technique to variational autoencoders that proposes special weighting of the KL divergence term in the VAE loss to obtain disentangled representations. Unsupervised learning is known to be brittle even on toy…

Machine Learning · Computer Science 2022-01-03 Miroslav Fil , Munib Mesinovic , Matthew Morris , Jonas Wildberger