English
Related papers

Related papers: Learning variational autoencoders via MCMC speed m…

200 papers

Learning a generative model from partial data (data with missingness) is a challenging area of machine learning research. We study a specific implementation of the Auto-Encoding Variational Bayes (AEVB) algorithm, named in this paper as a…

Machine Learning · Computer Science 2021-01-05 Amir Zadeh , Yao-Chong Lim , Paul Pu Liang , Louis-Philippe Morency

Most visual generative models compress images into a latent space before applying diffusion or autoregressive modelling. Yet, existing approaches such as VAEs and foundation model aligned encoders implicitly constrain the latent space…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Sen Ye , Jianning Pei , Mengde Xu , Shuyang Gu , Chunyu Wang , Liwei Wang , Han Hu

Variational autoencoders learn distributions of high-dimensional data. They model data with a deep latent-variable model and then fit the model by maximizing a lower bound of the log marginal likelihood. VAEs can capture complex…

Machine Learning · Statistics 2019-02-01 Adji B. Dieng , Yoon Kim , Alexander M. Rush , David M. Blei

Powerful generative models, particularly in Natural Language Modelling, are commonly trained by maximizing a variational lower bound on the data log likelihood. These models often suffer from poor use of their latent variable, with ad-hoc…

Machine Learning · Statistics 2018-06-13 Alex Mansbridge , Roberto Fierimonte , Ilya Feige , David Barber

Variational auto-encoders (VAEs) have proven to be a well suited tool for performing dimensionality reduction by extracting latent variables lying in a potentially much smaller dimensional space than the data. Their ability to capture…

Machine Learning · Statistics 2020-10-23 Clément Chadebec , Clément Mantoux , Stéphanie Allassonnière

Variational auto-encoders (VAEs) are a popular and powerful deep generative model. Previous works on VAEs have assumed a factorized likelihood model, whereby the output uncertainty of each pixel is assumed to be independent. This…

Machine Learning · Statistics 2026-05-14 Gara Dorta , Sara Vicente , Lourdes Agapito , Neill D. F. Campbell , Ivor Simpson

Deep latent variable models (DLVMs) are designed to learn meaningful representations in an unsupervised manner, such that the hidden explanatory factors are interpretable by independent latent variables (aka disentanglement). The…

Machine Learning · Computer Science 2025-01-28 Surojit Saha , Sarang Joshi , Ross Whitaker

Generative models for multimodal data permit the identification of latent factors that may be associated with important determinants of observed data heterogeneity. Common or shared factors could be important for explaining variation across…

Machine Learning · Statistics 2024-03-12 Kaspar Märtens , Christopher Yau

Multi-access edge computing (MEC) is viewed as an integral part of future wireless networks to support new applications with stringent service reliability and latency requirements. However, guaranteeing ultra-reliable and low-latency MEC…

Systems and Control · Electrical Eng. & Systems 2022-01-26 Arian Ahmadi , Omid Semiari , Mehdi Bennis , Merouane Debbah

Variational autoencoder (VAE) neural networks can be trained to generate power system states that capture both marginal distribution and multivariate dependencies of historical data. The coordinates of the latent space codes of VAEs have…

Systems and Control · Electrical Eng. & Systems 2023-03-22 Chenguang Wang , Ensieh Sharifnia , Simon H. Tindemans , Peter Palensky

Predicting customers' long-term revenue from sparse and irregular transaction data is central to marketing resource allocation in non-contractual settings, yet existing approaches face a trade-off. Traditional probabilistic customer base…

Machine Learning · Statistics 2026-04-27 Jeffrey Näf , Riana Valera Mbelson , Markus Meierer

A probability distribution allows practitioners to uncover hidden structure in the data and build models to solve supervised learning problems using limited data. The focus of this report is on Variational autoencoders, a method to learn…

Machine Learning · Computer Science 2022-06-22 Vasanth Kalingeri

Practitioners of Bayesian statistics have long depended on Markov chain Monte Carlo (MCMC) to obtain samples from intractable posterior distributions. Unfortunately, MCMC algorithms are typically serial, and do not scale to the large…

Machine Learning · Statistics 2015-06-11 Maxim Rabinovich , Elaine Angelino , Michael I. Jordan

Generalized linear latent variable models (GLLVMs) are a class of methods for analyzing multi-response data which has garnered considerable popularity in recent years, for example, in the analysis of multivariate abundance data in ecology.…

Methodology · Statistics 2021-07-07 Pekka Korhonen , Francis K. C. Hui , Jenni Niku , Sara Taskinen

We propose a new computationally efficient sampling scheme for Bayesian inference involving high dimensional probability distributions. Our method maps the original parameter space into a low-dimensional latent space, explores the latent…

Computation · Statistics 2019-10-15 Babak Shahbaba , Luis Martinez Lomeli , Tian Chen , Shiwei Lan

Large climate-model ensembles are computationally expensive; yet many downstream analyses would benefit from additional, statistically consistent realizations of spatiotemporal climate variables. We study a generative modeling approach for…

Machine Learning · Computer Science 2026-01-06 Jacquelyn Shelton , Przemyslaw Polewski , Alexander Robel , Matthew Hoffman , Stephen Price

With the increasingly widespread deployment of generative models, there is a mounting need for a deeper understanding of their behaviors and limitations. In this paper, we expose the limitations of Variational Autoencoders (VAEs), which…

Machine Learning · Statistics 2019-06-12 Mihaela Rosca , Balaji Lakshminarayanan , Shakir Mohamed

Variational autoencoders (VAEs), that are built upon deep neural networks have emerged as popular generative models in computer vision. Most of the work towards improving variational autoencoders has focused mainly on making the…

Machine Learning · Statistics 2016-11-17 Siddharth Agrawal , Ambedkar Dukkipati

Deep generative models are increasingly becoming integral parts of the in silico molecule design pipeline and have dual goals of learning the chemical and structural features that render candidate molecules viable while also being flexible…

Biomolecules · Quantitative Biology 2021-06-08 Yair Schiff , Vijil Chenthamarakshan , Karthikeyan Natesan Ramamurthy , Payel Das

The surrogate loss of variational autoencoders (VAEs) poses various challenges to their training, inducing the imbalance between task fitting and representation inference. To avert this, the existing strategies for VAEs focus on adjusting…

Neural and Evolutionary Computing · Computer Science 2024-04-02 Zhangkai Wu , Longbing Cao , Lei Qi