English
Related papers

Related papers: Improving VAE generations of multimodal data throu…

200 papers

Variational Auto-Encoders (VAEs) have been widely applied for learning compact, low-dimensional latent representations of high-dimensional data. When the correlation structure among data points is available, previous work proposed…

Machine Learning · Computer Science 2019-12-20 Da Tang , Dawen Liang , Nicholas Ruozzi , Tony Jebara

Variational autoencoders (VAEs) are widely used deep generative models capable of learning unsupervised latent representations of data. Such representations are often difficult to interpret or control. We consider the problem of…

Machine Learning · Computer Science 2018-12-18 Jack Klys , Jake Snell , Richard Zemel

Density estimation, compression and data generation are crucial tasks in artificial intelligence. Variational Auto-Encoders (VAEs) constitute a single framework to achieve these goals. Here, we present a novel class of generative models,…

Machine Learning · Statistics 2021-07-07 Ioannis Gatopoulos , Jakub M. Tomczak

The variational autoencoder (VAE) is a powerful generative model that can estimate the probability of a data point by using latent variables. In the VAE, the posterior of the latent variable given the data point is regularized by the prior…

Machine Learning · Statistics 2019-12-30 Hiroshi Takahashi , Tomoharu Iwata , Yuki Yamanaka , Masanori Yamada , Satoshi Yagi

Variational autoencoders (VAE) are powerful generative models that learn the latent representations of input data as random variables. Recent studies show that VAE can flexibly learn the complex temporal dynamics of time series and achieve…

Machine Learning · Computer Science 2023-11-14 Borui Cai , Shuiqiao Yang , Longxiang Gao , Yong Xiang

We consider the task of estimating variational autoencoders (VAEs) when the training data is incomplete. We show that missing data increases the complexity of the model's posterior distribution over the latent variables compared to the…

Machine Learning · Computer Science 2024-06-28 Vaidotas Simkus , Michael U. Gutmann

Variational Autoencoders (VAEs) provide a theoretically-backed and popular framework for deep generative models. However, learning a VAE from data poses still unanswered theoretical questions and considerable practical challenges. In this…

Machine Learning · Computer Science 2020-06-01 Partha Ghosh , Mehdi S. M. Sajjadi , Antonio Vergari , Michael Black , Bernhard Schölkopf

Deep generative models are commonly used for generating images and text. Interpretability of these models is one important pursuit, other than the generation quality. Variational auto-encoder (VAE) with Gaussian distribution as prior has…

Machine Learning · Computer Science 2020-08-24 Wenxian Shi , Hao Zhou , Ning Miao , Lei Li

Prediction of future states of the environment and interacting agents is a key competence required for autonomous agents to operate successfully in the real world. Prior work for structured sequence prediction based on latent variable…

Computer Vision and Pattern Recognition · Computer Science 2020-08-19 Apratim Bhattacharyya , Michael Hanselmann , Mario Fritz , Bernt Schiele , Christoph-Nikolas Straehle

The posterior collapse phenomenon in variational autoencoder (VAE), where the variational posterior distribution closely matches the prior distribution, can hinder the quality of the learned latent variables. As a consequence of posterior…

Machine Learning · Statistics 2024-05-14 Hien Dang , Tho Tran , Tan Nguyen , Nhat Ho

Large climate-model ensembles are computationally expensive; yet many downstream analyses would benefit from additional, statistically consistent realizations of spatiotemporal climate variables. We study a generative modeling approach for…

Machine Learning · Computer Science 2026-01-06 Jacquelyn Shelton , Przemyslaw Polewski , Alexander Robel , Matthew Hoffman , Stephen Price

Variational autoencoders (VAEs) are a powerful class of deep generative latent variable model for unsupervised representation learning on high-dimensional data. To ensure computational tractability, VAEs are often implemented with a…

Machine Learning · Computer Science 2020-06-09 Alex Campbell , Pietro Liò

Variational autoencoders are prominent generative models for modeling discrete data. However, with flexible decoders, they tend to ignore the latent codes. In this paper, we study a VAE model with a deterministic decoder (DD-VAE) for…

Machine Learning · Computer Science 2020-03-05 Daniil Polykovskiy , Dmitry Vetrov

Variational autoencoders~(VAEs) have shown a promise in data-driven conversation modeling. However, most VAE conversation models match the approximate posterior distribution over the latent variables to a simple prior such as standard…

Computation and Language · Computer Science 2019-02-27 Xiaodong Gu , Kyunghyun Cho , Jung-Woo Ha , Sunghun Kim

We propose Tree Variational Autoencoder (TreeVAE), a new generative hierarchical clustering model that learns a flexible tree-based posterior distribution over latent variables. TreeVAE hierarchically divides samples according to their…

Machine Learning · Computer Science 2023-11-20 Laura Manduchi , Moritz Vandenhirtz , Alain Ryser , Julia Vogt

A new form of variational autoencoder (VAE) is developed, in which the joint distribution of data and codes is considered in two (symmetric) forms: ($i$) from observed data fed through the encoder to yield codes, and ($ii$) from latent…

Machine Learning · Computer Science 2017-11-21 Yunchen Pu , Weiyao Wang , Ricardo Henao , Liqun Chen , Zhe Gan , Chunyuan Li , Lawrence Carin

As deep neural networks become more adept at traditional tasks, many of the most exciting new challenges concern multimodality---observations that combine diverse types, such as image and text. In this paper, we introduce a family of…

Machine Learning · Computer Science 2019-12-12 Mike Wu , Noah Goodman

Variational Autoencoder (VAE)-based generative models offer flexible representation learning by incorporating meta-priors, general premises considered beneficial for downstream tasks. However, the incorporated meta-priors often involve…

Machine Learning · Computer Science 2023-02-27 Nao Nakagawa , Ren Togo , Takahiro Ogawa , Miki Haseyama

In this paper, we propose a latent-variable generative model called mixture of dynamical variational autoencoders (MixDVAE) to model the dynamics of a system composed of multiple moving sources. A DVAE model is pre-trained on a…

Machine Learning · Computer Science 2023-12-08 Xiaoyu Lin , Laurent Girin , Xavier Alameda-Pineda

Semi-supervised learning is sought for leveraging the unlabelled data when labelled data is difficult or expensive to acquire. Deep generative models (e.g., Variational Autoencoder (VAE)) and semisupervised Generative Adversarial Networks…

Machine Learning · Computer Science 2019-05-09 Xiang Zhang , Lina Yao , Feng Yuan