中文
相关论文

相关论文: Discouraging posterior collapse in hierarchical Va…

200 篇论文

Despite advances in deep probabilistic models, learning discrete latent representations remains challenging. This work introduces a novel method to improve inference in discrete Variational Autoencoders by reframing the inference problem…

机器学习 · 计算机科学 2025-06-11 María Martínez-García , Grace Villacrés , David Mitchell , Pablo M. Olmos

Classical methods for model order selection often fail in scenarios with low SNR or few snapshots. Deep learning-based methods are promising alternatives for such challenging situations as they compensate lack of information in the…

信号处理 · 电气工程与系统科学 2023-12-07 Michael Baur , Franz Weißer , Benedikt Böck , Wolfgang Utschick

Variational Auto-Encoders (VAEs) have been widely applied for learning compact, low-dimensional latent representations of high-dimensional data. When the correlation structure among data points is available, previous work proposed…

机器学习 · 计算机科学 2019-12-20 Da Tang , Dawen Liang , Nicholas Ruozzi , Tony Jebara

Variational Autoencoder (VAE), a simple and effective deep generative model, has led to a number of impressive empirical successes and spawned many advanced variants and theoretical investigations. However, recent studies demonstrate that,…

机器学习 · 计算机科学 2019-01-08 Xuezhe Ma , Chunting Zhou , Eduard Hovy

Variational autoencoders are prominent generative models for modeling discrete data. However, with flexible decoders, they tend to ignore the latent codes. In this paper, we study a VAE model with a deterministic decoder (DD-VAE) for…

机器学习 · 计算机科学 2020-03-05 Daniil Polykovskiy , Dmitry Vetrov

Variational AutoEncoders (VAEs) are powerful generative models that merge elements from statistics and information theory with the flexibility offered by deep neural networks to efficiently solve the generation problem for high dimensional…

机器学习 · 计算机科学 2021-03-02 A. Asperti , D. Evangelista , E. Loli Piccolomini

It has been previously observed that training Variational Recurrent Autoencoders (VRAE) for text generation suffers from serious uninformative latent variables problem. The model would collapse into a plain language model that totally…

计算与语言 · 计算机科学 2019-11-20 Dayiheng Liu , Xu Yang , Feng He , Yuanyuan Chen , Jiancheng Lv

Variational autoencoders (VAEs) have been widely applied for text modeling. In practice, however, they are troubled by two challenges: information underrepresentation and posterior collapse. The former arises as only the last hidden state…

机器学习 · 计算机科学 2021-06-17 Xianghong Fang , Haoli Bai , Jian Li , Zenglin Xu , Michael Lyu , Irwin King

We propose Tree Variational Autoencoder (TreeVAE), a new generative hierarchical clustering model that learns a flexible tree-based posterior distribution over latent variables. TreeVAE hierarchically divides samples according to their…

机器学习 · 计算机科学 2023-11-20 Laura Manduchi , Moritz Vandenhirtz , Alain Ryser , Julia Vogt

Learning latent representations that are simultaneously expressive, geometrically well-structured, and reliably calibrated remains a central challenge for Variational Autoencoders (VAEs). Standard VAEs typically assume a diagonal Gaussian…

机器学习 · 计算机科学 2025-12-02 Mehmet Can Yavuz

The variational autoencoder (VAE) is a popular, deep, latent-variable model (DLVM) due to its simple yet effective formulation for modeling the data distribution. Moreover, optimizing the VAE objective function is more manageable than other…

机器学习 · 计算机科学 2025-01-28 Surojit Saha , Sarang Joshi , Ross Whitaker

We consider the problem of learning Variational Autoencoders (VAEs), i.e., a type of deep generative model, from data with missing values. Such data is omnipresent in real-world applications of machine learning because complete data is…

机器学习 · 计算机科学 2023-10-26 Timur Sudak , Sebastian Tschiatschek

Variational autoencoders (VAEs), as well as other generative models, have been shown to be efficient and accurate for capturing the latent structure of vast amounts of complex high-dimensional data. However, existing VAEs can still not…

机器学习 · 计算机科学 2020-05-25 Alfredo Nazabal , Pablo M. Olmos , Zoubin Ghahramani , Isabel Valera

An implicit goal in works on deep generative models is that such models should be able to generate novel examples that were not previously seen in the training data. In this paper, we investigate to what extent this property holds for…

机器学习 · 计算机科学 2018-12-27 Alican Bozkurt , Babak Esmaeili , Dana H. Brooks , Jennifer G. Dy , Jan-Willem van de Meent

Variational autoencoders (VAE) encode data into lower-dimensional latent vectors before decoding those vectors back to data. Once trained, decoding a random latent vector from the prior usually does not produce meaningful data, at least…

机器学习 · 计算机科学 2025-07-23 Alejandro Ascarate , Leo Lebrat , Rodrigo Santa Cruz , Clinton Fookes , Olivier Salvado

Variational autoencoders (VAE) are powerful generative models that learn the latent representations of input data as random variables. Recent studies show that VAE can flexibly learn the complex temporal dynamics of time series and achieve…

机器学习 · 计算机科学 2023-11-14 Borui Cai , Shuiqiao Yang , Longxiang Gao , Yong Xiang

Variational Autoencoders are powerful models for unsupervised learning. However deep models with several layers of dependent stochastic variables are difficult to train which limits the improvements obtained using these highly expressive…

Variational autoencoders (VAEs) frequently suffer from posterior collapse, where the latent variables become uninformative as the approximate posterior degenerates to the prior. While recent work has characterized collapse as a phase…

机器学习 · 计算机科学 2026-05-19 Zegu Zhang , Jian Zhang

The variational autoencoder (VAE) is a powerful generative model that can estimate the probability of a data point by using latent variables. In the VAE, the posterior of the latent variable given the data point is regularized by the prior…

机器学习 · 统计学 2019-12-30 Hiroshi Takahashi , Tomoharu Iwata , Yuki Yamanaka , Masanori Yamada , Satoshi Yagi

Many different methods to train deep generative models have been introduced in the past. In this paper, we propose to extend the variational auto-encoder (VAE) framework with a new type of prior which we call "Variational Mixture of…

机器学习 · 计算机科学 2018-02-27 Jakub M. Tomczak , Max Welling