中文
相关论文

相关论文: Neural Gaussian Copula for Variational Autoencoder

200 篇论文

Text variational autoencoders (VAEs) are notorious for posterior collapse, a phenomenon where the model's decoder learns to ignore signals from the encoder. Because posterior collapse is known to be exacerbated by expressive decoders,…

计算与语言 · 计算机科学 2021-11-25 Seongmin Park , Jihwa Lee

Variational Autoencoder (VAE) is widely used as a generative model to approximate a model's posterior on latent variables by combining the amortized variational inference and deep neural networks. However, when paired with strong…

机器学习 · 计算机科学 2020-06-02 Qile Zhu , Jianlin Su , Wei Bi , Xiaojiang Liu , Xiyao Ma , Xiaolin Li , Dapeng Wu

As one of the most popular generative models, Variational Autoencoder (VAE) approximates the posterior of latent variables based on amortized variational inference. However, when the decoder network is sufficiently expressive, VAE may lead…

机器学习 · 计算机科学 2021-10-26 Dazhong Shen , Chuan Qin , Chao Wang , Hengshu Zhu , Enhong Chen , Hui Xiong

Posterior collapse plagues VAEs for text, especially for conditional text generation with strong autoregressive decoders. In this work, we address this problem in variational neural machine translation by explicitly promoting mutual…

计算与语言 · 计算机科学 2019-09-23 Arya D. McCarthy , Xian Li , Jiatao Gu , Ning Dong

Variational Autoencoder (VAE) is a powerful method for learning representations of high-dimensional data. However, VAEs can suffer from an issue known as latent variable collapse (or KL loss vanishing), where the posterior collapses to the…

计算与语言 · 计算机科学 2019-11-14 Ruizhe Li , Xiao Li , Chenghua Lin , Matthew Collinson , Rui Mao

In variational autoencoders (VAEs), the variational posterior often collapses to the prior, known as posterior collapse, which leads to poor representation learning quality. An adjustable hyperparameter beta has been introduced in VAEs to…

机器学习 · 统计学 2025-07-22 Yuma Ichikawa , Koji Hukushima

Predicting future frames of video sequences is challenging due to the complex and stochastic nature of the problem. Video prediction methods based on variational auto-encoders (VAEs) have been a great success, but they require the training…

计算机视觉与模式识别 · 计算机科学 2021-01-29 Yizhou Zhou , Chong Luo , Xiaoyan Sun , Zheng-Jun Zha , Wenjun Zeng

We utilize copulas to constitute a unified framework for constructing and optimizing variational proposals in hierarchical Bayesian models. For models with continuous and non-Gaussian hidden variables, we propose a semiparametric and…

机器学习 · 统计学 2016-05-19 Shaobo Han , Xuejun Liao , David B. Dunson , Lawrence Carin

Multi-view data from the same source often exhibit correlation. This is mirrored in correlation between the latent spaces of separate variational autoencoders (VAEs) trained on each data-view. A multi-view VAE approach is proposed that…

机器学习 · 统计学 2025-08-01 Ella S. C. Orme , Marina Evangelou , Ulrich Paquet

Variational Auto-Encoders (VAEs) have been widely applied for learning compact, low-dimensional latent representations of high-dimensional data. When the correlation structure among data points is available, previous work proposed…

机器学习 · 计算机科学 2019-12-20 Da Tang , Dawen Liang , Nicholas Ruozzi , Tony Jebara

The variational autoencoder (VAE) framework is a popular option for training unsupervised generative models, featuring ease of training and latent representation of data. The objective function of VAE does not guarantee to achieve the…

机器学习 · 计算机科学 2019-04-25 Jason Chou

In Bayesian machine learning, the posterior distribution is typically computationally intractable, hence variational inference is often required. In this approach, an evidence lower bound on the log likelihood of data is maximized during…

机器学习 · 计算机科学 2019-07-23 Stephen Odaibo

Variational autoencoders (VAEs) have been used extensively to discover low-dimensional latent factors governing neural activity and animal behavior. However, without careful model selection, the uncovered latent factors may reflect noise in…

机器学习 · 计算机科学 2023-12-13 Julia Huiming Wang , Dexter Tsin , Tatiana Engel

We investigate a fully Latent AutoRegressive scheme based on a Gaussian Process (GP) integrated into a Variational Autoencoder (VAE). In this setting, sequential dynamics are transferred from the observation space to a continuous latent…

机器学习 · 计算机科学 2025-12-16 Yves Ruffenach

Variational autoencoders learn distributions of high-dimensional data. They model data with a deep latent-variable model and then fit the model by maximizing a lower bound of the log marginal likelihood. VAEs can capture complex…

机器学习 · 统计学 2019-02-01 Adji B. Dieng , Yoon Kim , Alexander M. Rush , David M. Blei

Advances in variational inference enable parameterisation of probabilistic models by deep neural networks. This combines the statistical transparency of the probabilistic modelling framework with the representational power of deep learning.…

计算与语言 · 计算机科学 2020-05-05 Tom Pelsmaeker , Wilker Aziz

Variational autoencoders (VAEs), that are built upon deep neural networks have emerged as popular generative models in computer vision. Most of the work towards improving variational autoencoders has focused mainly on making the…

机器学习 · 统计学 2016-11-17 Siddharth Agrawal , Ambedkar Dukkipati

The Variational Autoencoder (VAE) is known to suffer from the phenomenon of \textit{posterior collapse}, where the latent representations generated by the model become independent of the inputs. This leads to degenerated representations of…

机器学习 · 计算机科学 2023-09-12 Fotios Lygerakis , Elmar Rueckert

Conditional variational autoencoders (CVAEs) are versatile deep generative models that extend the standard VAE framework by conditioning the generative model with auxiliary covariates. The original CVAE model assumes that the data samples…

The variational autoencoder (VAE) is a powerful generative model that can estimate the probability of a data point by using latent variables. In the VAE, the posterior of the latent variable given the data point is regularized by the prior…

机器学习 · 统计学 2019-12-30 Hiroshi Takahashi , Tomoharu Iwata , Yuki Yamanaka , Masanori Yamada , Satoshi Yagi