中文
相关论文

相关论文: Improve variational autoEncoder with auxiliary sof…

200 篇论文

The posterior collapse phenomenon in variational autoencoder (VAE), where the variational posterior distribution closely matches the prior distribution, can hinder the quality of the learned latent variables. As a consequence of posterior…

机器学习 · 统计学 2024-05-14 Hien Dang , Tho Tran , Tan Nguyen , Nhat Ho

The variational autoencoder (VAE) framework is a popular option for training unsupervised generative models, featuring ease of training and latent representation of data. The objective function of VAE does not guarantee to achieve the…

机器学习 · 计算机科学 2019-04-25 Jason Chou

Posterior collapse plagues VAEs for text, especially for conditional text generation with strong autoregressive decoders. In this work, we address this problem in variational neural machine translation by explicitly promoting mutual…

计算与语言 · 计算机科学 2019-09-23 Arya D. McCarthy , Xian Li , Jiatao Gu , Ning Dong

The variational autoencoder (VAE) is a popular combination of deep latent variable model and accompanying variational learning technique. By using a neural inference network to approximate the model's posterior on latent variables, VAEs…

机器学习 · 计算机科学 2019-01-30 Junxian He , Daniel Spokoyny , Graham Neubig , Taylor Berg-Kirkpatrick

Variational autoencoders (VAEs) often suffer from posterior collapse, which is a phenomenon in which the learned latent space becomes uninformative. This is often related to the hyperparameter resembling the data variance. It can be shown…

机器学习 · 计算机科学 2022-08-23 Yuhta Takida , Wei-Hsiang Liao , Chieh-Hsin Lai , Toshimitsu Uesaka , Shusuke Takahashi , Yuki Mitsufuji

The Variational Autoencoder (VAE) is a popular and powerful model applied to text modelling to generate diverse sentences. However, an issue known as posterior collapse (or KL loss vanishing) happens when the VAE is used in text modelling,…

计算与语言 · 计算机科学 2020-11-04 Ruizhe Li , Xiao Li , Guanyi Chen , Chenghua Lin

Text variational autoencoders (VAEs) are notorious for posterior collapse, a phenomenon where the model's decoder learns to ignore signals from the encoder. Because posterior collapse is known to be exacerbated by expressive decoders,…

计算与语言 · 计算机科学 2021-11-25 Seongmin Park , Jihwa Lee

Variational Autoencoder (VAE) is a powerful method for learning representations of high-dimensional data. However, VAEs can suffer from an issue known as latent variable collapse (or KL loss vanishing), where the posterior collapses to the…

计算与语言 · 计算机科学 2019-11-14 Ruizhe Li , Xiao Li , Chenghua Lin , Matthew Collinson , Rui Mao

As one of the most popular generative models, Variational Autoencoder (VAE) approximates the posterior of latent variables based on amortized variational inference. However, when the decoder network is sufficiently expressive, VAE may lead…

机器学习 · 计算机科学 2021-10-26 Dazhong Shen , Chuan Qin , Chao Wang , Hengshu Zhu , Enhong Chen , Hui Xiong

Variational auto-encoders (VAEs) provide an attractive solution to image generation problem. However, they tend to produce blurred and over-smoothed images due to their dependence on pixel-wise reconstruction loss. This paper introduces a…

计算机视觉与模式识别 · 计算机科学 2018-04-30 Salman H. Khan , Munawar Hayat , Nick Barnes

Multi-agent behavior modeling and trajectory forecasting are crucial for the safe navigation of autonomous agents in interactive scenarios. Variational Autoencoder (VAE) has been widely applied in multi-agent interaction modeling to…

机器学习 · 计算机科学 2021-12-02 Chen Tang , Wei Zhan , Masayoshi Tomizuka

Variational Autoencoder (VAE), a simple and effective deep generative model, has led to a number of impressive empirical successes and spawned many advanced variants and theoretical investigations. However, recent studies demonstrate that,…

机器学习 · 计算机科学 2019-01-08 Xuezhe Ma , Chunting Zhou , Eduard Hovy

Variational autoencoder (VAE) is a deep generative model for unsupervised learning, allowing to encode observations into the meaningful latent space. VAE is prone to catastrophic forgetting when tasks arrive sequentially, and only the data…

机器学习 · 计算机科学 2021-11-04 Anna Kuzina , Evgenii Egorov , Evgeny Burnaev

A number of variational autoencoders (VAEs) have recently emerged with the aim of modeling multimodal data, e.g., to jointly model images and their corresponding captions. Still, multimodal VAEs tend to focus solely on a subset of the…

机器学习 · 计算机科学 2022-06-10 Adrián Javaloy , Maryam Meghdadi , Isabel Valera

Variational autoencoders (VAEs) are widely used deep generative models capable of learning unsupervised latent representations of data. Such representations are often difficult to interpret or control. We consider the problem of…

机器学习 · 计算机科学 2018-12-18 Jack Klys , Jake Snell , Richard Zemel

Variational AutoEncoder (VAE) has been extended as a representative nonlinear method for collaborative filtering. However, the bottleneck of VAE lies in the softmax computation over all items, such that it takes linear costs in the number…

机器学习 · 计算机科学 2022-05-31 Jin Chen , Defu Lian , Binbin Jin , Xu Huang , Kai Zheng , Enhong Chen

Variational autoencoders (VAEs) face a notorious problem wherein the variational posterior often aligns closely with the prior, a phenomenon known as posterior collapse, which hinders the quality of representation learning. To mitigate this…

机器学习 · 统计学 2023-10-25 Yuma Ichikawa , Koji Hukushima

Latent variable models like the Variational Auto-Encoder (VAE) are commonly used to learn representations of images. However, for downstream tasks like semantic classification, the representations learned by VAE are less competitive than…

机器学习 · 统计学 2022-05-31 Mingtian Zhang , Tim Z. Xiao , Brooks Paige , David Barber

We propose a new method for unsupervised generative continual learning through realignment of Variational Autoencoder's latent space. Deep generative models suffer from catastrophic forgetting in the same way as other neural structures.…

机器学习 · 计算机科学 2022-06-06 Kamil Deja , Paweł Wawrzyński , Wojciech Masarczyk , Daniel Marczak , Tomasz Trzciński

A variational autoencoder (VAE) is a probabilistic machine learning framework for posterior inference that projects an input set of high-dimensional data to a lower-dimensional, latent space. The latent space learned with a VAE offers…

机器学习 · 计算机科学 2022-11-16 Rafael Pastrana
‹ 上一页 1 2 3 10 下一页 ›