中文
相关论文

相关论文: Prior Learning in Introspective VAEs

200 篇论文

In this paper, we are interested in unsupervised (unknown noise) audio-visual speech enhancement based on variational autoencoders (VAEs), where the probability distribution of clean speech spectra is simulated using an encoder-decoder…

音频与语音处理 · 电气工程与系统科学 2021-03-10 Mostafa Sadeghi , Xavier Alameda-Pineda

Even though Variational Autoencoders (VAEs) are widely used for semi-supervised learning, the reason why they work remains unclear. In fact, the addition of the unsupervised objective is most often vaguely described as a regularization. The…

机器学习 · 计算机科学 2020-10-15 Ghazi Felhi , Joseph Leroux , Djamé Seddah

Current state-of-the-art generative approaches frequently rely on a two-stage training procedure, where an autoencoder (often a VAE) first performs dimensionality reduction, followed by training a generative model on the learned latent…

机器学习 · 统计学 2025-07-15 Gianluigi Silvestri , Luca Ambrogioni

Variational autoencoders (VAEs) have been used extensively to discover low-dimensional latent factors governing neural activity and animal behavior. However, without careful model selection, the uncovered latent factors may reflect noise in…

机器学习 · 计算机科学 2023-12-13 Julia Huiming Wang , Dexter Tsin , Tatiana Engel

Despite their ubiquity, variational autoencoders (VAEs) inherently suffer from posterior collapse, a failure mode in which latent variables are effectively ignored. This failure arises because explicit prior imposition drives optimization…

机器学习 · 计算机科学 2026-05-18 Hazhir Aliahmadi , Irina Babayan , Greg van Anders

In this paper, we present a novel approach for training a Variational Autoencoder (VAE) on a highly imbalanced data set. The proposed training of a high-resolution VAE model begins with the training of a low-resolution core model, which can…

计算机视觉与模式识别 · 计算机科学 2019-12-19 Dmitry Utyamishev , Inna Partin-Vaisband

We explain why directly changing the prior can be a surprisingly ineffective mechanism for incorporating inductive biases into VAEs, and introduce a simple and effective alternative approach: Intermediary Latent Space VAEs(InteL-VAEs).…

机器学习 · 统计学 2022-02-16 Ning Miao , Emile Mathieu , N. Siddharth , Yee Whye Teh , Tom Rainforth

Variational autoencoders (VAEs) rely on amortized variational inference to enable efficient posterior approximation, but this efficiency comes at the cost of a shared parametrization, giving rise to the amortization gap. We propose the…

机器学习 · 计算机科学 2026-04-21 Andrea Pollastro , Andrea Apicella , Francesco Isgrò , Roberto Prevete

Variational autoencoders (VAEs) are a standard framework for inducing latent variable models that have been shown effective in learning text representations as well as in text generation. The key challenge with using VAEs is the {\it…

机器学习 · 计算机科学 2020-05-01 Serhii Havrylov , Ivan Titov

Recently, audio-visual speech enhancement has been tackled in the unsupervised settings based on variational auto-encoders (VAEs), where during training only clean data is used to train a generative model for speech, which at test time is…

音频与语音处理 · 电气工程与系统科学 2021-02-09 Mostafa Sadeghi , Xavier Alameda-Pineda

Learning rich data representations from unlabeled data is a key challenge towards applying deep learning algorithms in downstream tasks. Several variants of variational autoencoders (VAEs) have been proposed to learn compact data…

计算机视觉与模式识别 · 计算机科学 2024-01-11 Pan Xiao , Peijie Qiu , Sungmin Ha , Abdalla Bani , Shuang Zhou , Aristeidis Sotiras

Optimal computations under uncertainty require an adequate probabilistic representation about beliefs. Deep generative models, and specifically Variational Autoencoders (VAEs), have the potential to meet this demand by building latent…

Variational autoencoders (VAEs) are one class of generative probabilistic latent-variable models designed for inference based on known data. We develop three variations on VAEs by introducing a second parameterized encoder/decoder pair and,…

机器学习 · 计算机科学 2023-04-06 R. I. Cukier

Variational Auto-encoders (VAEs) have been very successful as methods for forming compressed latent representations of complex, often high-dimensional, data. In this paper, we derive an alternative variational lower bound from the one…

机器学习 · 计算机科学 2019-03-20 Shuyu Lin , Ronald Clark , Robert Birke , Niki Trigoni , Stephen Roberts

Variational autoencoders (VAEs) provide an effective and simple method for modeling complex distributions. However, training VAEs often requires considerable hyperparameter tuning to determine the optimal amount of information retained by…

机器学习 · 计算机科学 2021-07-13 Oleh Rybkin , Kostas Daniilidis , Sergey Levine

We propose an algorithm, guided variational autoencoder (Guided-VAE), that is able to learn a controllable generative model by performing latent representation disentanglement learning. The learning objective is achieved by providing…

计算机视觉与模式识别 · 计算机科学 2020-04-06 Zheng Ding , Yifan Xu , Weijian Xu , Gaurav Parmar , Yang Yang , Max Welling , Zhuowen Tu

We propose a new structure for the variational auto-encoders (VAEs) prior, with the weakly informative multivariate Student's t-distribution. In the proposed model all distribution parameters are trained, thereby allowing for a more robust…

机器学习 · 计算机科学 2020-04-07 Najmeh Abiri , Mattias Ohlsson

Variational auto-encoders (VAEs) are deep generative latent variable models that can be used for learning the distribution of complex data. VAEs have been successfully used to learn a probabilistic prior over speech signals, which is then…

声音 · 计算机科学 2020-12-18 Mostafa Sadeghi , Simon Leglaive , Xavier Alameda-PIneda , Laurent Girin , Radu Horaud

Variational AutoEncoders (VAEs) provide a means to generate representational latent embeddings. Previous research has highlighted the benefits of achieving representations that are disentangled, particularly for downstream tasks. However,…

计算机视觉与模式识别 · 计算机科学 2019-11-18 Matthew J. Vowels , Necati Cihan Camgoz , Richard Bowden

Variational autoencoders (VAEs) are one of the powerful unsupervised learning frameworks in NLP for latent representation learning and latent-directed generation. The classic optimization goal of VAEs is to maximize the Evidence Lower Bound…

机器学习 · 计算机科学 2022-11-02 Jianfei Zhang , Jun Bai , Chenghua Lin , Yanmeng Wang , Wenge Rong