中文
相关论文

相关论文: Zero-Variance Gradients for Variational Autoencode…

200 篇论文

Discrete variational auto-encoders (VAEs) are able to represent semantic latent spaces in generative learning. In many real-life settings, the discrete latent space consists of high-dimensional structures, and propagating gradients through…

机器学习 · 计算机科学 2022-05-04 Alon Berliner , Guy Rotman , Yossi Adi , Roi Reichart , Tamir Hazan

Variational autoencoders (VAEs) have been used extensively to discover low-dimensional latent factors governing neural activity and animal behavior. However, without careful model selection, the uncovered latent factors may reflect noise in…

机器学习 · 计算机科学 2023-12-13 Julia Huiming Wang , Dexter Tsin , Tatiana Engel

Variational autoencoders (VAEs), as an important aspect of generative models, have received a lot of research interests and reached many successful applications. However, it is always a challenge to achieve the consistency between the…

机器学习 · 计算机科学 2022-05-10 Xiaoyu Chen , Chen Gong , Qiang He , Xinwen Hou , Yu Liu

Variational autoencoders (VAEs) are a standard framework for inducing latent variable models that have been shown effective in learning text representations as well as in text generation. The key challenge with using VAEs is the {\it…

机器学习 · 计算机科学 2020-05-01 Serhii Havrylov , Ivan Titov

A new method for learning variational autoencoders (VAEs) is developed, based on Stein variational gradient descent. A key advantage of this approach is that one need not make parametric assumptions about the form of the encoder…

机器学习 · 计算机科学 2017-11-20 Yunchen Pu , Zhe Gan , Ricardo Henao , Chunyuan Li , Shaobo Han , Lawrence Carin

Variational Autoencoders (VAEs) provide a theoretically-backed and popular framework for deep generative models. However, learning a VAE from data poses still unanswered theoretical questions and considerable practical challenges. In this…

机器学习 · 计算机科学 2020-06-01 Partha Ghosh , Mehdi S. M. Sajjadi , Antonio Vergari , Michael Black , Bernhard Schölkopf

Variational Autoencoders are one of the most commonly used generative models, particularly for image data. A prominent difficulty in training VAEs is data that is supported on a lower-dimensional manifold. Recent work by Dai and Wipf (2020)…

机器学习 · 计算机科学 2022-05-19 Frederic Koehler , Viraj Mehta , Chenghui Zhou , Andrej Risteski

Variational AutoEncoders (VAEs) provide a means to generate representational latent embeddings. Previous research has highlighted the benefits of achieving representations that are disentangled, particularly for downstream tasks. However,…

计算机视觉与模式识别 · 计算机科学 2019-11-18 Matthew J. Vowels , Necati Cihan Camgoz , Richard Bowden

Learning the latent representation of data in unsupervised fashion is a very interesting process that provides relevant features for enhancing the performance of a classifier. For speech emotion recognition tasks, generating effective…

声音 · 计算机科学 2020-07-29 Siddique Latif , Rajib Rana , Junaid Qadir , Julien Epps

We explore a new research direction in Bayesian variational inference with discrete latent variable priors where we exploit Kronecker matrix algebra for efficient and exact computations of the evidence lower bound (ELBO). The proposed…

机器学习 · 统计学 2019-01-11 Trefor W. Evans , Prasanth B. Nair

Variational Autoencoders (VAEs) have been shown to be remarkably effective in recovering model latent spaces for several computer vision tasks. However, currently trained VAEs, for a number of reasons, seem to fall short in learning…

机器学习 · 计算机科学 2021-07-27 Chandrajit Bajaj , Avik Roy , Haoran Zhang

Variational autoencoders (VAEs) are powerful generative models with the salient ability to perform inference. Here, we introduce a quantum variational autoencoder (QVAE): a VAE whose latent generative process is implemented as a quantum…

Variational auto-encoders (VAE) are popular deep latent variable models which are trained by maximizing an Evidence Lower Bound (ELBO). To obtain tighter ELBO and hence better variational approximations, it has been proposed to use…

机器学习 · 统计学 2021-07-22 Achille Thin , Nikita Kotelevskii , Arnaud Doucet , Alain Durmus , Eric Moulines , Maxim Panov

The ability to accurately model random fields plays a critical role in science and engineering for problems involving uncertain, spatially-varying quantities such as heterogeneous material properties and turbulent flows. Deep generative…

We prove that the evidence lower bound (ELBO) employed by variational auto-encoders (VAEs) admits non-trivial solutions having constant posterior variances under certain mild conditions, removing the need to learn variances in the encoder.…

机器学习 · 计算机科学 2021-05-27 Graham Fyffe

The importance of Variational Autoencoders reaches far beyond standalone generative models -- the approach is also used for learning latent representations and can be generalized to semi-supervised learning. This requires a thorough…

机器学习 · 计算机科学 2022-04-12 Alexander Shekhovtsov , Dmitrij Schlesinger , Boris Flach

Learning a generative model from partial data (data with missingness) is a challenging area of machine learning research. We study a specific implementation of the Auto-Encoding Variational Bayes (AEVB) algorithm, named in this paper as a…

机器学习 · 计算机科学 2021-01-05 Amir Zadeh , Yao-Chong Lim , Paul Pu Liang , Louis-Philippe Morency

Variational autoencoders (VAEs) are one of the powerful unsupervised learning frameworks in NLP for latent representation learning and latent-directed generation. The classic optimization goal of VAEs is to maximize the Evidence Lower Bound…

机器学习 · 计算机科学 2022-11-02 Jianfei Zhang , Jun Bai , Chenghua Lin , Yanmeng Wang , Wenge Rong

Disentangled representation learning aims to represent the underlying generative factors of a dataset in a latent representation independently of one another. In our work, we propose a discrete variational autoencoder (VAE) based model…

计算机视觉与模式识别 · 计算机科学 2025-11-06 Gulcin Baykal , Melih Kandemir , Gozde Unal

Probabilistic models with hierarchical-latent-variable structures provide state-of-the-art results amongst non-autoregressive, unsupervised density-based models. However, the most common approach to training such models based on Variational…

机器学习 · 统计学 2020-10-09 Benoit Gaujac , Ilya Feige , David Barber