中文
相关论文

相关论文: Resetting a fixed broken ELBO

200 篇论文

Recent work in unsupervised representation learning has focused on learning deep directed latent-variable models. Fitting these models by maximizing the marginal likelihood or evidence is typically intractable, thus a common approximation…

机器学习 · 计算机科学 2018-02-15 Alexander A. Alemi , Ben Poole , Ian Fischer , Joshua V. Dillon , Rif A. Saurous , Kevin Murphy

Although variational autoencoders (VAEs) represent a widely influential deep generative model, many aspects of the underlying energy function remain poorly understood. In particular, it is commonly believed that Gaussian encoder/decoder…

机器学习 · 计算机科学 2019-10-31 Bin Dai , David Wipf

The variational autoencoder (VAE) is a generative model with continuous latent variables where a pair of probabilistic encoder (bottom-up) and decoder (top-down) is jointly learned by stochastic gradient variational Bayes. We first…

机器学习 · 统计学 2016-04-19 Suwon Suh , Seungjin Choi

In this paper, we consider variational autoencoders (VAE) for general state space models. We consider a backward factorization of the variational distributions to analyze the excess risk associated with VAE. Such backward factorizations…

统计方法学 · 统计学 2023-12-18 Élisabeth Gassiat , Sylvain Le Corff

This is a tutorial and survey paper on factor analysis, probabilistic Principal Component Analysis (PCA), variational inference, and Variational Autoencoder (VAE). These methods, which are tightly related, are dimensionality reduction and…

机器学习 · 统计学 2022-05-25 Benyamin Ghojogh , Ali Ghodsi , Fakhri Karray , Mark Crowley

Variational AutoEncoders (VAEs) provide a means to generate representational latent embeddings. Previous research has highlighted the benefits of achieving representations that are disentangled, particularly for downstream tasks. However,…

计算机视觉与模式识别 · 计算机科学 2019-11-18 Matthew J. Vowels , Necati Cihan Camgoz , Richard Bowden

Variational autoencoders (VAEs) are essential tools in end-to-end representation learning. However, the sequential text generation common pitfall with VAEs is that the model tends to ignore latent variables with a strong auto-regressive…

机器学习 · 计算机科学 2021-02-26 Yang Zhao , Ping Yu , Suchismit Mahapatra , Qinliang Su , Changyou Chen

The variational autoencoder (VAE) is a popular deep latent variable model used to analyse high-dimensional datasets by learning a low-dimensional latent representation of the data. It simultaneously learns a generative model and an…

机器学习 · 计算机科学 2023-11-21 Mine Öğretir , Siddharth Ramchandran , Dimitrios Papatheodorou , Harri Lähdesmäki

Variational autoencoders (VAEs) are a popular class of deep generative models with many variants and a wide range of applications. Improvements upon the standard VAE mostly focus on the modelling of the posterior distribution over the…

机器学习 · 计算机科学 2022-11-02 James Langley , Miguel Monteiro , Charles Jones , Nick Pawlowski , Ben Glocker

The variational autoencoder (VAE) is a popular probabilistic generative model. However, one shortcoming of VAEs is that the latent variables cannot be discrete, which makes it difficult to generate data from different modes of a…

机器学习 · 统计学 2017-11-21 Jay A. Hennig , Akash Umakantha , Ryan C. Williamson

The posterior collapse phenomenon in variational autoencoder (VAE), where the variational posterior distribution closely matches the prior distribution, can hinder the quality of the learned latent variables. As a consequence of posterior…

机器学习 · 统计学 2024-05-14 Hien Dang , Tho Tran , Tan Nguyen , Nhat Ho

Variational Autoencoders (VAEs) represent the given data in a low-dimensional latent space, which is generally assumed to be Euclidean. This assumption naturally leads to the common choice of a standard Gaussian prior over continuous latent…

机器学习 · 计算机科学 2020-08-10 Dimitris Kalatzis , David Eklund , Georgios Arvanitidis , Søren Hauberg

An assumption-free automatic check of medical images for potentially overseen anomalies would be a valuable assistance for a radiologist. Deep learning and especially Variational Auto-Encoders (VAEs) have shown great potential in the…

机器学习 · 计算机科学 2019-07-12 David Zimmerer , Fabian Isensee , Jens Petersen , Simon Kohl , Klaus Maier-Hein

Variational Auto-Encoders have often been used for unsupervised pretraining, feature extraction and out-of-distribution and anomaly detection in the medical field. However, VAEs often lack the ability to produce sharp images and learn…

机器学习 · 计算机科学 2019-11-28 David Zimmerer , Jens Petersen , Klaus Maier-Hein

Neural Networks play a growing role in many science disciplines, including physics. Variational Autoencoders (VAEs) are neural networks that are able to represent the essential information of a high dimensional data set in a low dimensional…

机器学习 · 统计学 2021-12-08 Johannes Zacherl , Philipp Frank , Torsten A. Enßlin

We combine conditional variational autoencoders (VAE) with adversarial censoring in order to learn invariant representations that are disentangled from nuisance/sensitive variations. In this method, an adversarial network attempts to…

机器学习 · 计算机科学 2018-05-22 Ye Wang , Toshiaki Koike-Akino , Deniz Erdogmus

The Variational Auto-Encoder (VAE) is a simple, efficient, and popular deep maximum likelihood model. Though usage of VAEs is widespread, the derivation of the VAE is not as widely understood. In this tutorial, we will provide an overview…

机器学习 · 计算机科学 2020-07-02 Ronald Yu

Given the notably increasing complexity of mathematical models to study realistic systems and their coupling to their environment that constrains their dynamics, both analytical approaches and numerical methods that build on these models,…

量子物理 · 物理学 2019-11-11 I. Luchnikov , A. Ryzhov , P. -J. C. Stas , S. N. Filippov , H. Ouerdane

The Variational Autoencoder (VAE) is a seminal approach in deep generative modeling with latent variables. Interpreting its reconstruction process as a nonlinear transformation of samples from the latent posterior distribution, we apply the…

机器学习 · 计算机科学 2023-06-09 Faris Janjoš , Lars Rosenbaum , Maxim Dolgov , J. Marius Zöllner

The manifold hypothesis states that high-dimensional data can be modeled as lying on or near a low-dimensional, nonlinear manifold. Variational Autoencoders (VAEs) approximate this manifold by learning mappings from low-dimensional latent…

机器学习 · 统计学 2021-03-03 Marissa C. Connor , Gregory H. Canal , Christopher J. Rozell