English
Related papers

Related papers: Variational auto-encoders with Student's t-prior

200 papers

In this paper, we consider variational autoencoders (VAE) for general state space models. We consider a backward factorization of the variational distributions to analyze the excess risk associated with VAE. Such backward factorizations…

Methodology · Statistics 2023-12-18 Élisabeth Gassiat , Sylvain Le Corff

Variational autoencoder is a powerful deep generative model with variational inference. The practice of modeling latent variables in the VAE's original formulation as normal distributions with a diagonal covariance matrix limits the…

Machine Learning · Computer Science 2019-03-11 Sarin Chandy , Amin Rasekh

We extend variational autoencoders (VAEs) to collaborative filtering for implicit feedback. This non-linear probabilistic model enables us to go beyond the limited modeling capacity of linear factor models which still largely dominate…

Machine Learning · Statistics 2018-02-19 Dawen Liang , Rahul G. Krishnan , Matthew D. Hoffman , Tony Jebara

Variational auto-encoder (VAE) is a powerful unsupervised learning framework for image generation. One drawback of VAE is that it generates blurry images due to its Gaussianity assumption and thus L2 loss. To allow the generation of high…

Computer Vision and Pattern Recognition · Computer Science 2017-05-23 Lei Cai , Hongyang Gao , Shuiwang Ji

Although substantial efforts have been made to learn disentangled representations under the variational autoencoder (VAE) framework, the fundamental properties to the dynamics of learning of most VAE models still remain unknown and…

Machine Learning · Computer Science 2020-07-14 Yanjun Li , Shujian Yu , Jose C. Principe , Xiaolin Li , Dapeng Wu

Variational Autoencoder (VAE), a simple and effective deep generative model, has led to a number of impressive empirical successes and spawned many advanced variants and theoretical investigations. However, recent studies demonstrate that,…

Machine Learning · Computer Science 2019-01-08 Xuezhe Ma , Chunting Zhou , Eduard Hovy

Variational auto-encoders (VAEs) are a powerful approach to unsupervised learning. They enable scalable approximate posterior inference in latent-variable models using variational inference (VI). A VAE posits a variational family…

Machine Learning · Computer Science 2022-06-08 Samarth Sinha , Adji B. Dieng

We propose a novel Conditional Latent space Variational Autoencoder (CL-VAE) to perform improved pre-processing for anomaly detection on data with known inlier classes and unknown outlier classes. This proposed variational autoencoder (VAE)…

Machine Learning · Computer Science 2024-10-17 Oskar Åström , Alexandros Sopasakis

The combination of machine learning models with physical models is a recent research path to learn robust data representations. In this paper, we introduce p$^3$VAE, a variational autoencoder that integrates prior physical knowledge about…

Computer Vision and Pattern Recognition · Computer Science 2025-02-27 Romain Thoreau , Laurent Risser , Véronique Achard , Béatrice Berthelot , Xavier Briottet

Variational autoencoder (VAE) has widely been utilized for modeling data distributions because it is theoretically elegant, easy to train, and has nice manifold representations. However, when applied to image reconstruction and synthesis…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Dooseop Choi , KyoungWook Min

A new form of the variational autoencoder (VAE) is proposed, based on the symmetric Kullback-Leibler divergence. It is demonstrated that learning of the resulting symmetric VAE (sVAE) has close connections to previously developed…

Machine Learning · Statistics 2017-10-23 Liqun Chen , Shuyang Dai , Yunchen Pu , Chunyuan Li , Qinliang Su , Lawrence Carin

Optimal computations under uncertainty require an adequate probabilistic representation about beliefs. Deep generative models, and specifically Variational Autoencoders (VAEs), have the potential to meet this demand by building latent…

The Variational Autoencoder (VAE) is a seminal approach in deep generative modeling with latent variables. Interpreting its reconstruction process as a nonlinear transformation of samples from the latent posterior distribution, we apply the…

Machine Learning · Computer Science 2023-06-09 Faris Janjoš , Lars Rosenbaum , Maxim Dolgov , J. Marius Zöllner

We propose a Gaussian manifold variational auto-encoder (GM-VAE) whose latent space consists of a set of Gaussian distributions. It is known that the set of the univariate Gaussian distributions with the Fisher information metric form a…

Machine Learning · Computer Science 2023-10-31 Seunghyuk Cho , Juyong Lee , Dongwoo Kim

Variational autoencoders employ an amortized inference model to approximate the posterior of latent variables. However, such amortized variational inference faces two challenges: (1) the limited posterior expressiveness of fully-factorized…

Machine Learning · Computer Science 2022-12-01 Yookoon Park , Chris Dongjoo Kim , Gunhee Kim

We extend Stochastic Gradient Variational Bayes to perform posterior inference for the weights of Stick-Breaking processes. This development allows us to define a Stick-Breaking Variational Autoencoder (SB-VAE), a Bayesian nonparametric…

Machine Learning · Statistics 2017-04-05 Eric Nalisnick , Padhraic Smyth

Variational auto-encoders (VAE) are scalable and powerful generative models. However, the choice of the variational posterior determines tractability and flexibility of the VAE. Commonly, latent variables are modeled using the normal…

Machine Learning · Computer Science 2017-01-30 Jakub M. Tomczak , Max Welling

We present the development of a semi-supervised regression method using variational autoencoders (VAE), which is customized for use in soft sensing applications. We motivate the use of semi-supervised learning considering the fact that…

Machine Learning · Computer Science 2022-12-12 Yilin Zhuang , Zhuobin Zhou , Burak Alakent , Mehmet Mercangöz

Variational autoencoders (VAE) are powerful generative models that learn the latent representations of input data as random variables. Recent studies show that VAE can flexibly learn the complex temporal dynamics of time series and achieve…

Machine Learning · Computer Science 2023-11-14 Borui Cai , Shuiqiao Yang , Longxiang Gao , Yong Xiang

Approximating distributions over complicated manifolds, such as natural images, are conceptually attractive. The deep latent variable model, trained using variational autoencoders and generative adversarial networks, is now a key technique…

Computer Vision and Pattern Recognition · Computer Science 2019-10-08 Wenju Xu , Shawn Keshmiri , Guanghui Wang