English
Related papers

Related papers: On Kernel-based Variational Autoencoder

200 papers

Variational Autoencoder (VAE), a simple and effective deep generative model, has led to a number of impressive empirical successes and spawned many advanced variants and theoretical investigations. However, recent studies demonstrate that,…

Machine Learning · Computer Science 2019-01-08 Xuezhe Ma , Chunting Zhou , Eduard Hovy

Variational Auto-Encoders (VAEs) have shown great potential in the unsupervised learning of data distributions. An VAE trained on normal images is expected to only be able to reconstruct normal images, allowing the localization of anomalous…

Computer Vision and Pattern Recognition · Computer Science 2020-05-22 Leixin Zhou , Wenxiang Deng , Xiaodong Wu

Variational autoencoders (VAEs) are powerful generative modelling methods, however they suffer from blurry generated samples and reconstructions compared to the images they have been trained on. Significant research effort has been spent to…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Gustav Bredell , Kyriakos Flouris , Krishna Chaitanya , Ertunc Erdil , Ender Konukoglu

Variational autoencoders (VAEs) are a popular framework for modeling complex data distributions; they can be efficiently trained via variational inference by maximizing the evidence lower bound (ELBO), at the expense of a gap to the exact…

Variational Autoencoders (VAEs) have been shown to be remarkably effective in recovering model latent spaces for several computer vision tasks. However, currently trained VAEs, for a number of reasons, seem to fall short in learning…

Machine Learning · Computer Science 2021-07-27 Chandrajit Bajaj , Avik Roy , Haoran Zhang

A hallmark of variational autoencoders (VAEs) for text processing is their combination of powerful encoder-decoder models, such as LSTMs, with simple latent distributions, typically multivariate Gaussians. These models pose a difficult…

Computation and Language · Computer Science 2018-10-15 Jiacheng Xu , Greg Durrett

Variational autoencoders (VAEs) are one class of generative probabilistic latent-variable models designed for inference based on known data. They balance reconstruction and regularizer terms. A variational approximation produces an evidence…

Machine Learning · Statistics 2023-12-13 Robert I. Cukier

Kernel methods have been studied extensively in recent years. We propose a three-dimensional (3-D) Epanechnikov Mixture Regression (EMR) based on our Epanechnikov Kernel (EK) and realize a complete framework for image coding. In our…

Image and Video Processing · Electrical Eng. & Systems 2021-06-04 Boning Liu , Yan Zhao , Xiaomeng Jiang , Shigang Wang

Variational autoencoders (VAEs) have recently been used for unsupervised disentanglement learning of complex density distributions. Numerous variants exist to encourage disentanglement in latent space while improving reconstruction.…

Machine Learning · Statistics 2022-06-10 Kenneth Ezukwoke , Anis Hoayek , Mireille Batton-Hubert , Xavier Boucher

One of the challenges in training generative models such as the variational auto encoder (VAE) is avoiding posterior collapse. When the generator has too much capacity, it is prone to ignoring latent code. This problem is exacerbated when…

Machine Learning · Computer Science 2019-10-30 Talip Ucar

Being one of the most popular generative framework, variational autoencoders(VAE) are known to suffer from a phenomenon termed posterior collapse, i.e. the latent variational distributions collapse to the prior, especially when a strong…

Machine Learning · Computer Science 2021-03-23 Renfei Tu , Yang Liu , Yongzeng Xue , Cheng Wang , Maozu Guo

This paper introduces a novel kernel density estimator (KDE) based on the generalised exponential (GE) distribution, designed specifically for positive continuous data. The proposed GE KDE offers a mathematically tractable form that avoids…

Methodology · Statistics 2026-02-18 Laura M. Craig , Wagner Barreto-Souza

We introduce an improved variational autoencoder (VAE) for text modeling with topic information explicitly modeled as a Dirichlet latent variable. By providing the proposed model topic awareness, it is more superior at reconstructing input…

Computation and Language · Computer Science 2018-11-02 Yijun Xiao , Tiancheng Zhao , William Yang Wang

Machine learning methods often need a large amount of labeled training data. Since the training data is assumed to be the ground truth, outliers can severely degrade learned representations and performance of trained models. Here we apply…

Machine Learning · Statistics 2019-12-24 Haleh Akrami , Anand A. Joshi , Jian Li , Sergul Aydore , Richard M. Leahy

In Bayesian machine learning, the posterior distribution is typically computationally intractable, hence variational inference is often required. In this approach, an evidence lower bound on the log likelihood of data is maximized during…

Machine Learning · Computer Science 2019-07-23 Stephen Odaibo

When analyzing modern machine learning algorithms, we may need to handle kernel density estimation (KDE) with intricate kernels that are not designed by the user and might even be irregular and asymmetric. To handle this emerging challenge,…

Statistics Theory · Mathematics 2021-06-09 Hau-Tieng Wu , Nan Wu

We introduce a Deep Kernel Learning Variational Autoencoder (VAE-DKL) framework that integrates the generative power of a Variational Autoencoder (VAE) with the predictive nature of Deep Kernel Learning (DKL). The VAE learns a latent…

Machine Learning · Computer Science 2025-03-06 Boris N. Slautin , Utkarsh Pratiush , Doru C. Lupascu , Maxim A. Ziatdinov , Sergei V. Kalinin

Variational autoencoders (VAE) often use Gaussian or category distribution to model the inference process. This puts a limit on variational learning because this simplified assumption does not match the true posterior distribution, which is…

Machine Learning · Computer Science 2017-02-28 Ke Sun , Xiangliang Zhang

In this paper we propose two novel bounds for the log-likelihood based on Kullback-Leibler and the R\'{e}nyi divergences, which can be used for variational inference and in particular for the training of Variational AutoEncoders. Our…

Machine Learning · Computer Science 2018-07-06 Septimia Sârbu , Riccardo Volpi , Alexandra Peşte , Luigi Malagò

While hierarchical variational autoencoders (VAEs) have achieved great density estimation on image modeling tasks, samples from their prior tend to look less convincing than models with similar log-likelihood. We attribute this to learned…

Machine Learning · Computer Science 2022-10-20 Eric Luhman , Troy Luhman