中文
相关论文

相关论文: Variational excess risk bound for general state sp…

200 篇论文

Recently there has been an increased interest in unsupervised learning of disentangled representations using the Variational Autoencoder (VAE) framework. Most of the existing work has focused largely on modifying the variational cost…

机器学习 · 统计学 2019-09-12 Jan Stühmer , Richard E. Turner , Sebastian Nowozin

In this paper we propose two novel bounds for the log-likelihood based on Kullback-Leibler and the R\'{e}nyi divergences, which can be used for variational inference and in particular for the training of Variational AutoEncoders. Our…

机器学习 · 计算机科学 2018-07-06 Septimia Sârbu , Riccardo Volpi , Alexandra Peşte , Luigi Malagò

We consider a variational autoencoder (VAE) for binary data. Our main innovations are an interpretable lower bound for its training objective, a modified initialization and architecture of such a VAE that leads to faster training, and a…

机器学习 · 计算机科学 2020-03-27 Robert Sicks , Ralf Korn , Stefanie Schwaar

Data assimilation refers to a set of algorithms designed to compute the optimal estimate of a system's state by refining the prior prediction (known as background states) using observed data. Variational assimilation methods rely on the…

机器学习 · 计算机科学 2024-05-24 Yi Xiao , Qilong Jia , Wei Xue , Lei Bai

In this paper, we study two aspects of the variational autoencoder (VAE): the prior distribution over the latent variables and its corresponding posterior. First, we decompose the learning of VAEs into layerwise density estimation, and…

Variational autoencoders (VAEs) are a powerful class of deep generative latent variable model for unsupervised representation learning on high-dimensional data. To ensure computational tractability, VAEs are often implemented with a…

机器学习 · 计算机科学 2020-06-09 Alex Campbell , Pietro Liò

The posterior collapse phenomenon in variational autoencoder (VAE), where the variational posterior distribution closely matches the prior distribution, can hinder the quality of the learned latent variables. As a consequence of posterior…

机器学习 · 统计学 2024-05-14 Hien Dang , Tho Tran , Tan Nguyen , Nhat Ho

Among other uses, neural networks are a powerful tool for solving deterministic and Bayesian inverse problems in real-time, where variational autoencoders, a specialized type of neural network, enable the Bayesian estimation of model…

机器学习 · 计算机科学 2025-09-25 Andrea Tonini , Luca Dede'

We propose a Gaussian manifold variational auto-encoder (GM-VAE) whose latent space consists of a set of Gaussian distributions. It is known that the set of the univariate Gaussian distributions with the Fisher information metric form a…

机器学习 · 计算机科学 2023-10-31 Seunghyuk Cho , Juyong Lee , Dongwoo Kim

Variational Autoencoders (VAEs) have experienced recent success as data-generating models by using simple architectures that do not require significant fine-tuning of hyperparameters. However, VAEs are known to suffer from…

机器学习 · 统计学 2020-07-22 Wei Cheng , Gregory Darnell , Sohini Ramachandran , Lorin Crawford

The Gaussianity assumption has been consistently criticized as a main limitation of the Variational Autoencoder (VAE) despite its efficiency in computational modeling. In this paper, we propose a new approach that expands the model capacity…

机器学习 · 统计学 2023-10-30 Seunghwan An , Jong-June Jeon

The variational autoencoder (VAE) framework remains a popular option for training unsupervised generative models, especially for discrete data where generative adversarial networks (GANs) require workaround to create gradient for the…

机器学习 · 计算机科学 2019-04-24 Jason Chou , Gautam Hathi

A variational autoencoder (VAE) is a probabilistic machine learning framework for posterior inference that projects an input set of high-dimensional data to a lower-dimensional, latent space. The latent space learned with a VAE offers…

机器学习 · 计算机科学 2022-11-16 Rafael Pastrana

Inverse problems aim to determine model parameters of a mathematical problem from given observational data. Neural networks can provide an efficient tool to solve these problems. In the context of Bayesian inverse problems, Uncertainty…

数值分析 · 数学 2025-09-16 Andrea Tonini , Tan Bui-Thanh , Francesco Regazzoni , Luca Dede' , Alfio Quarteroni

Variational autoencoders (VAEs) are one of the powerful unsupervised learning frameworks in NLP for latent representation learning and latent-directed generation. The classic optimization goal of VAEs is to maximize the Evidence Lower Bound…

机器学习 · 计算机科学 2022-11-02 Jianfei Zhang , Jun Bai , Chenghua Lin , Yanmeng Wang , Wenge Rong

The variational autoencoder (VAE) is a popular deep latent variable model used to analyse high-dimensional datasets by learning a low-dimensional latent representation of the data. It simultaneously learns a generative model and an…

机器学习 · 计算机科学 2023-11-21 Mine Öğretir , Siddharth Ramchandran , Dimitrios Papatheodorou , Harri Lähdesmäki

We propose to utilize a variational autoencoder (VAE) for data-driven channel estimation. The underlying true and unknown channel distribution is modeled by the VAE as a conditional Gaussian distribution in a novel way, parameterized by the…

信号处理 · 电气工程与系统科学 2023-04-07 Michael Baur , Benedikt Fesl , Michael Koller , Wolfgang Utschick

The variational auto-encoder (VAE) is a deep latent variable model that has two neural networks in an autoencoder-like architecture; one of them parameterizes the model's likelihood. Fitting its parameters via maximum likelihood (ML) is…

机器学习 · 计算机科学 2021-06-03 Francisco J. R. Ruiz , Michalis K. Titsias , Taylan Cemgil , Arnaud Doucet

We propose a framework for the statistical evaluation of variational auto-encoders (VAEs) and test two instances of this framework in the context of modelling images of handwritten digits and a corpus of English text. Our take on evaluation…

机器学习 · 计算机科学 2022-04-08 Claartje Barkhof , Wilker Aziz

Variational autoencoders (VAE) are a powerful and widely-used class of models to learn complex data distributions in an unsupervised fashion. One important limitation of VAEs is the prior assumption that latent sample representations are…

机器学习 · 计算机科学 2018-11-27 Francesco Paolo Casale , Adrian V Dalca , Luca Saglietti , Jennifer Listgarten , Nicolo Fusi