中文
相关论文

相关论文: On PAC-Bayesian reconstruction guarantees for VAEs

200 篇论文

Variational Autoencoders (VAEs) have gained significant popularity among researchers as a powerful tool for understanding unknown distributions based on limited samples. This popularity stems partly from their impressive performance and…

机器学习 · 计算机科学 2024-02-27 Saptarshi Chakraborty , Peter L. Bartlett

Empirically, the PAC-Bayesian analysis is known to produce tight risk bounds for practical machine learning algorithms. However, in its naive form, it can only deal with stochastic predictors while such predictors are rarely used and…

机器学习 · 统计学 2019-11-22 Kohei Miyaguchi

Variational autoencoders (VAEs) are one class of generative probabilistic latent-variable models designed for inference based on known data. We develop three variations on VAEs by introducing a second parameterized encoder/decoder pair and,…

机器学习 · 计算机科学 2023-04-06 R. I. Cukier

We derive a novel PAC-Bayesian generalization bound for reinforcement learning that explicitly accounts for Markov dependencies in the data, through the chain's mixing time. This contributes to overcoming challenges in obtaining…

机器学习 · 计算机科学 2026-02-10 Abdelkrim Zitouni , Mehdi Hennequin , Juba Agoun , Ryan Horache , Nadia Kabachi , Omar Rivasplata

Variational autoencoders (VAEs) are powerful generative modelling methods, however they suffer from blurry generated samples and reconstructions compared to the images they have been trained on. Significant research effort has been spent to…

计算机视觉与模式识别 · 计算机科学 2023-04-13 Gustav Bredell , Kyriakos Flouris , Krishna Chaitanya , Ertunc Erdil , Ender Konukoglu

We present a coupled Variational Auto-Encoder (VAE) method that improves the accuracy and robustness of the probabilistic inferences on represented data. The new method models the dependency between input feature vectors (images) and weighs…

机器学习 · 计算机科学 2025-11-25 Shichen Cao , Jingjing Li , Kenric P. Nelson , Mark A. Kon

Variational Autoencoders (VAEs) are well-established as a principled approach to probabilistic unsupervised learning with neural networks. Typically, an encoder network defines the parameters of a Gaussian distributed latent space from…

机器学习 · 计算机科学 2025-05-16 Alan Jeffares , Liyuan Liu

The combination of machine learning models with physical models is a recent research path to learn robust data representations. In this paper, we introduce p$^3$VAE, a variational autoencoder that integrates prior physical knowledge about…

计算机视觉与模式识别 · 计算机科学 2025-02-27 Romain Thoreau , Laurent Risser , Véronique Achard , Béatrice Berthelot , Xavier Briottet

Bayesian priors offer a compact yet general means of incorporating domain knowledge into many learning tasks. The correctness of the Bayesian analysis and inference, however, largely depends on accuracy and correctness of these priors.…

机器学习 · 计算机科学 2012-02-20 Mahdi MIlani Fard , Joelle Pineau , Csaba Szepesvari

Variational Autoencoders are one of the most commonly used generative models, particularly for image data. A prominent difficulty in training VAEs is data that is supported on a lower-dimensional manifold. Recent work by Dai and Wipf (2020)…

机器学习 · 计算机科学 2022-05-19 Frederic Koehler , Viraj Mehta , Chenghui Zhou , Andrej Risteski

Variational autoencoder (VAE) estimates the posterior parameters (mean and variance) of latent variables corresponding to each input data. While it is used for many tasks, the transparency of the model is still an underlying issue. This…

机器学习 · 统计学 2023-02-23 Akira Nakagawa , Keizo Kato , Taiji Suzuki

In this study, we consider the reliability assessment of anomaly detection (AD) using Variational Autoencoder (VAE). Over the last decade, VAE-based AD has been actively studied in various perspective, from method development to applied…

机器学习 · 统计学 2024-06-04 Daiki Miwa , Tomohiro Shiraishi , Vo Nguyen Le Duy , Teruyuki Katsuoka , Ichiro Takeuchi

Inverse problems often involve matching observational data using a physical model that takes a large number of parameters as input. These problems tend to be under-constrained and require regularization to impose additional structure on the…

计算物理 · 物理学 2019-06-07 Daniel O'Malley , John K. Golden , Velimir V. Vesselinov

Structured variational autoencoders (SVAEs) combine probabilistic graphical model priors on latent variables, deep neural networks to link latent variables to observed data, and structure-exploiting algorithms for approximate posterior…

机器学习 · 统计学 2023-05-29 Yixiu Zhao , Scott W. Linderman

Application of deep neural networks to medical imaging tasks has in some sense become commonplace. Still, a "thorn in the side" of the deep learning movement is the argument that deep networks are prone to overfitting and are thus unable to…

机器学习 · 计算机科学 2021-07-12 Anthony Sicilia , Xingchen Zhao , Anastasia Sosnovskikh , Seong Jae Hwang

We focus on a stochastic learning model where the learner observes a finite set of training examples and the output of the learning process is a data-dependent distribution over a space of hypotheses. The learned data-dependent distribution…

机器学习 · 统计学 2020-12-29 Omar Rivasplata , Ilja Kuzborskij , Csaba Szepesvari , John Shawe-Taylor

The ability of likelihood-based probabilistic models to generalize to unseen data is central to many machine learning applications such as lossless compression. In this work, we study the generalization of a popular class of probabilistic…

机器学习 · 统计学 2022-10-18 Mingtian Zhang , Peter Hayes , David Barber

We present new PAC-Bayesian generalisation bounds for learning problems with unbounded loss functions. This extends the relevance and applicability of the PAC-Bayes learning framework, where most of the existing literature focuses on…

机器学习 · 统计学 2021-12-16 Maxime Haddouche , Benjamin Guedj , Omar Rivasplata , John Shawe-Taylor

We introduce an improved variational autoencoder (VAE) for text modeling with topic information explicitly modeled as a Dirichlet latent variable. By providing the proposed model topic awareness, it is more superior at reconstructing input…

计算与语言 · 计算机科学 2018-11-02 Yijun Xiao , Tiancheng Zhao , William Yang Wang

Estimation of uncertainty in deep learning models is of vital importance, especially in medical imaging, where reliance on inference without taking into account uncertainty could lead to misdiagnosis. Recently, the probabilistic Variational…

机器学习 · 计算机科学 2020-10-20 Haleh Akrami , Anand A. Joshi , Sergul Aydore , Richard M. Leahy