English
Related papers

Related papers: Variationally Inferred Sampling Through a Refined …

200 papers

Bayesian calibration of black-box computer models offers an established framework to obtain a posterior distribution over model parameters. Traditional Bayesian calibration involves the emulation of the computer model and an additive model…

Machine Learning · Statistics 2018-10-30 Sébastien Marmin , Maurizio Filippone

The variational autoencoder (VAE) is a popular model for density estimation and representation learning. Canonically, the variational principle suggests to prefer an expressive inference model so that the variational approximation is…

Machine Learning · Statistics 2019-01-10 Rui Shu , Hung H. Bui , Shengjia Zhao , Mykel J. Kochenderfer , Stefano Ermon

Non-linear hierarchical models are commonly used in many disciplines. However, inference in the presence of non-nested effects and on large datasets is challenging and computationally burdensome. This paper provides two contributions to…

Methodology · Statistics 2021-10-22 Max Goplerud

In this paper, we address the unsupervised speech enhancement problem based on recurrent variational autoencoder (RVAE). This approach offers promising generalization performance over the supervised counterpart. Nevertheless, the involved…

Computer Vision and Pattern Recognition · Computer Science 2023-09-20 Mostafa Sadeghi , Romain Serizel

Variational autoencoder (VAE) is a very successful generative model whose key element is the so called amortized inference network, which can perform test time inference using a single feed forward pass. Unfortunately, this comes at the…

Machine Learning · Computer Science 2021-02-08 Minyoung Kim , Vladimir Pavlovic

The variational autoencoder (VAE) is a powerful generative model that can estimate the probability of a data point by using latent variables. In the VAE, the posterior of the latent variable given the data point is regularized by the prior…

Machine Learning · Statistics 2019-12-30 Hiroshi Takahashi , Tomoharu Iwata , Yuki Yamanaka , Masanori Yamada , Satoshi Yagi

Predicting future frames for a video sequence is a challenging generative modeling task. Promising approaches include probabilistic latent variable models such as the Variational Auto-Encoder. While VAEs can handle uncertainty and model…

Computer Vision and Pattern Recognition · Computer Science 2019-04-30 Lluis Castrejon , Nicolas Ballas , Aaron Courville

The variational auto-encoder (VAE) is a deep latent variable model that has two neural networks in an autoencoder-like architecture; one of them parameterizes the model's likelihood. Fitting its parameters via maximum likelihood (ML) is…

Machine Learning · Computer Science 2021-06-03 Francisco J. R. Ruiz , Michalis K. Titsias , Taylan Cemgil , Arnaud Doucet

We consider the problem of lossy image compression with deep latent variable models. State-of-the-art methods build on hierarchical variational autoencoders (VAEs) and learn inference networks to predict a compressible latent representation…

Image and Video Processing · Electrical Eng. & Systems 2021-01-11 Yibo Yang , Robert Bamler , Stephan Mandt

We present two approximate Bayesian inference methods for parameter estimation in partial differential equation (PDE) models with space-dependent and state-dependent parameters. We demonstrate that these methods provide accurate and…

Methodology · Statistics 2019-09-04 David A. Barajas-Solano , Alexandre M. Tartakovsky

Sampling complex free energy surfaces is one of the main challenges of modern atomistic simulation methods. The presence of kinetic bottlenecks in such surfaces often renders a direct approach useless. A popular strategy is to identify a…

Computational Physics · Physics 2019-09-25 Luigi Bonati , Yue-Yu Zhang , Michele Parrinello

Many statistical models can be simulated forwards but have intractable likelihoods. Approximate Bayesian Computation (ABC) methods are used to infer properties of these models from data. Traditionally these methods approximate the posterior…

Machine Learning · Statistics 2018-04-03 George Papamakarios , Iain Murray

Diffusion models may be viewed as hierarchical variational autoencoders (VAEs) with two improvements: parameter sharing for the conditional distributions in the generative process and efficient computation of the loss as independent terms…

Machine Learning · Computer Science 2025-10-20 Beatrix M. G. Nielsen , Anders Christensen , Andrea Dittadi , Ole Winther

We propose a scalable variational Bayes method for statistical inference for a single or low-dimensional subset of the coordinates of a high-dimensional parameter in sparse linear regression. Our approach relies on assigning a mean-field…

Machine Learning · Statistics 2025-08-12 Ismaël Castillo , Alice L'Huillier , Kolyan Ray , Luke Travis

Approximating a probability density in a tractable manner is a central task in Bayesian statistics. Variational Inference (VI) is a popular technique that achieves tractability by choosing a relatively simple variational family. Borrowing…

Machine Learning · Statistics 2018-11-30 Francesco Locatello , Gideon Dresdner , Rajiv Khanna , Isabel Valera , Gunnar Rätsch

We present a new algorithm for approximate inference in probabilistic programs, based on a stochastic gradient for variational programs. This method is efficient without restrictions on the probabilistic program; it is particularly…

Machine Learning · Statistics 2013-01-08 David Wingate , Theophane Weber

Variational Bayes (VB) is a recent approximate method for Bayesian inference. It has the merit of being a fast and scalable alternative to Markov Chain Monte Carlo (MCMC) but its approximation error is often unknown. In this paper, we…

Machine Learning · Statistics 2019-03-05 Reza Hajargasht

Variational inference in probabilistic graphical models aims to approximate fundamental quantities such as marginal distributions and the partition function. Popular approaches are the Bethe approximation, tree-reweighted, and other types…

Machine Learning · Statistics 2025-02-06 Harald Leisenberger , Franz Pernkopf

Stochastic processes provide a mathematically elegant way model complex data. In theory, they provide flexible priors over function classes that can encode a wide range of interesting assumptions. In practice, however, efficient inference…

Machine Learning · Computer Science 2022-09-15 Swapnil Mishra , Seth Flaxman , Tresnia Berah , Harrison Zhu , Mikko Pakkanen , Samir Bhatt

For stochastic models with intractable likelihood functions, approximate Bayesian computation offers a way of approximating the true posterior through repeated comparisons of observations with simulated model outputs in terms of a small set…

Machine Learning · Computer Science 2022-05-24 Carlo Albert , Simone Ulzega , Firat Ozdemir , Fernando Perez-Cruz , Antonietta Mira