English
Related papers

Related papers: Amortized Inference of Multi-Modal Posteriors usin…

200 papers

Many application domains, spanning from computational photography to medical imaging, require recovery of high-fidelity images from noisy, incomplete or partial/compressed measurements. State of the art methods for solving these inverse…

Image and Video Processing · Electrical Eng. & Systems 2022-07-13 Xinyi Wei , Hans van Gorp , Lizeth Gonzalez Carabarin , Daniel Freedman , Yonina C. Eldar , Ruud J. G. van Sloun

Mixture models are widely used in Bayesian statistics and machine learning, in particular in computational biology, natural language processing and many other fields. Variational inference, a technique for approximating intractable…

Statistics Theory · Mathematics 2020-08-03 Badr-Eddine Chérief-Abdellatif , Pierre Alquier

Inference networks of traditional Variational Autoencoders (VAEs) are typically amortized, resulting in relatively inaccurate posterior approximation compared to instance-wise variational optimization. Recent semi-amortized approaches were…

Machine Learning · Computer Science 2020-11-18 Minyoung Kim , Vladimir Pavlovic

Optimization is a ubiquitous modeling tool and is often deployed in settings which repeatedly solve similar instances of the same problem. Amortized optimization methods use learning to predict the solutions to problems in these settings,…

Machine Learning · Computer Science 2025-10-07 Brandon Amos

Normalizing constant (also called partition function, Bayesian evidence, or marginal likelihood) is one of the central goals of Bayesian inference, yet most of the existing methods are both expensive and inaccurate. Here we develop a new…

Machine Learning · Statistics 2020-07-09 He Jia , Uroš Seljak

Amortized simulator-based inference offers a powerful framework for tackling Bayesian inference in computational fields such as engineering or neuroscience, increasingly leveraging modern generative methods like diffusion models to map…

Importance sampling is a rare event simulation technique used in Monte Carlo simulations to bias the sampling distribution towards the rare event of interest. By assigning appropriate weights to sampled points, importance sampling allows…

In a broad and fundamental type of ''inverse problems'' in science, one infers a spatially distributed physical attribute based on observations of processes that are controlled by the spatial attribute in question. The data-generating field…

Methodology · Statistics 2014-09-09 Zepu Zhang

Over the last years, deep learning methods have become an increasingly popular choice to solve tasks from the field of inverse problems. Many of these new data-driven methods have produced impressive results, although most only give point…

Image and Video Processing · Electrical Eng. & Systems 2021-10-28 Alexander Denker , Maximilian Schmidt , Johannes Leuschner , Peter Maass

We propose a novel amortized variational inference scheme for an empirical Bayes meta-learning model, where model parameters are treated as latent variables. We learn the prior distribution over model parameters conditioned on limited…

Machine Learning · Computer Science 2020-08-31 Ekaterina Iakovleva , Jakob Verbeek , Karteek Alahari

Normalizing flows are a powerful technique for obtaining reparameterizable samples from complex multimodal distributions. Unfortunately, current approaches are only available for the most basic geometries and fall short when the underlying…

Machine Learning · Statistics 2021-05-03 Luca Falorsi

Each training step for a variational autoencoder (VAE) requires us to sample from the approximate posterior, so we usually choose simple (e.g. factorised) approximate posteriors in which sampling is an efficient computation that fully…

Machine Learning · Statistics 2018-05-29 Laurence Aitchison , Vincent Adam , Srinivas C. Turaga

We present a novel approach to transcranial ultrasound computed tomography that utilizes normalizing flows to improve the speed of imaging and provide Bayesian uncertainty quantification. Our method combines physics-informed methods and…

Image and Video Processing · Electrical Eng. & Systems 2023-03-08 Rafael Orozco , Mathias Louboutin , Ali Siahkoohi , Gabrio Rizzuti , Tristan van Leeuwen , Felix Herrmann

Simulator-based models are models for which the likelihood is intractable but simulation of synthetic data is possible. They are often used to describe complex real-world phenomena, and as such can often be misspecified in practice.…

Modern generative models can produce realistic samples, however, balancing memorisation and generalisation remains an open problem. We approach this challenge from a Bayesian perspective by focusing on the parameter space of flow matching…

This paper focuses on the problem of 3D human reconstruction from 2D evidence. Although this is an inherently ambiguous problem, the majority of recent works avoid the uncertainty modeling and typically regress a single estimate for a given…

Computer Vision and Pattern Recognition · Computer Science 2021-08-27 Nikos Kolotouros , Georgios Pavlakos , Dinesh Jayaraman , Kostas Daniilidis

Current deep learning-based solutions for image analysis tasks are commonly incapable of handling problems to which multiple different plausible solutions exist. In response, posterior-based methods such as conditional Diffusion Models and…

Gaussian processes (GPs) are Bayesian nonparametric models for function approximation with principled predictive uncertainty estimates. Deep Gaussian processes (DGPs) are multilayer generalizations of GPs that can represent complex marginal…

Machine Learning · Statistics 2024-09-20 Qiuxian Meng , Yongyou Zhang

Probabilistic programming languages (PPLs) are a powerful modeling tool, able to represent any computable probability distribution. Unfortunately, probabilistic program inference is often intractable, and existing PPLs mostly rely on…

Artificial Intelligence · Computer Science 2016-10-19 Daniel Ritchie , Paul Horsfall , Noah D. Goodman

While linear mixed modeling methods are foundational concepts introduced in any statistical education, adequate general methods for interval estimation involving models with more than a few variance components are lacking, especially in the…

Methodology · Statistics 2012-11-07 Jessi Cisewski , Jan Hannig