English
Related papers

Related papers: Expectation Propagation for Nonlinear Inverse Prob…

200 papers

We consider amortized Bayesian inference for nonlinear inverse problems in settings where only samples from the joint distribution of parameters and observations are available. Classical methods such as Markov chain Monte Carlo require…

Numerical Analysis · Mathematics 2026-05-19 Hojjat Kaveh , Ricardo Baptista , Andrew M. Stuart

This paper provides an analysis of the linearized inverse problem in multifrequency electrical impedance tomography. We consider an isotropic conductivity distribution with a finite number of unknown inclusions with different frequency…

Numerical Analysis · Mathematics 2016-10-06 Giovanni S. Alberti , Habib Ammari , Bangti Jin , Jin-Keun Seo , Wenlong Zhang

Expectation Propagation (Minka, 2001) is a widely successful algorithm for variational inference. EP is an iterative algorithm used to approximate complicated distributions, typically to find a Gaussian approximation of posterior…

Computation · Statistics 2016-04-01 Guillaume Dehaene , Simon Barthelmé

This paper presents a new Expectation Propagation (EP) framework for image restoration using patch-based prior distributions. While Monte Carlo techniques are classically used to sample from intractable posterior distributions, they can…

Computer Vision and Pattern Recognition · Computer Science 2021-11-11 Dan Yao , Stephen McLaughlin , Yoann Altmann

We consider the inverse problem of reconstructing the posterior measure over the trajec- tories of a diffusion process from discrete time observations and continuous time constraints. We cast the problem in a Bayesian framework and derive…

Machine Learning · Statistics 2016-12-21 Botond Cseke , David Schnoerr , Manfred Opper , Guido Sanguinetti

Doubly intractable distributions arise in many settings, for example in Markov models for point processes and exponential random graph models for networks. Bayesian inference for these models is challenging because they involve intractable…

Computation · Statistics 2019-04-03 Jaewoo Park , Murali Haran

Formulating a statistical inverse problem as one of inference in a Bayesian model has great appeal, notably for what this brings in terms of coherence, the interpretability of regularisation penalties, the integration of all uncertainties,…

Statistics Theory · Mathematics 2012-12-19 Natalia A. Bochkina , Peter J. Green

In order to solve tasks like uncertainty quantification or hypothesis tests in Bayesian imaging inverse problems, we often have to draw samples from the arising posterior distribution. For the usually log-concave but high-dimensional…

Computation · Statistics 2025-01-23 Matthias J. Ehrhardt , Lorenz Kuger , Carola-Bibiane Schönlieb

We investigate the problem of approximate Bayesian inference for a general class of observation models by means of the expectation propagation (EP) framework for large systems under some statistical assumptions. Our approach tries to…

Information Theory · Computer Science 2016-08-24 Burak Çakmak , Manfred Opper , Bernard H. Fleury , Ole Winther

We propose a novel algorithm to solve the expectation propagation relaxation of Bayesian inference for continuous-variable graphical models. In contrast to most previous algorithms, our method is provably convergent. By marrying convergent…

Machine Learning · Statistics 2010-12-17 Matthias W. Seeger , Hannes Nickisch

We present a new approach to the electromagnetic inverse problem that explicitly addresses the ambiguity associated with its ill-posed character. Rather than calculating a single ``best'' solution according to some criterion, our approach…

Neurons and Cognition · Quantitative Biology 2007-05-23 David M. Schmidt , John S. George , C. C. Wood

Estimation of parameters that obey specific constraints is crucial in statistics and machine learning; for example, when parameters are required to satisfy boundedness, monotonicity, or linear inequalities. Traditional approaches impose…

Methodology · Statistics 2026-04-03 Lachlan Astfalck , Deborshee Sen , Sayan Patra , Edward Cripps , David Dunson

Binary regression models represent a popular model-based approach for binary classification. In the Bayesian framework, computational challenges in the form of the posterior distribution motivate still-ongoing fruitful research. Here, we…

Computation · Statistics 2023-09-06 Augusto Fasano , Niccolò Anceschi , Beatrice Franzolini , Giovanni Rebaudo

This paper presents a new deterministic approximation technique in Bayesian networks. This method, "Expectation Propagation", unifies two previous techniques: assumed-density filtering, an extension of the Kalman filter, and loopy belief…

Artificial Intelligence · Computer Science 2013-01-14 Thomas P. Minka

Inverse problems, i.e., estimating parameters of physical models from experimental data, are ubiquitous in science and engineering. The Bayesian formulation is the gold standard because it alleviates ill-posedness issues and quantifies…

Machine Learning · Statistics 2024-05-28 Sharmila Karumuri , Ilias Bilionis

Expectation Propagation (EP) is a widely used message-passing algorithm that decomposes a global inference problem into multiple local ones. It approximates marginal distributions (beliefs) using intermediate functions (messages). While…

Information Theory · Computer Science 2026-01-30 Zilu Zhao , Fangqing Xiao , Dirk Slock

In indirect measurements, the measurand is determined by solving an inverse problem which requires a model of the measurement process. Such models are often approximations and introduce systematic errors leading to a bias of the posterior…

Methodology · Statistics 2025-09-22 Maren Casfor , Philipp Trunschke , Sebastian Heidenreich , Nando Hegemann

Bayesian probabilistic numerical methods are a set of tools providing posterior distributions on the output of numerical methods. The use of these methods is usually motivated by the fact that they can represent our uncertainty due to…

Computation · Statistics 2018-08-01 Xiaoyue Xi , François-Xavier Briol , Mark Girolami

Bayesian posterior distributions arising in modern applications, including inverse problems in partial differential equation models in tomography and subsurface flow, are often computationally intractable due to the large computational cost…

Machine Learning · Statistics 2023-02-10 Tapio Helin , Andrew Stuart , Aretha Teckentrup , Konstantinos Zygalakis

Most modern imaging systems incorporate a computational pipeline to infer the image of interest from acquired measurements. The Bayesian approach to solve such ill-posed inverse problems involves the characterization of the posterior…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Pakshal Bohra , Thanh-an Pham , Jonathan Dong , Michael Unser