English
Related papers

Related papers: Fast Convergent Algorithms for Expectation Propaga…

200 papers

A method for large scale Gaussian process classification has been recently proposed based on expectation propagation (EP). Such a method allows Gaussian process classifiers to be trained on very large datasets that were out of the reach of…

We study Bayesian methods for large-scale linear inverse problems, focusing on the challenging task of hyperparameter estimation. Typical hierarchical Bayesian formulations that follow a Markov Chain Monte Carlo approach are possible for…

Numerical Analysis · Mathematics 2024-01-05 Khalil A Hall-Hooper , Arvind K Saibaba , Julianne Chung , Scot M Miller

Compressive sensing (CS) is an emerging field based on the revelation that a small collection of linear projections of a sparse signal contains enough information for stable, sub-Nyquist signal acquisition. When a statistical…

Information Theory · Computer Science 2009-06-25 Dror Baron , Shriram Sarvotham , Richard G. Baraniuk

We introduce a novel relaxation of combinatorial discrepancy called Gaussian discrepancy, whereby binary signings are replaced with correlated standard Gaussian random variables. This relaxation effectively reformulates an optimization…

Discrete Mathematics · Computer Science 2022-08-11 Sinho Chewi , Patrik Gerber , Philippe Rigollet , Paxton Turner

Expectation propagation is a general approach to fast approximate inference for graphical models. The existing literature treats models separately when it comes to deriving and coding expectation propagation inference algorithms. This comes…

Methodology · Statistics 2018-01-17 Wilson Y. Chen , Matt P. Wand

Bayesian inference on non-Gaussian data is often non-analytic and requires computationally expensive approximations such as sampling or variational inference. We propose an approximate inference framework primarily designed to be…

Machine Learning · Computer Science 2022-10-12 Marius Hobbhahn , Philipp Hennig

In this article, we present an $O(N \log N)$ rapidly convergent algorithm for the numerical approximation of the convolution integral with radially symmetric weakly singular kernels and compactly supported densities. To achieve the reduced…

Numerical Analysis · Mathematics 2021-07-09 Awanish Kumar Tiwari , Ambuj Pandey , Jagabandhu Paul , Akash Anand

We propose a unified, yet simple to code, non-conjugate variational Bayes algorithm for posterior approximation of generic Bayesian generalized mixed effect models. Specifically, we consider regression models identified by a linear…

Methodology · Statistics 2025-10-14 Cristian Castiglione , Mauro Bernardi

In this paper, we study efficient approximate sampling for probability distributions known up to normalization constants. We specifically focus on a problem class arising in Bayesian inference for large-scale inverse problems in science and…

Machine Learning · Computer Science 2024-10-14 Yifan Chen , Daniel Zhengyu Huang , Jiaoyang Huang , Sebastian Reich , Andrew M. Stuart

Belief updating in Bayes nets, a well known computationally hard problem, has recently been approximated by several deterministic algorithms, and by various randomized approximation algorithms. Deterministic algorithms usually provide…

Artificial Intelligence · Computer Science 2013-02-18 Eugene Santos , Solomon Eyal Shimony , Edward Williams

This paper presents an efficient Bayesian framework for solving nonlinear, high-dimensional model calibration problems. It is based on a Variational Bayesian formulation that aims at approximating the exact posterior by means of solving an…

Applications · Statistics 2015-11-02 Isabell M. Franck , P. S. Koutsourelakis

A new framework for analyzing Fejer convergent algorithms is presented. Using this framework we define a very general class of Fejer convergent algorithms and establish its convergence properties. We also introduce a new definition of…

Optimization and Control · Mathematics 2012-04-19 B. F. Svaiter

In this work, we present the Bregman Alternating Projected Gradient (BAPG) method, a single-loop algorithm that offers an approximate solution to the Gromov-Wasserstein (GW) distance. We introduce a novel relaxation technique that balances…

Computational Geometry · Computer Science 2023-03-14 Jiajin Li , Jianheng Tang , Lemin Kong , Huikang Liu , Jia Li , Anthony Man-Cho So , Jose Blanchet

This paper presents the application, testing and first results of a new adaptive Bayesian inference analysis which utilises conventional and ultrafast spectroscopic measurements made in the divertor chamber to investigate the divertor…

Plasma Physics · Physics 2024-04-24 Xander Pope , Kevin Verhaegh , Chris Bowman , Bruce Lipschultz

We introduce and investigate an iterative scheme for approximating common fixed point of a family of Bregman relatively-nonexpansive mappings in real reflexive Banach spaces. We prove strong convergence theorem of the sequence generated by…

Functional Analysis · Mathematics 2017-07-27 Oladipo Abiodun Timoye , Enyinnaya Ekuma-Okereke

This paper introduces a new method for performing computational inference on log-Gaussian Cox processes. The likelihood is approximated directly by making novel use of a continuously specified Gaussian random field. We show that for…

Computation · Statistics 2015-11-02 Daniel Simpson , Janine Illian , Finn Lindgren , Sigrunn Sørbye , Håvard Rue

The Expectation Maximization (EM) algorithm is a key reference for inference in latent variable models; unfortunately, its computational cost is prohibitive in the large scale learning setting. In this paper, we propose an extension of the…

Machine Learning · Statistics 2020-11-26 Gersende Fort , Eric Moulines , Hoi-To Wai

Expectation Propagation (EP) is a widely used iterative message-passing algorithm that decomposes a global inference problem into multiple local ones. It approximates marginal distributions as ``beliefs'' using intermediate functions called…

Machine Learning · Statistics 2026-04-07 Zilu Zhao , Jichao Chen , Dirk Slock

Paraxial diffraction modeling based on the Fourier transform has seen widespread implementation for simulating the response of a diffraction-limited optical system. For systems where the paraxial assumption is not sufficient, a class of…

Reconstructing images from downsampled and noisy measurements, such as MRI and low dose Computed Tomography (CT), is a mathematically ill-posed inverse problem. We propose an easy-to-use reconstruction method based on Expectation…

Image and Video Processing · Electrical Eng. & Systems 2022-08-29 Robert G. Aykroyd , Kehinde Olobatuyi