English
Related papers

Related papers: Pull Message Passing for Nonparametric Belief Prop…

200 papers

The canonical problem of solving a system of linear equations arises in numerous contexts in information theory, communication theory, and related fields. In this contribution, we develop a solution based upon Gaussian belief propagation…

Information Theory · Computer Science 2008-10-08 Ori Shental , Danny Bickson , Paul H. Siegel , Jack K. Wolf , Danny Dolev

Methods to extract information from the tracking of mobile objects/particles have broad interest in biological and physical sciences. Techniques based on simple criteria of proximity in time-consecutive snapshots are useful to identify the…

Data Analysis, Statistics and Probability · Physics 2015-03-13 M. Chertkov , L. Kroc , F. Krzakala , M. Vergassola , L. Zdeborová

The goal of hyperspectral unmixing is to decompose an electromagnetic spectral dataset measured over M spectral bands and T pixels into N constituent material spectra (or "end-members") with corresponding spatial abundances. In this paper,…

Information Theory · Computer Science 2015-08-05 Jeremy Vila , Philip Schniter , Joseph Meola

Efficient inference in high-dimensional models is a central challenge in machine learning. We introduce the Gaussian Ensemble Belief Propagation (GEnBP) algorithm, which combines the strengths of the Ensemble Kalman Filter (EnKF) and…

Machine Learning · Computer Science 2025-02-12 Dan MacKinlay , Russell Tsuchida , Dan Pagendam , Petra Kuhnert

Belief Propagation (BP) is a powerful algorithm for distributed inference in probabilistic graphical models, however it quickly becomes infeasible for practical compute and memory budgets. Many efficient, non-parametric forms of BP have…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-30 Tom Yates , Yuzhou Cheng , Ignacio Alzugaray , Danyal Akarca , Pedro A. M. Mediano , Andrew J. Davison

We describe a novel approach to statistical learning from particles tracked while moving in a random environment. The problem consists in inferring properties of the environment from recorded snapshots. We consider here the case of a fluid…

Information Theory · Computer Science 2008-06-09 Michael Chertkov , Lukas Kroc , Massimo Vergassola

A fundamental computation for statistical inference and accurate decision-making is to compute the marginal probabilities or most probable states of task-relevant variables. Probabilistic graphical models can efficiently represent the…

Machine Learning · Computer Science 2019-06-28 KiJung Yoon , Renjie Liao , Yuwen Xiong , Lisa Zhang , Ethan Fetaya , Raquel Urtasun , Richard Zemel , Xaq Pitkow

Expectation Propagation (EP) is a widely used message-passing algorithm that decomposes a global inference problem into multiple local ones. It approximates marginal distributions (beliefs) using intermediate functions (messages). While…

Information Theory · Computer Science 2026-01-30 Zilu Zhao , Fangqing Xiao , Dirk Slock

Inference in continuous label Markov random fields is a challenging task. We use particle belief propagation (PBP) for solving the inference problem in continuous label space. Sampling particles from the belief distribution is typically…

Computer Vision and Pattern Recognition · Computer Science 2018-02-12 Oliver Mueller , Michael Ying Yang , Bodo Rosenhahn

Data association, the problem of reasoning over correspondence between targets and measurements, is a fundamental problem in tracking. This paper presents a graphical model formulation of data association and applies an approximate…

Artificial Intelligence · Computer Science 2014-12-16 Jason L. Williams , Roslyn A. Lau

Inference for probabilistic graphical models is still very much a practical challenge in large domains. The commonly used and effective belief propagation (BP) algorithm and its generalizations often do not converge when applied to hard,…

Artificial Intelligence · Computer Science 2012-07-02 Gal Elidan , Ian McGraw , Daphne Koller

We propose and analyze an approximate message passing (AMP) algorithm for the matrix tensor product model, which is a generalization of the standard spiked matrix models that allows for multiple types of pairwise observations over a…

Machine Learning · Statistics 2023-06-28 Riccardo Rossetti , Galen Reeves

Nonparametric maximum likelihood (NPML) for mixture models is a technique for estimating mixing distributions that has a long and rich history in statistics going back to the 1950s, and is closely related to empirical Bayes methods.…

Methodology · Statistics 2018-01-15 Long Feng , Lee H. Dicker

In this paper we treat both forms of probabilistic inference, estimating marginal probabilities of the joint distribution and finding the most probable assignment, through a unified message-passing algorithm architecture. We generalize the…

Artificial Intelligence · Computer Science 2010-06-29 Tamir Hazan , Amnon Shashua

Message-passing algorithms based on the Belief Propagation (BP) equations constitute a well-known distributed computational scheme. It is exact on tree-like graphical models and has also proven to be effective in many problems defined on…

Machine Learning · Computer Science 2022-07-20 Carlo Lucibello , Fabrizio Pittorino , Gabriele Perugini , Riccardo Zecchina

Gaussian belief propagation (GaBP) is a technique that relies on linearized error and input-output models to yield low-complexity solutions to complex estimation problems, which has been recently shown to be effective in the design of…

Signal Processing · Electrical Eng. & Systems 2026-02-05 Niclas Führling , Hyeon Seok Rou , Giuseppe Abreu , David González G. , Osvaldo Gonsa

Gaussian belief propagation (BP) has been widely used for distributed inference in large-scale networks such as the smart grid, sensor networks, and social networks, where local measurements/observations are scattered over a wide…

Machine Learning · Computer Science 2017-11-21 Jian Du , Shaodan Ma , Yik-Chung Wu , Soummya Kar , José M. F. Moura

We introduce the lifted Generalized Belief Propagation (GBP) message passing algorithm, for the computation of sum-product queries in Probabilistic Relational Models (e.g. Markov logic network). The algorithm forms a compact region graph…

Artificial Intelligence · Computer Science 2016-10-06 Udi Apsel

We present a differentiable approach to learn the probabilistic factors used for inference by a nonparametric belief propagation algorithm. Existing nonparametric belief propagation methods rely on domain-specific features encoded in the…

Belief propagation (BP) is a popular method for performing probabilistic inference on graphical models. In this work, we enhance BP and propose self-guided belief propagation (SBP) that incorporates the pairwise potentials only gradually.…

Machine Learning · Statistics 2024-10-30 Christian Knoll , Adrian Weller , Franz Pernkopf