English
Related papers

Related papers: Self-Guided Belief Propagation -- A Homotopy Conti…

200 papers

In this article, we present a visual introduction to Gaussian Belief Propagation (GBP), an approximate probabilistic inference algorithm that operates by passing messages between the nodes of arbitrarily structured factor graphs. A special…

Artificial Intelligence · Computer Science 2021-07-07 Joseph Ortiz , Talfan Evans , Andrew J. Davison

Belief propagation (BP) is a message-passing method for solving probabilistic graphical models. It is very successful in treating disordered models (such as spin glasses) on random graphs. On the other hand, finite-dimensional lattice…

Statistical Mechanics · Physics 2016-02-17 Hai-Jun Zhou , Wei-Mou Zheng

Belief propagation is known to perform extremely well in many practical statistical inference and learning problems using graphical models, even in the presence of multiple loops. The iterative use of belief propagation algorithm on loopy…

Information Theory · Computer Science 2013-02-13 Xiangqiong Shi , Dan Schonfeld , Daniela Tuninetti

We present an exact method of greatly speeding up belief propagation (BP) for a wide variety of potential functions in pairwise MRFs and other graphical models. Specifically, our technique applies whenever the pairwise potentials have been…

Computer Vision and Pattern Recognition · Computer Science 2010-10-04 James M. Coughlan , Huiying Shen

We first present an empirical study of the Belief Propagation (BP) algorithm, when run on the random field Ising model defined on random regular graphs in the zero temperature limit. We introduce the notion of maximal solutions for the BP…

Disordered Systems and Neural Networks · Physics 2018-02-01 Gabriele Perugini , Federico Ricci-Tersenghi

Gaussian belief propagation (BP) has been widely used for distributed inference in large-scale networks such as the smart grid, sensor networks, and social networks, where local measurements/observations are scattered over a wide…

Machine Learning · Computer Science 2017-11-21 Jian Du , Shaodan Ma , Yik-Chung Wu , Soummya Kar , José M. F. Moura

We present new message passing algorithms for performing inference with graphical models. Our methods are designed for the most difficult inference problems where loopy belief propagation and other heuristics fail to converge. Belief…

Artificial Intelligence · Computer Science 2022-07-19 Anna Grim , Pedro Felzenszwalb

Gaussian belief propagation (BP) is a computationally efficient method to approximate the marginal distribution and has been widely used for inference with high dimensional data as well as distributed estimation in large-scale networks.…

Information Theory · Computer Science 2017-11-29 Jian Du , Soummya Kar , José M. F. Moura

Generalized belief propagation (GBP) has proven to be a promising technique for approximate inference tasks in AI and machine learning. However, the choice of a good set of clusters to be used in GBP has remained more of an art then a…

Artificial Intelligence · Computer Science 2012-07-19 Max Welling

The belief propagation (BP) algorithm is an efficient way to solve "inference" problems in graphical models, such as Bayesian networks and Markov random fields. The system-state probability distribution of CSMA wireless networks is a Markov…

Networking and Internet Architecture · Computer Science 2011-07-15 Cai Hong Kai , Soung Chang Liew

Belief Propagation (BP) is a message-passing algorithm for approximate inference over Probabilistic Graphical Models (PGMs), finding many applications such as computer vision, error-correcting codes, and protein-folding. While general, the…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-09-26 Mark Van der Merwe , Vinu Joseph , Ganesh Gopalakrishnan

We describe a novel approach to statistical learning from particles tracked while moving in a random environment. The problem consists in inferring properties of the environment from recorded snapshots. We consider here the case of a fluid…

Information Theory · Computer Science 2008-06-09 Michael Chertkov , Lukas Kroc , Massimo Vergassola

In the context of inference with expectation constraints, we propose an approach based on the "loopy belief propagation" algorithm LBP, as a surrogate to an exact Markov Random Field MRF modelling. A prior information composed of…

Machine Learning · Computer Science 2015-05-13 Cyril Furtlehner , Jean-Marc Lasgouttes , Anne Auger

We present a novel inference algorithm for arbitrary, binary, undirected graphs. Unlike loopy belief propagation, which iterates fixed point equations, we directly descend on the Bethe free energy. The algorithm consists of two phases,…

Artificial Intelligence · Computer Science 2013-01-14 Max Welling , Yee Whye Teh

Belief Propagation (BP) is an important message-passing algorithm for various reasoning tasks over graphical models, including solving the Constraint Optimization Problems (COPs). It has been shown that BP can achieve state-of-the-art…

Artificial Intelligence · Computer Science 2022-09-27 Yanchen Deng , Shufeng Kong , Caihua Liu , Bo An

Gaussian belief propagation (GaBP) is an iterative message-passing algorithm for inference in Gaussian graphical models. It is known that when GaBP converges it converges to the correct MAP estimate of the Gaussian random vector and simple…

Information Theory · Computer Science 2010-03-23 Jason K. Johnson , Danny Bickson , Danny Dolev

Location-aware networks will introduce innovative services and applications for modern convenience, applied ocean sciences, and public safety. In this paper, we establish a hybrid method for model-based and data-driven inference. We…

Machine Learning · Computer Science 2021-05-28 Mingchao Liang , Florian Meyer

Belief propagation (BP) is a useful probabilistic inference algorithm for efficiently computing approximate marginal probability densities of random variables. However, in its standard form, BP is only applicable to the vector-type random…

Artificial Intelligence · Computer Science 2024-04-05 Hyowon Kim , Angel F. García-Fernández , Yu Ge , Yuxuan Xia , Lennart Svensson , Henk Wymeersch

We consider inference (filtering) problems over probabilistic graphical models with aggregate data generated by a large population of individuals. We propose a new efficient belief propagation type algorithm over tree-structured graphs with…

Machine Learning · Computer Science 2020-10-06 Rahul Singh , Isabel Haasler , Qinsheng Zhang , Johan Karlsson , Yongxin Chen

We apply belief propagation (BP) to multi--user detection in a spread spectrum system, under the assumption of Gaussian symbols. We prove that BP is both convergent and allows to estimate the correct conditional expectation of the input…

Information Theory · Computer Science 2007-07-13 Andrea Montanari , Balaji Prabhakar , David Tse