English
Related papers

Related papers: Fast Convergence of Belief Propagation to Global O…

200 papers

We generalize the belief-propagation algorithm to sparse random networks with arbitrary distributions of motifs (triangles, loops, etc.). Each vertex in these networks belongs to a given set of motifs (generalization of the configuration…

Disordered Systems and Neural Networks · Physics 2015-05-28 S. Yoon , A. V. Goltsev , S. N. Dorogovtsev , J. F. F. Mendes

Inference problems in graphical models can be represented as a constrained optimization of a free energy function. It is known that when the Bethe free energy is used, the fixedpoints of the belief propagation (BP) algorithm correspond to…

Machine Learning · Computer Science 2012-06-18 Tamir Hazan , Amnon Shashua

Belief Propagation is a well-studied message-passing algorithm that runs over graphical models and can be used for approximate inference and approximation of local marginals. The resulting approximations are equivalent to the Bethe-Peierls…

Quantum Physics · Physics 2021-05-05 Roy Alkabetz , Itai Arad

Belief propagation (BP) provides a scalable heuristic for contracting tensor networks on loopy graphs, but its success in quantum many-body settings has largely rested on empirical evidence. Developing upon a recently introduced…

Quantum Physics · Physics 2026-04-06 Siddhant Midha , Grace M. Sommers , Joseph Tindall , Dmitry A. Abanin

Belief propagation (BP) is a popular method for performing probabilistic inference on graphical models. In this work, we enhance BP and propose self-guided belief propagation (SBP) that incorporates the pairwise potentials only gradually.…

Machine Learning · Statistics 2024-10-30 Christian Knoll , Adrian Weller , Franz Pernkopf

Belief Propagation (BP) is a widely used approximation for exact probabilistic inference in graphical models, such as Markov Random Fields (MRFs). In graphs with cycles, however, no exact convergence guarantees for BP are known, in general.…

Artificial Intelligence · Computer Science 2016-12-28 Wolfgang Gatterbauer

We consider the general problem of finding the minimum weight $\bm$-matching on arbitrary graphs. We prove that, whenever the linear programming (LP) relaxation of the problem has no fractional solutions, then the belief propagation (BP)…

Information Theory · Computer Science 2015-03-13 Mohsen Bayati , Christian Borgs , Jennifer Chayes , Riccardo Zecchina

In this article, we present a visual introduction to Gaussian Belief Propagation (GBP), an approximate probabilistic inference algorithm that operates by passing messages between the nodes of arbitrarily structured factor graphs. A special…

Artificial Intelligence · Computer Science 2021-07-07 Joseph Ortiz , Talfan Evans , Andrew J. Davison

We describe a novel approach to statistical learning from particles tracked while moving in a random environment. The problem consists in inferring properties of the environment from recorded snapshots. We consider here the case of a fluid…

Information Theory · Computer Science 2008-06-09 Michael Chertkov , Lukas Kroc , Massimo Vergassola

An important part of problems in statistical physics and computer science can be expressed as the computation of marginal probabilities over a Markov Random Field. The belief propagation algorithm, which is an exact procedure to compute…

Machine Learning · Computer Science 2011-01-24 Victorin Martin , Jean-Marc Lasgouttes , Cyril Furtlehner

Belief propagation is known to perform extremely well in many practical statistical inference and learning problems using graphical models, even in the presence of multiple loops. The iterative use of belief propagation algorithm on loopy…

Information Theory · Computer Science 2013-02-13 Xiangqiong Shi , Dan Schonfeld , Daniela Tuninetti

Gaussian belief propagation (GBP) is a recursive computation method that is widely used in inference for computing marginal distributions efficiently. Depending on how the factorization of the underlying joint Gaussian distribution is…

Information Theory · Computer Science 2018-01-22 Jian Du , Shaodan Ma , Yik-Chung Wu , Soummya Kar , José M. F. Moura

Undirected graphical models are a widely used class of probabilistic models in machine learning that capture prior knowledge or putative pairwise interactions between variables. Those interactions are encoded in a graph for pairwise…

Statistics Theory · Mathematics 2025-03-21 Grégoire Sergeant-Perthuis , Toby St Clere Smithe , Léo Boitel

We present new message passing algorithms for performing inference with graphical models. Our methods are designed for the most difficult inference problems where loopy belief propagation and other heuristics fail to converge. Belief…

Artificial Intelligence · Computer Science 2022-07-19 Anna Grim , Pedro Felzenszwalb

A graphical model is a structured representation of locally dependent random variables. A traditional method to reason over these random variables is to perform inference using belief propagation. When provided with the true data generating…

Machine Learning · Computer Science 2021-03-17 Victor Garcia Satorras , Max Welling

A major benefit of graphical models is that most knowledge is captured in the model structure. Many models, however, produce inference problems with a lot of symmetries not reflected in the graphical structure and hence not exploitable by…

Artificial Intelligence · Computer Science 2012-05-14 Kristian Kersting , Babak Ahmadi , Sriraam Natarajan

Belief propagation (BP) is a message-passing method for solving probabilistic graphical models. It is very successful in treating disordered models (such as spin glasses) on random graphs. On the other hand, finite-dimensional lattice…

Statistical Mechanics · Physics 2016-02-17 Hai-Jun Zhou , Wei-Mou Zheng

We consider belief propagation (BP) as an efficient and scalable tool for state estimation and optimization problems in supply networks such as power grids. BP algorithms make use of factor graph representations, whose assignment to the…

Artificial Intelligence · Computer Science 2022-06-09 Tim Ritmeester , Hildegard Meyer-Ortmanns

The belief propagation (BP) algorithm is an efficient way to solve "inference" problems in graphical models, such as Bayesian networks and Markov random fields. The system-state probability distribution of CSMA wireless networks is a Markov…

Networking and Internet Architecture · Computer Science 2011-07-15 Cai Hong Kai , Soung Chang Liew

This paper considers inference over distributed linear Gaussian models using factor graphs and Gaussian belief propagation (BP). The distributed inference algorithm involves only local computation of the information matrix and of the mean…

Machine Learning · Statistics 2018-01-01 Jian Du , Shaodan Ma , Yik-Chung Wu , Soummya Kar , José M. F. Moura