English
Related papers

Related papers: Exactness of Belief Propagation for Some Graphical…

200 papers

This manuscript discusses computation of the Partition Function (PF) and the Minimum Weight Perfect Matching (MWPM) on arbitrary, non-bipartite graphs. We present two novel problem formulations - one for computing the PF of a Perfect…

Statistical Mechanics · Physics 2015-06-16 Michael Chertkov , Andrew Gelfand , Jinwoo Shin

Belief Propagation algorithms are instruments used broadly to solve graphical model optimization and statistical inference problems. In the general case of a loopy Graphical Model, Belief Propagation is a heuristic which is quite successful…

Machine Learning · Statistics 2021-09-15 Andrii Riazanov , Yury Maximov , Michael Chertkov

It is known that fixed points of loopy belief propagation (BP) correspond to stationary points of the Bethe variational problem, where we minimize the Bethe free energy subject to normalization and marginalization constraints.…

Machine Learning · Computer Science 2012-03-19 Tomas Werner

After the discovery that fixed points of loopy belief propagation coincide with stationary points of the Bethe free energy, several researchers proposed provably convergent algorithms to directly minimize the Bethe free energy. These…

Computer Vision and Pattern Recognition · Computer Science 2011-12-23 Tomas Werner

In the context of inference with expectation constraints, we propose an approach based on the "loopy belief propagation" algorithm LBP, as a surrogate to an exact Markov Random Field MRF modelling. A prior information composed of…

Machine Learning · Computer Science 2015-05-13 Cyril Furtlehner , Jean-Marc Lasgouttes , Anne Auger

We propose a new approach to the analysis of Loopy Belief Propagation (LBP) by establishing a formula that connects the Hessian of the Bethe free energy with the edge zeta function. The formula has a number of theoretical implications on…

Artificial Intelligence · Computer Science 2010-02-18 Yusuke Watanabe , Kenji Fukumizu

Belief propagation (BP) is a message-passing heuristic for statistical inference in graphical models such as Bayesian networks and Markov random fields. BP is used to compute marginal distributions or maximum likelihood assignments and has…

Data Structures and Algorithms · Computer Science 2012-11-15 Tobias Brunsch , Kamiel Cornelissen , Bodo Manthey , Heiko Röglin

The max-product {belief propagation} (BP) is a popular message-passing heuristic for approximating a maximum-a-posteriori (MAP) assignment in a joint distribution represented by a graphical model (GM). In the past years, it has been shown…

Artificial Intelligence · Computer Science 2017-06-29 Sejun Park , Jinwoo Shin

Belief Propagation (BP) is one of the most popular methods for inference in probabilistic graphical models. BP is guaranteed to return the correct answer for tree structures, but can be incorrect or non-convergent for loopy graphical…

Artificial Intelligence · Computer Science 2012-06-22 Siamak Ravanbakhsh , Chun-Nam Yu , Russell Greiner

Belief Propagation (BP) is an efficient message-passing algorithm widely used for inference in graphical models and for solving various problems in statistical physics. However, BP often yields inaccurate estimates of order parameters and…

Social and Information Networks · Computer Science 2025-10-23 Seongmin Kim , Alec Kirkley

Belief Propagation (BP) is a powerful algorithm for distributed inference in probabilistic graphical models, however it quickly becomes infeasible for practical compute and memory budgets. Many efficient, non-parametric forms of BP have…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-30 Tom Yates , Yuzhou Cheng , Ignacio Alzugaray , Danyal Akarca , Pedro A. M. Mediano , Andrew J. Davison

This paper resolves a common complexity issue in the Bethe approximation of statistical physics and the Belief Propagation (BP) algorithm of artificial intelligence. The Bethe approximation and the BP algorithm are heuristic methods for…

Artificial Intelligence · Computer Science 2013-03-22 Jinwoo Shin

Belief propagation (BP) is a message-passing method for solving probabilistic graphical models. It is very successful in treating disordered models (such as spin glasses) on random graphs. On the other hand, finite-dimensional lattice…

Statistical Mechanics · Physics 2016-02-17 Hai-Jun Zhou , Wei-Mou Zheng

When belief propagation (BP) converges, it does so to a stationary point of the Bethe free energy $F$, and is often strikingly accurate. However, it may converge only to a local optimum or may not converge at all. An algorithm was recently…

Machine Learning · Computer Science 2014-01-03 Adrian Weller , Tony Jebara

This work proves a new result on the correct convergence of Min-Sum Loopy Belief Propagation (LBP) in an interpolation problem on a square grid graph. The focus is on the notion of local solutions, a numerical quantity attached to each site…

Other Computer Science · Computer Science 2017-02-22 Yutong Wang , Matthew G. Reyes , David L. Neuhoff

Message passing type algorithms such as the so-called Belief Propagation algorithm have recently gained a lot of attention in the statistics, signal processing and machine learning communities as attractive algorithms for solving a variety…

Discrete Mathematics · Computer Science 2016-03-10 David Gamarnik , Devavrat Shah , Yehua Wei

We discuss schemes for exact and approximate computations of permanents, and compare them with each other. Specifically, we analyze the Belief Propagation (BP) approach and its Fractional Belief Propagation (FBP) generalization for…

Discrete Mathematics · Computer Science 2013-01-08 M. Chertkov , A. B. Yedidia

We consider belief propagation (BP) as an efficient and scalable tool for state estimation and optimization problems in supply networks such as power grids. BP algorithms make use of factor graph representations, whose assignment to the…

Artificial Intelligence · Computer Science 2022-06-09 Tim Ritmeester , Hildegard Meyer-Ortmanns

Belief propagation (BP) provides a scalable heuristic for contracting tensor networks on loopy graphs, but its success in quantum many-body settings has largely rested on empirical evidence. Developing upon a recently introduced…

Quantum Physics · Physics 2026-04-06 Siddhant Midha , Grace M. Sommers , Joseph Tindall , Dmitry A. Abanin

Loopy Belief Propagation (LBP) is a widely used approximate inference algorithm in probabilistic graphical models, with applications in computer vision, error correction codes, protein folding, program analysis, etc. However, LBP faces…

Software Engineering · Computer Science 2025-09-29 Haoyu Feng , Xin Zhang