English
Related papers

Related papers: Belief propagation : an asymptotically optimal alg…

200 papers

Belief Propagation (BP) is a widely used approximation for exact probabilistic inference in graphical models, such as Markov Random Fields (MRFs). In graphs with cycles, however, no exact convergence guarantees for BP are known, in general.…

Artificial Intelligence · Computer Science 2016-12-28 Wolfgang Gatterbauer

Belief Propagation (BP) is a simple probabilistic inference algorithm, consisting of passing messages between nodes of a graph representing a probability distribution. Its analogy with a neural network suggests that it could have…

Artificial Intelligence · Computer Science 2024-03-20 Vincent Bouttier , Renaud Jardri , Sophie Deneve

Gaussian Belief Propagation (BP) algorithm is one of the most important distributed algorithms in signal processing and statistical learning involving Markov networks. It is well known that the algorithm correctly computes marginal density…

Machine Learning · Statistics 2019-03-08 Zhaorong Zhang , Minyue Fu

The max-product {belief propagation} (BP) is a popular message-passing heuristic for approximating a maximum-a-posteriori (MAP) assignment in a joint distribution represented by a graphical model (GM). In the past years, it has been shown…

Artificial Intelligence · Computer Science 2017-06-29 Sejun Park , Jinwoo Shin

In this paper, we investigate distributed inference schemes, over binary-valued Markov random fields, which are realized by the belief propagation (BP) algorithm. We first show that a decision variable obtained by the BP algorithm in a…

Information Theory · Computer Science 2019-09-19 Younes Abdi , Tapani Ristaniemi

Max-product "belief propagation" is an iterative, local, message-passing algorithm for finding the maximum a posteriori (MAP) assignment of a discrete probability distribution specified by a graphical model. Despite the spectacular success…

Information Theory · Computer Science 2012-03-06 Mohsen Bayati , Devavrat Shah , Mayank Sharma

Belief propagation (BP) is an iterative method to perform approximate inference on arbitrary graphical models. Whether BP converges and if the solution is a unique fixed point depends on both the structure and the parametrization of the…

Machine Learning · Statistics 2017-05-31 Christian Knoll , Franz Pernkopf , Dhagash Mehta , Tianran Chen

We define and study an inference algorithm based on "belief propagation" (BP) and the Bethe approximation. The idea is to encode into a graph an a priori information composed of correlations or marginal probabilities of variables, and to…

Physics and Society · Physics 2007-05-23 Cyril Furtlehner , Jean-Marc Lasgouttes , Arnaud De La Fortelle

The generalized belief propagation (GBP), introduced by Yedidia et al., is an extension of the belief propagation (BP) algorithm, which is widely used in different problems involved in calculating exact or approximate marginals of…

Machine Learning · Computer Science 2016-05-09 Farzin Haddadpour , Mahdi Jafari Siavoshani , Morteza Noshad

We study the Maximum Weight Matching (MWM) problem for general graphs through the max-product Belief Propagation (BP) and related Linear Programming (LP). The BP approach provides distributed heuristics for finding the Maximum A Posteriori…

Data Structures and Algorithms · Computer Science 2018-01-03 Sungsoo Ahn , Michael Chertkov , Andrew E. Gelfand , Sejun Park , Jinwoo Shin

We consider a class of spreading processes on networks, which generalize commonly used epidemic models such as the SIR model or the SIS model with a bounded number of re-infections. We analyse the related problem of inference of the…

Disordered Systems and Neural Networks · Physics 2024-07-22 D. Ghio , A. L. M. Aragon , I. Biazzo , L. Zdeborova

Message passing algorithms have proved surprisingly successful in solving hard constraint satisfaction problems on sparse random graphs. In such applications, variables are fixed sequentially to satisfy the constraints. Message passing is…

Artificial Intelligence · Computer Science 2019-06-05 Andrea Montanari , Federico Ricci-Tersenghi , Guilhem Semerjian

Belief propagation is a well-studied algorithm for approximating local marginals of multivariate probability distribution over complex networks, while tensor network states are powerful tools for quantum and classical many-body problems.…

Quantum Physics · Physics 2023-09-08 Chu Guo , Dario Poletti , Itai Arad

We present a novel distributed Gauss-Newton method for the non-linear state estimation (SE) model based on a probabilistic inference method called belief propagation (BP). The main novelty of our work comes from applying BP sequentially…

Information Theory · Computer Science 2018-08-28 Mirsad Cosovic , Dejan Vukobratovic

We consider the general problem of finding the minimum weight b-matching on arbitrary graphs. We prove that, whenever the linear programming relaxation of the problem has no fractional solutions, then the cavity or belief propagation…

Statistical Mechanics · Physics 2009-11-13 M. Bayati , C. Borgs , J. Chayes , R. Zecchina

Belief propagation (BP) provides a scalable heuristic for contracting tensor networks on loopy graphs, but its success in quantum many-body settings has largely rested on empirical evidence. Developing upon a recently introduced…

Quantum Physics · Physics 2026-04-06 Siddhant Midha , Grace M. Sommers , Joseph Tindall , Dmitry A. Abanin

It is well known that an arbitrary graphical model of statistical inference defined on a tree, i.e. on a graph without loops, is solved exactly and efficiently by an iterative Belief Propagation (BP) algorithm convergent to unique minimum…

Statistical Mechanics · Physics 2009-11-13 Michael Chertkov

We study the problem of reconstructing a perfect matching $M^*$ hidden in a randomly weighted $n\times n$ bipartite graph. The edge set includes every node pair in $M^*$ and each of the $n(n-1)$ node pairs not in $M^*$ independently with…

Statistics Theory · Mathematics 2021-03-18 Jian Ding , Yihong Wu , Jiaming Xu , Dana Yang

Recent years have seen a growing interest in the use of belief propagation - an algorithm originally introduced for performing statistical inference on graphical models - for approximate, but highly efficient, tensor network contraction.…

Quantum Physics · Physics 2026-04-28 Joseph Tindall , Grace M. Sommers , Hilbert Kappen

Belief Propagation algorithms are instruments used broadly to solve graphical model optimization and statistical inference problems. In the general case of a loopy Graphical Model, Belief Propagation is a heuristic which is quite successful…

Machine Learning · Statistics 2021-09-15 Andrii Riazanov , Yury Maximov , Michael Chertkov