English
Related papers

Related papers: Linearized and Single-Pass Belief Propagation

200 papers

Learned neural solvers have successfully been used to solve combinatorial optimization and decision problems. More general counting variants of these problems, however, are still largely solved with hand-crafted solvers. To bridge this gap,…

Machine Learning · Computer Science 2020-07-02 Jonathan Kuck , Shuvam Chakraborty , Hao Tang , Rachel Luo , Jiaming Song , Ashish Sabharwal , Stefano Ermon

Belief Propagation algorithms are instruments used broadly to solve graphical model optimization and statistical inference problems. In the general case of a loopy Graphical Model, Belief Propagation is a heuristic which is quite successful…

Machine Learning · Statistics 2021-09-15 Andrii Riazanov , Yury Maximov , Michael Chertkov

The community detection problem requires to cluster the nodes of a network into a small number of well-connected "communities". There has been substantial recent progress in characterizing the fundamental statistical limits of community…

A number of problems in statistical physics and computer science can be expressed as the computation of marginal probabilities over a Markov random field. Belief propagation, an iterative message-passing algorithm, computes exactly such…

Machine Learning · Statistics 2012-10-23 Victorin Martin , Jean-Marc Lasgouttes , Cyril Furtlehner

Belief Propagation (BP) is a powerful algorithm for distributed inference in probabilistic graphical models, however it quickly becomes infeasible for practical compute and memory budgets. Many efficient, non-parametric forms of BP have…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-30 Tom Yates , Yuzhou Cheng , Ignacio Alzugaray , Danyal Akarca , Pedro A. M. Mediano , Andrew J. Davison

We present a differentiable approach to learn the probabilistic factors used for inference by a nonparametric belief propagation algorithm. Existing nonparametric belief propagation methods rely on domain-specific features encoded in the…

Belief propagation is a fundamental message-passing algorithm for probabilistic reasoning and inference in graphical models. While it is known to be exact on trees, in most applications belief propagation is run on graphs with cycles.…

Machine Learning · Computer Science 2019-05-27 Frederic Koehler

This work proves a new result on the correct convergence of Min-Sum Loopy Belief Propagation (LBP) in an interpolation problem on a square grid graph. The focus is on the notion of local solutions, a numerical quantity attached to each site…

Other Computer Science · Computer Science 2017-02-22 Yutong Wang , Matthew G. Reyes , David L. Neuhoff

We consider the general problem of finding the minimum weight $\bm$-matching on arbitrary graphs. We prove that, whenever the linear programming (LP) relaxation of the problem has no fractional solutions, then the belief propagation (BP)…

Information Theory · Computer Science 2015-03-13 Mohsen Bayati , Christian Borgs , Jennifer Chayes , Riccardo Zecchina

In this paper we present a synthesis of the work performed on two inference algorithms: the Pearl's belief propagation (BP) algorithm applied to Bayesian networks without loops (i.e. polytree) and the Loopy belief propagation (LBP)…

Artificial Intelligence · Computer Science 2012-06-06 Amen Ajroud , Mohamed Nazih Omri , Habib Youssef , Salem Benferhat

We introduce here a multi-type bootstrap percolation model, which we call T-Bootstrap Percolation (T-BP), and apply it to study information propagation in social networks. In this model, a social network is represented by a graph G whose…

Physics and Society · Physics 2022-10-18 Rinni Bhansali , Laura P. Schaposnik

Conditional belief networks introduce stochastic binary variables in neural networks. Contrary to a classical neural network, a belief network can predict more than the expected value of the output $Y$ given the input $X$. It can predict a…

Machine Learning · Computer Science 2016-05-03 Yann N. Dauphin , David Grangier

This paper considers the problem of tracking a large-scale number of group targets. Usually, multi-target in most tracking scenarios are assumed to have independent motion and are well-separated. However, for group target tracking (GTT),…

Machine Learning · Computer Science 2022-08-26 Xuqi Zhang , Fanqin Meng , Haiqi Liu , Xiaojing Shen , Yunmin Zhu

This paper presents a novel communication-efficient parallel belief propagation (CE-PBP) algorithm for training latent Dirichlet allocation (LDA). Based on the synchronous belief propagation (BP) algorithm, we first develop a parallel…

Machine Learning · Computer Science 2012-06-12 Jian-feng Yan , Zhi-Qiang Liu , Yang Gao , Jia Zeng

The framework of statistical inference has been successfully used to detect the meso-scale structures in complex networks, such as community structure, core-periphery (CP) structure. The main principle is that the stochastic block model…

Physics and Society · Physics 2018-08-29 Chuang Ma , Bing-Bing Xiang , Han-Shuang Chen , Hai-Feng Zhang

In this article, we present a visual introduction to Gaussian Belief Propagation (GBP), an approximate probabilistic inference algorithm that operates by passing messages between the nodes of arbitrarily structured factor graphs. A special…

Artificial Intelligence · Computer Science 2021-07-07 Joseph Ortiz , Talfan Evans , Andrew J. Davison

In second-order uncertain Bayesian networks, the conditional probabilities are only known within distributions, i.e., probabilities over probabilities. The delta-method has been applied to extend exact first-order inference methods to…

Artificial Intelligence · Computer Science 2022-08-17 Conrad D. Hougen , Lance M. Kaplan , Magdalena Ivanovska , Federico Cerutti , Kumar Vijay Mishra , Alfred O. Hero

We study the stochastic block model with two communities where vertices contain side information in the form of a vertex label. These vertex labels may have arbitrary label distributions, depending on the community memberships. We analyze a…

Machine Learning · Statistics 2019-05-24 Clara Stegehuis , Laurent Massoulié

Tensor network contraction on arbitrary graphs is a fundamental computational challenge with applications ranging from quantum simulation to error correction. While belief propagation (BP) provides a powerful approximation algorithm for…

Quantum Physics · Physics 2025-10-28 Siddhant Midha , Yifan F. Zhang

The belief propagation (BP) algorithm is an efficient way to solve "inference" problems in graphical models, such as Bayesian networks and Markov random fields. The system-state probability distribution of CSMA wireless networks is a Markov…

Networking and Internet Architecture · Computer Science 2011-07-15 Cai Hong Kai , Soung Chang Liew