English
Related papers

Related papers: Iterative Belief Propagation for Sparse Combinator…

200 papers

This paper develops methods of distributed Bayesian hypothesis tests for fault detection and diagnosis that are based on belief propagation and optimization in graphical models. The main challenges in developing distributed statistical…

Systems and Control · Computer Science 2015-01-20 Kwang-Ki K. Kim

The paper investigates parameterized approximate message-passing schemes that are based on bounded inference and are inspired by Pearl's belief propagation algorithm (BP). We start with the bounded inference mini-clustering algorithm and…

Artificial Intelligence · Computer Science 2014-01-16 Robert Mateescu , Kalev Kask , Vibhav Gogate , Rina Dechter

The max-product {belief propagation} (BP) is a popular message-passing heuristic for approximating a maximum-a-posteriori (MAP) assignment in a joint distribution represented by a graphical model (GM). In the past years, it has been shown…

Artificial Intelligence · Computer Science 2017-06-29 Sejun Park , Jinwoo Shin

We first present an empirical study of the Belief Propagation (BP) algorithm, when run on the random field Ising model defined on random regular graphs in the zero temperature limit. We introduce the notion of maximal solutions for the BP…

Disordered Systems and Neural Networks · Physics 2018-02-01 Gabriele Perugini , Federico Ricci-Tersenghi

Recent result shows how to compute distributively and efficiently the linear MMSE for the multiuser detection problem, using the Gaussian BP algorithm. In the current work, we extend this construction, and show that operating this algorithm…

Information Theory · Computer Science 2009-04-16 Danny Bickson , Ori Shental , Danny Dolev

This paper considers the noisy group testing problem where among a large population of items some are defective. The goal is to identify all defective items by testing groups of items, with the minimum possible number of tests. The focus of…

Information Theory · Computer Science 2021-10-20 Esmaeil Karimi , Anoosheh Heidarzadeh , Krishna R. Narayanan , Alex Sprintson

We consider the problem of reconstructing sparse symmetric block models with two blocks and connection probabilities $a/n$ and $b/n$ for inter- and intra-block edge probabilities, respectively. It was recently shown that one can do better…

Probability · Mathematics 2016-09-28 Elchanan Mossel , Joe Neeman , Allan Sly

Tensor network contraction is a fundamental computational challenge underlying quantum many-body physics, statistical mechanics, and machine learning. Belief propagation (BP) provides an efficient approximate solution, but introduces…

In this paper, we propose a sparse recovery algorithm called detection-directed (DD) sparse estimation using Bayesian hypothesis test (BHT) and belief propagation (BP). In this framework, we consider the use of sparse-binary sensing…

Information Theory · Computer Science 2012-11-07 Jaewook Kang , Heung-No Lee , Kiseon Kim

The paper presents an iterative version of join-tree clustering that applies the message passing of join-tree clustering algorithm to join-graphs rather than to join-trees, iteratively. It is inspired by the success of Pearl's belief…

Artificial Intelligence · Computer Science 2013-01-07 Rina Dechter , Kalev Kask , Robert Mateescu

Gaussian belief propagation (BP) has been widely used for distributed inference in large-scale networks such as the smart grid, sensor networks, and social networks, where local measurements/observations are scattered over a wide…

Machine Learning · Computer Science 2017-11-21 Jian Du , Shaodan Ma , Yik-Chung Wu , Soummya Kar , José M. F. Moura

Inference in continuous label Markov random fields is a challenging task. We use particle belief propagation (PBP) for solving the inference problem in continuous label space. Sampling particles from the belief distribution is typically…

Computer Vision and Pattern Recognition · Computer Science 2018-02-12 Oliver Mueller , Michael Ying Yang , Bodo Rosenhahn

Data association, the problem of reasoning over correspondence between targets and measurements, is a fundamental problem in tracking. This paper presents a graphical model formulation of data association and applies an approximate…

Artificial Intelligence · Computer Science 2014-12-16 Jason L. Williams , Roslyn A. Lau

The decoding of Low-Density Parity-Check codes by the Belief Propagation (BP) algorithm is revisited. We check the iterative algorithm for its convergence to a codeword (termination), we run Monte Carlo simulations to find the probability…

Information Theory · Computer Science 2007-07-13 M. G. Stepanov , M. Chertkov

Gaussian belief propagation (BP) has been widely used for distributed estimation in large-scale networks such as the smart grid, communication networks, and social networks, where local measurements/observations are scattered over a wide…

Machine Learning · Computer Science 2017-04-14 Jian Du , Shaodan Ma , Yik-Chung Wu , Soummya Kar , José M. F. Moura

Compressed sensing (CS) demonstrates that sparse signals can be recovered from underdetermined linear measurements. We focus on the joint sparse recovery problem where multiple signals share the same common sparse support sets, and they are…

Information Theory · Computer Science 2011-02-17 Jongmin Kim , Woohyuk Chang , Bangchul Jung , Dror Baron , Jong Chul Ye

The sum-product or belief propagation (BP) algorithm is a widely-used message-passing algorithm for computing marginal distributions in graphical models with discrete variables. At the core of the BP message updates, when applied to a…

Information Theory · Computer Science 2012-05-28 Nima Noorshams , Martin J. Wainwright

Expectation Propagation (EP) is a widely used iterative message-passing algorithm that decomposes a global inference problem into multiple local ones. It approximates marginal distributions as ``beliefs'' using intermediate functions called…

Machine Learning · Statistics 2026-04-07 Zilu Zhao , Jichao Chen , Dirk Slock

The distributed coordination of robot teams performing complex tasks is challenging to formulate. The different aspects of a complete task such as local planning for obstacle avoidance, global goal coordination and collaborative mapping are…

Robotics · Computer Science 2023-10-04 Aalok Patwardhan , Andrew J. Davison

Message passing algorithms have proved surprisingly successful in solving hard constraint satisfaction problems on sparse random graphs. In such applications, variables are fixed sequentially to satisfy the constraints. Message passing is…

Artificial Intelligence · Computer Science 2019-06-05 Andrea Montanari , Federico Ricci-Tersenghi , Guilhem Semerjian