English
Related papers

Related papers: Belief propagation algorithm for computing correla…

200 papers

Loopy belief propagation (LBP), which is equivalent to the Bethe approximation in statistical mechanics, is a message-passing-type inference method that is widely used to analyze systems based on Markov random fields (MRFs). In this paper,…

Machine Learning · Statistics 2015-11-16 Muneki Yasuda , Shun Kataoka , Kazuyuki Tanaka

Belief propagation is a powerful tool in statistical physics, machine learning, and modern coding theory. As a decoding method, it is ubiquitous in classical error correction and has also been applied to stabilizer-based quantum error…

Quantum Physics · Physics 2017-07-31 Joseph M. Renes

We address the problem of uncertainty propagation in the discrete Fourier transform by modeling the fast Fourier transform as a factor graph. Building on this representation, we propose an efficient framework for approximate Bayesian…

Machine Learning · Computer Science 2025-06-09 Luca Schmid , Charlotte Muth , Laurent Schmalen

Belief Propagation algorithms are instruments used broadly to solve graphical model optimization and statistical inference problems. In the general case of a loopy Graphical Model, Belief Propagation is a heuristic which is quite successful…

Machine Learning · Statistics 2021-09-15 Andrii Riazanov , Yury Maximov , Michael Chertkov

Probabilistic graphical models are a powerful concept for modeling high-dimensional distributions. Besides modeling distributions, probabilistic graphical models also provide an elegant framework for performing statistical inference;…

Artificial Intelligence · Computer Science 2022-09-13 Christian Knoll

Belief Propagation (BP) is a message-passing algorithm for approximate inference over Probabilistic Graphical Models (PGMs), finding many applications such as computer vision, error-correcting codes, and protein-folding. While general, the…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-09-26 Mark Van der Merwe , Vinu Joseph , Ganesh Gopalakrishnan

A number of problems in statistical physics and computer science can be expressed as the computation of marginal probabilities over a Markov random field. Belief propagation, an iterative message-passing algorithm, computes exactly such…

Machine Learning · Statistics 2012-10-23 Victorin Martin , Jean-Marc Lasgouttes , Cyril Furtlehner

We propose an original particle-based implementation of the Loopy Belief Propagation (LPB) algorithm for pairwise Markov Random Fields (MRF) on a continuous state space. The algorithm constructs adaptively efficient proposal distributions…

Computation · Statistics 2015-06-22 Thibaut Lienart , Yee Whye Teh , Arnaud Doucet

Quantum algorithms can potentially overcome the boundary of computationally hard problems. One of the cornerstones in modern optics is the beam propagation algorithm, facilitating the calculation of how waves with a particular dispersion…

Quantum Physics · Physics 2024-05-08 Chanaprom Cholsuk , Siavash Davani , Lorcan O. Conlon , Tobias Vogl , Falk Eilenberger

Recently, researchers have demonstrated that loopy belief propagation - the use of Pearls polytree algorithm IN a Bayesian network WITH loops OF error- correcting codes.The most dramatic instance OF this IS the near Shannon - limit…

Artificial Intelligence · Computer Science 2013-01-30 Kevin Murphy , Yair Weiss , Michael I. Jordan

We introduce novel results for approximate inference on planar graphical models using the loop calculus framework. The loop calculus (Chertkov and Chernyak, 2006) allows to express the exact partition function of a graphical model as a…

Artificial Intelligence · Computer Science 2009-05-25 V. Gómez , H. J. Kappen , M. Chertkov

Tensor network contraction is a fundamental computational challenge underlying quantum many-body physics, statistical mechanics, and machine learning. Belief propagation (BP) provides an efficient approximate solution, but introduces…

The canonical problem of solving a system of linear equations arises in numerous contexts in information theory, communication theory, and related fields. In this contribution, we develop a solution based upon Gaussian belief propagation…

Information Theory · Computer Science 2008-10-08 Ori Shental , Danny Bickson , Paul H. Siegel , Jack K. Wolf , Danny Dolev

Decoding low-density parity-check codes is critical in many current technologies, such as fifth-generation (5G) wireless networks and satellite communications. The belief propagation algorithm allows for fast decoding due to the low density…

Quantum Physics · Physics 2024-12-12 Sheila M. Perez-Garcia , Ashley Montanaro

Belief propagation (BP) is a message-passing heuristic for statistical inference in graphical models such as Bayesian networks and Markov random fields. BP is used to compute marginal distributions or maximum likelihood assignments and has…

Data Structures and Algorithms · Computer Science 2012-11-15 Tobias Brunsch , Kamiel Cornelissen , Bodo Manthey , Heiko Röglin

The Bethe approximation, or loopy belief propagation algorithm is a successful method for approximating partition functions of probabilistic models associated with a graph. Chertkov and Chernyak derived an interesting formula called Loop…

Discrete Mathematics · Computer Science 2009-11-14 Yusuke Watanabe , Kenji Fukumizu

We define and study an inference algorithm based on "belief propagation" (BP) and the Bethe approximation. The idea is to encode into a graph an a priori information composed of correlations or marginal probabilities of variables, and to…

Physics and Society · Physics 2007-05-23 Cyril Furtlehner , Jean-Marc Lasgouttes , Arnaud De La Fortelle

Graphical models use the intuitive and well-studied methods of graph theory to implicitly represent dependencies between variables in large systems. They can model the global behaviour of a complex system by specifying only local factors.…

Artificial Intelligence · Computer Science 2015-08-21 Siamak Ravanbakhsh

A major benefit of graphical models is that most knowledge is captured in the model structure. Many models, however, produce inference problems with a lot of symmetries not reflected in the graphical structure and hence not exploitable by…

Artificial Intelligence · Computer Science 2012-05-14 Kristian Kersting , Babak Ahmadi , Sriraam Natarajan

We study the performance of different message passing algorithms in the two dimensional Edwards Anderson model. We show that the standard Belief Propagation (BP) algorithm converges only at high temperature to a paramagnetic solution. Then,…

Disordered Systems and Neural Networks · Physics 2011-12-26 E. Dominguez , A. Lage-Castellanos , R. Mulet , F. Ricci-Tersenghi , T. Rizzo