English
Related papers

Related papers: Truncating the loop series expansion for Belief Pr…

200 papers

It is often the case in Statistics that one needs to compute sums of infinite series, especially in marginalising over discrete latent variables. This has become more relevant with the popularization of gradient-based techniques (e.g.…

Methodology · Statistics 2025-03-11 Luiz Max Carvalho , Wellington J. Silva , Guido A. Moreira

Loopy belief propagation (LBP), which is equivalent to the Bethe approximation in statistical mechanics, is a message-passing-type inference method that is widely used to analyze systems based on Markov random fields (MRFs). In this paper,…

Machine Learning · Statistics 2015-11-16 Muneki Yasuda , Shun Kataoka , Kazuyuki Tanaka

For the minimum cardinality vertex cover and maximum cardinality matching problems, the max-product form of belief propagation (BP) is known to perform poorly on general graphs. In this paper, we present an iterative loopy annealing BP…

Discrete Mathematics · Computer Science 2014-07-09 Marc Lelarge

We describe a novel approach to statistical learning from particles tracked while moving in a random environment. The problem consists in inferring properties of the environment from recorded snapshots. We consider here the case of a fluid…

Information Theory · Computer Science 2008-06-09 Michael Chertkov , Lukas Kroc , Massimo Vergassola

Belief propagation (BP) can do exact inference in loop-free graphs, but its performance could be poor in graphs with loops, and the understanding of its solution is limited. This work gives an interpretable belief propagation rule that is…

Machine Learning · Computer Science 2019-08-26 Dong Liu , Nima N. Moghadam , Lars K. Rasmussen , Jinliang Huang , Saikat Chatterjee

Truncated sum rules have been used to calculate the fundamental limits of the nonlinear susceptibilities; and, the results have been consistent with all measured molecules. However, given that finite-state models result in inconsistencies…

Optics · Physics 2016-09-08 Mark G. Kuzyk

We consider the optimal quantization of compressive sensing measurements following the work on generalization of relaxed belief propagation (BP) for arbitrary measurement channels. Relaxed BP is an iterative reconstruction scheme inspired…

Information Theory · Computer Science 2016-11-15 Ulugbek Kamilov , Vivek K Goyal , Sundeep Rangan

Given a truncated perturbation expansion of a physical quantity, one can, under certain circumstances, obtain lower or upper bounds (or both) to the sum of the full perturbation series by using the Borel transform and a variational…

High Energy Physics - Theory · Physics 2007-05-23 Rajesh R. Parwani

For finite length polar codes, channel polarization leaves a significant number of channels not fully polarized. Adding a Cyclic Redundancy Check (CRC) to better protect information on the semi-polarized channels has already been…

Information Theory · Computer Science 2016-11-14 A. Elkelesh , M. Ebada , S. Cammerer , S. ten Brink

Time bounded reachability is a fundamental problem in model checking continuous-time Markov chains (CTMCs) and Markov decision processes (CTMDPs) for specifications in continuous stochastic logics. It can be computed by numerically solving…

Systems and Control · Electrical Eng. & Systems 2020-01-07 Mahmoud Salamati , Sadegh Soudjani , Rupak Majumdar

Belief Propagation (BP) is an efficient message-passing algorithm widely used for inference in graphical models and for solving various problems in statistical physics. However, BP often yields inaccurate estimates of order parameters and…

Social and Information Networks · Computer Science 2025-10-23 Seongmin Kim , Alec Kirkley

In this paper we present a synthesis of the work performed on two inference algorithms: the Pearl's belief propagation (BP) algorithm applied to Bayesian networks without loops (i.e. polytree) and the Loopy belief propagation (LBP)…

Artificial Intelligence · Computer Science 2012-06-06 Amen Ajroud , Mohamed Nazih Omri , Habib Youssef , Salem Benferhat

Loop Calculus introduced in [Chertkov, Chernyak '06] constitutes a new theoretical tool that explicitly expresses the symbol Maximum-A-Posteriori (MAP) solution of a general statistical inference problem via a solution of the Belief…

Information Theory · Computer Science 2008-09-09 Vladimir Y. Chernyak , Michael Chertkov

We begin with an exact expression for the entropy of a system of hard spheres within the Hamming space. This entropy relies on probability marginals, which are determined by an extended set of Belief Propagation (BP) equations. The BP…

Disordered Systems and Neural Networks · Physics 2024-09-06 Abolfazl Ramezanpour , Saman Moghimi-Araghi

This paper proposes a unified tree-reweighted belief propagation (BP) and mean field (MF) approach for scalable detection and tracking of extended targets within the framework of factor graph. The factor graph is partitioned into a BP…

Signal Processing · Electrical Eng. & Systems 2024-12-30 Weizhen Ma , Zhongliang Jing , Peng Dong , Henry Leung

Recent years have seen a growing interest in the use of belief propagation - an algorithm originally introduced for performing statistical inference on graphical models - for approximate, but highly efficient, tensor network contraction.…

Quantum Physics · Physics 2026-04-28 Joseph Tindall , Grace M. Sommers , Hilbert Kappen

In the analysis of Markov chains and processes, it is sometimes convenient to replace an unbounded state space with a "truncated" bounded state space. When such a replacement is made, one often wants to know whether the equilibrium behavior…

Probability · Mathematics 2022-03-30 Alex Infanger , Peter W. Glynn , Yuanyuan Liu

Belief propagation (BP) is a popular method for performing probabilistic inference on graphical models. In this work, we enhance BP and propose self-guided belief propagation (SBP) that incorporates the pairwise potentials only gradually.…

Machine Learning · Statistics 2024-10-30 Christian Knoll , Adrian Weller , Franz Pernkopf

A generalised analytical notion of summation-by-parts (SBP) methods is proposed, extending the concept of SBP operators in the correction procedure via reconstruction (CPR), a framework of high-order methods for conservation laws. For the…

Numerical Analysis · Mathematics 2017-04-26 Hendrik Ranocha , Philipp Öffner , Thomas Sonar

We examine stability of summation by parts (SBP) numerical schemes that use hyperboloidal slices to include future null infinity in the computational domain. This inclusion serves to mitigate outer boundary effects and, in the future, will…

General Relativity and Quantum Cosmology · Physics 2021-04-28 Shalabh Gautam , Alex Vañó-Viñuales , David Hilditch , Sukanta Bose