English
Related papers

Related papers: Belief propagation for general graphical models wi…

200 papers

Compiling Bayesian networks (BNs) to junction trees and performing belief propagation over them is among the most prominent approaches to computing posteriors in BNs. However, belief propagation over junction tree is known to be…

Artificial Intelligence · Computer Science 2012-02-20 Lu Zheng , Ole Mengshoel , Jike Chong

Numerical computations and methods have become increasingly crucial in the study of spin foam models across various regimes. This paper adds to this field by introducing new algorithms based on tensor network methods for computing…

General Relativity and Quantum Cosmology · Physics 2024-07-01 Seth K. Asante , Sebastian Steinhaus

We investigate a correspondence between two formalisms for discrete probabilistic modeling: probabilistic graphical models (PGMs) and tensor networks (TNs), a powerful modeling framework for simulating complex quantum systems. The graphical…

Machine Learning · Statistics 2021-07-01 Jacob Miller , Geoffrey Roeder , Tai-Danae Bradley

We illustrate the utility of the recently developed loop calculus for improving the Belief Propagation (BP) algorithm. If the algorithm that minimizes the Bethe free energy fails we modify the free energy by accounting for a critical loop…

Information Theory · Computer Science 2007-07-13 Michael Chertkov , Vladimir Y. Chernyak

Probabilistic graphical models are a powerful concept for modeling high-dimensional distributions. Besides modeling distributions, probabilistic graphical models also provide an elegant framework for performing statistical inference;…

Artificial Intelligence · Computer Science 2022-09-13 Christian Knoll

Methods to extract information from the tracking of mobile objects/particles have broad interest in biological and physical sciences. Techniques based on simple criteria of proximity in time-consecutive snapshots are useful to identify the…

Data Analysis, Statistics and Probability · Physics 2015-03-13 M. Chertkov , L. Kroc , F. Krzakala , M. Vergassola , L. Zdeborová

We propose an approach to do learning in Gaussian factor graphs. We treat all relevant quantities (inputs, outputs, parameters, latents) as random variables in a graphical model, and view both training and prediction as inference problems…

Machine Learning · Computer Science 2024-07-18 Seth Nabarro , Mark van der Wilk , Andrew J Davison

Message passing algorithms have proved surprisingly successful in solving hard constraint satisfaction problems on sparse random graphs. In such applications, variables are fixed sequentially to satisfy the constraints. Message passing is…

Artificial Intelligence · Computer Science 2019-06-05 Andrea Montanari , Federico Ricci-Tersenghi , Guilhem Semerjian

This paper presents an enhanced belief propagation (BP) decoding algorithm and a reinforcement learning-based BP decoding algorithm for polar codes. The enhanced BP algorithm weighs each Processing Element (PE) input based on their signals…

Information Theory · Computer Science 2021-11-02 L. M. Oliveira , R. M. Oliveira , R. C. de Lamare

Generalized belief propagation (GBP) has proven to be a promising technique for approximate inference tasks in AI and machine learning. However, the choice of a good set of clusters to be used in GBP has remained more of an art then a…

Artificial Intelligence · Computer Science 2012-07-19 Max Welling

Electric power systems require accurate, scalable, distributed, and near real-time state estimation (SE) to support reliable monitoring and control under increasingly complex operating conditions. Limited monitoring capabilities can lead to…

Information Theory · Computer Science 2026-04-24 Mirsad Cosovic , Armin Teskeredzic , Antonello Monti , Dejan Vukobratovic

We introduce novel results for approximate inference on planar graphical models using the loop calculus framework. The loop calculus (Chertkov and Chernyak, 2006b) allows to express the exact partition function Z of a graphical model as a…

Artificial Intelligence · Computer Science 2014-08-12 Vicenc Gomez , Hilbert Kappen , Michael Chertkov

The efficient simulation of complex quantum systems remains a central challenge due to the exponential growth of Hilbert space with system size. Tensor network methods have long been established as powerful approximation schemes, and their…

Computational Physics · Physics 2026-03-16 Min Chen , Minzhao Liu , Changhun Oh , Liang Jiang , Yuri Alexeev , Junyu Liu

We introduce the lifted Generalized Belief Propagation (GBP) message passing algorithm, for the computation of sum-product queries in Probabilistic Relational Models (e.g. Markov logic network). The algorithm forms a compact region graph…

Artificial Intelligence · Computer Science 2016-10-06 Udi Apsel

We describe an empirical approach to identify low-weight combinations of columns of the decoding matrices of a quantum circuit-level noise model, for which belief-propagation (BP) algorithms converge possibly very slowly. Focusing on the…

Quantum Physics · Physics 2026-03-20 Haggai Landa

The encoder and decoder for lossy data compression of binary memoryless sources are developed on the basis of a specific-type nonmonotonic perceptron. Statistical mechanical analysis indicates that the potential ability of the…

Information Theory · Computer Science 2009-11-11 Tadaaki Hosaka , Yoshiyuki Kabashima

Understanding the effects of noise on quantum computations is fundamental to the development of quantum hardware and quantum algorithms. Simulation tools are essential for quantitatively modelling these effects, yet unless artificial…

Quantum Physics · Physics 2025-10-07 Anthony P. Thompson , Arie Soeteman , Chris Cade , Ido Niesen

We introduce a new method for decoding short and moderate length linear block codes with dense parity-check matrix representations of cyclic form, termed multiple-bases belief-propagation (MBBP). The proposed iterative scheme makes use of…

Information Theory · Computer Science 2016-11-15 Thorsten Hehn , Johannes B. Huber , Olgica Milenkovic , Stefan Laendner

We present a differentiable approach to learn the probabilistic factors used for inference by a nonparametric belief propagation algorithm. Existing nonparametric belief propagation methods rely on domain-specific features encoded in the…

An important part of problems in statistical physics and computer science can be expressed as the computation of marginal probabilities over a Markov Random Field. The belief propagation algorithm, which is an exact procedure to compute…

Machine Learning · Computer Science 2011-01-24 Victorin Martin , Jean-Marc Lasgouttes , Cyril Furtlehner