English
Related papers

Related papers: $\alpha$ Belief Propagation for Approximate Infere…

200 papers

Cognitive Radio has been proposed as a key technology to significantly improve spectrum usage in wireless networks by enabling unlicensed users to access unused resource. We present new algorithms that are needed for the implementation of…

Information Theory · Computer Science 2013-10-22 Hamed Mahmoudi , Georgios Rodolakis , Leonidas Georgiadis , David Saad

Undirected graphical models are a widely used class of probabilistic models in machine learning that capture prior knowledge or putative pairwise interactions between variables. Those interactions are encoded in a graph for pairwise…

Statistics Theory · Mathematics 2025-03-21 Grégoire Sergeant-Perthuis , Toby St Clere Smithe , Léo Boitel

Fast convergence speed is a desired property for training latent Dirichlet allocation (LDA), especially in online and parallel topic modeling for massive data sets. This paper presents a novel residual belief propagation (RBP) algorithm to…

Machine Learning · Computer Science 2013-06-14 Jia Zeng , Xiao-Qin Cao , Zhi-Qiang Liu

The canonical problem of solving a system of linear equations arises in numerous contexts in information theory, communication theory, and related fields. In this contribution, we develop a solution based upon Gaussian belief propagation…

Information Theory · Computer Science 2008-10-08 Ori Shental , Danny Bickson , Paul H. Siegel , Jack K. Wolf , Danny Dolev

This paper resolves a common complexity issue in the Bethe approximation of statistical physics and the Belief Propagation (BP) algorithm of artificial intelligence. The Bethe approximation and the BP algorithm are heuristic methods for…

Artificial Intelligence · Computer Science 2013-03-22 Jinwoo Shin

We consider a class of spreading processes on networks, which generalize commonly used epidemic models such as the SIR model or the SIS model with a bounded number of re-infections. We analyse the related problem of inference of the…

Disordered Systems and Neural Networks · Physics 2024-07-22 D. Ghio , A. L. M. Aragon , I. Biazzo , L. Zdeborova

We present a differentiable approach to learn the probabilistic factors used for inference by a nonparametric belief propagation algorithm. Existing nonparametric belief propagation methods rely on domain-specific features encoded in the…

We propose a nonparametric generalization of belief propagation, Kernel Belief Propagation (KBP), for pairwise Markov random fields. Messages are represented as functions in a reproducing kernel Hilbert space (RKHS), and message updates are…

Machine Learning · Computer Science 2011-05-30 Le Song , Arthur Gretton , Danny Bickson , Yucheng Low , Carlos Guestrin

The Bethe approximation, discovered in statistical physics, gives an efficient algorithm called belief propagation (BP) for approximating a partition function. BP empirically gives an accurate approximation for many problems, e.g.,…

Information Theory · Computer Science 2012-10-11 Ryuhei Mori , Toshiyuki Tanaka

Quantum error correction is crucial for universal fault-tolerant quantum computing. Highly accurate and low-time-complexity decoding algorithms play an indispensable role in ensuring quantum error correction works effectively. Among…

Quantum Physics · Physics 2025-07-01 Jiahan Chen , Zhengzhong Yi , Zhipeng Liang , Xuan Wang

In this paper we treat both forms of probabilistic inference, estimating marginal probabilities of the joint distribution and finding the most probable assignment, through a unified message-passing algorithm architecture. We generalize the…

Artificial Intelligence · Computer Science 2010-06-29 Tamir Hazan , Amnon Shashua

We describe expectation propagation for approximate inference in dynamic Bayesian networks as a natural extension of Pearl s exact belief propagation.Expectation propagation IS a greedy algorithm, converges IN many practical cases, but NOT…

Artificial Intelligence · Computer Science 2013-01-07 Tom Heskes , Onno Zoeter

We present a differentiable approach to learn the probabilistic factors used for inference by a nonparametric belief propagation algorithm. Existing nonparametric belief propagation methods rely on domain-specific features encoded in the…

Sensing and imaging with distributed radio infrastructures (e.g., distributed MIMO, wireless sensor networks, multistatic radar) rely on knowledge of the positions, orientations, and clock parameters of distributed apertures. We extend a…

Signal Processing · Electrical Eng. & Systems 2025-05-29 Benjamin J. B. Deutschmann , Peter Vouras

Gaussian belief propagation (GaBP) is an iterative algorithm for computing the mean of a multivariate Gaussian distribution, or equivalently, the minimum of a multivariate positive definite quadratic function. Sufficient conditions, such as…

Information Theory · Computer Science 2014-01-07 Nicholas Ruozzi , Sekhar Tatikonda

We introduce novel results for approximate inference on planar graphical models using the loop calculus framework. The loop calculus (Chertkov and Chernyak, 2006b) allows to express the exact partition function Z of a graphical model as a…

Artificial Intelligence · Computer Science 2014-08-12 Vicenc Gomez , Hilbert Kappen , Michael Chertkov

We consider the problem of maximum likelihood estimation in linear models represented by factor graphs and solved via the Gaussian belief propagation algorithm. Motivated by massive internet of things (IoT) networks and edge computing, we…

Information Theory · Computer Science 2023-05-31 Mirsad Cosovic , Dragisa Miskovic , Muhamed Delalic , Darijo Raca , Dejan Vukobratovic

Neural networks are popular state-of-the-art models for many different tasks.They are often trained via back-propagation to find a value of the weights that correctly predicts the observed data. Although back-propagation has shown good…

Machine Learning · Statistics 2020-12-29 Simón Rodríguez Santana , Daniel Hernández-Lobato

We study the behavior of the belief-propagation (BP) algorithm affected by erroneous data exchange in a wireless sensor network (WSN). The WSN conducts a distributed binary hypothesis test where the joint statistical behavior of the sensor…

Information Theory · Computer Science 2020-04-14 Younes Abdi , Tapani Ristaniemi

We study the Maximum Weight Matching (MWM) problem for general graphs through the max-product Belief Propagation (BP) and related Linear Programming (LP). The BP approach provides distributed heuristics for finding the Maximum A Posteriori…

Data Structures and Algorithms · Computer Science 2018-01-03 Sungsoo Ahn , Michael Chertkov , Andrew E. Gelfand , Sejun Park , Jinwoo Shin