English
Related papers

Related papers: Unifying Message Passing Algorithms Under the Fram…

200 papers

Iterative information processing, either based on heuristics or analytical frameworks, has been shown to be a very powerful tool for the design of efficient, yet feasible, wireless receiver architectures. Within this context, algorithms…

Mixed-effects regression models represent a useful subclass of regression models for grouped data; the introduction of random effects allows for the correlation between observations within each group to be conveniently captured when…

Methodology · Statistics 2024-09-25 Jackson Zhou , John T. Ormerod , Clara Grazian

We present a message-passing algorithm to solve the edge disjoint path problem (EDP) on graphs incorporating under a unique framework both traffic optimization and path length minimization. The min-sum equations for this problem present an…

Disordered Systems and Neural Networks · Physics 2016-01-21 Fabrizio Altarelli , Alfredo Braunstein , Luca Dall'Asta , Caterina De Bacco , Silvio Franz

Belief Propagation (BP) is a popular, distributed heuristic for performing MAP computations in Graphical Models. BP can be interpreted, from a variational perspective, as minimizing the Bethe Free Energy (BFE). BP can also be used to solve…

Artificial Intelligence · Computer Science 2013-05-20 Andrew Gelfand , Jinwoo Shin , Michael Chertkov

This paper investigates sparse signal recovery based on expectation propagation (EP) from unitarily invariant measurements. A rigorous analysis is presented for the state evolution (SE) of an EP-based message-passing algorithm in the large…

Information Theory · Computer Science 2017-04-06 Keigo Takeuchi

The design of message passing (MP) algorithms on factor graphs is an effective manner to implement channel estimation (CE) in wireless communication systems, which performance can be further improved by exploiting prior probability models…

Information Theory · Computer Science 2023-03-21 Yi Song , Chuanzong Zhang , Xinhua Lu , Fabio Saggese , Zhongyong Wang

While loopy belief propagation (LBP) performs reasonably well for inference in some Gaussian graphical models with cycles, its performance is unsatisfactory for many others. In particular for some models LBP does not converge, and in…

Machine Learning · Statistics 2015-05-28 Ying Liu , Venkat Chandrasekaran , Animashree Anandkumar , Alan S. Willsky

Message-passing algorithms have emerged as powerful techniques for approximate inference in graphical models. When these algorithms converge, they can be shown to find local (or sometimes even global) optima of variational formulations to…

Artificial Intelligence · Computer Science 2012-05-14 Talya Meltzer , Amir Globerson , Yair Weiss

This paper considers a discrete-valued signal estimation scheme based on a low-complexity Bayesian optimal message passing algorithm (MPA) for solving massive linear inverse problems under highly correlated measurements. Gaussian belief…

Signal Processing · Electrical Eng. & Systems 2024-11-14 Tomoharu Furudoi , Takumi Takahashi , Shinsuke Ibi , Hideki Ochiai

The sum-product or belief propagation (BP) algorithm is a widely-used message-passing algorithm for computing marginal distributions in graphical models with discrete variables. At the core of the BP message updates, when applied to a…

Information Theory · Computer Science 2012-05-28 Nima Noorshams , Martin J. Wainwright

Message passing algorithms have proved surprisingly successful in solving hard constraint satisfaction problems on sparse random graphs. In such applications, variables are fixed sequentially to satisfy the constraints. Message passing is…

Artificial Intelligence · Computer Science 2019-06-05 Andrea Montanari , Federico Ricci-Tersenghi , Guilhem Semerjian

We consider distributed statistical optimization in one-shot setting, where there are $m$ machines each observing $n$ i.i.d. samples. Based on its observed samples, each machine sends a $B$-bit-long message to a server. The server then…

Machine Learning · Computer Science 2020-01-01 Saber Salehkaleybar , Arsalan Sharifnassab , S. Jamaloddin Golestani

Large-scale multiple-input-multiple-output (MIMO) systems typically operate in dense array deployments with limited scattering environments, leading to highly correlated and ill-conditioned channel matrices that severely degrade the…

Signal Processing · Electrical Eng. & Systems 2025-09-30 Kabuto Arai , Takumi Yoshida , Takumi Takahashi , Koji Ishibashi

We investigate the problem of approximate Bayesian inference for a general class of observation models by means of the expectation propagation (EP) framework for large systems under some statistical assumptions. Our approach tries to…

Information Theory · Computer Science 2016-08-24 Burak Çakmak , Manfred Opper , Bernard H. Fleury , Ole Winther

We present a new implementation of the Cluster Variational Method (CVM) as a message passing algorithm. The kind of message passing algorithms used for CVM, usually named Generalized Belief Propagation, are a generalization of the Belief…

Disordered Systems and Neural Networks · Physics 2017-04-27 Eduardo Dominguez , Alejandro Lage-Castellanos , Roberto Mulet , Federico Ricci-Tersenghi

We propose a message-passing algorithm to compute the Hamiltonian expectation with respect to an appropriate class of trial wave functions for an interacting system of fermions. To this end, we connect the quantum expectations to average…

Statistical Mechanics · Physics 2015-06-11 A. Ramezanpour , R. Zecchina

A scheme to provide various mean-field-type approximation algorithms is presented by employing the Bethe free energy formalism to a family of replicated systems in conjunction with analytical continuation with respect to the number of…

Disordered Systems and Neural Networks · Physics 2009-11-11 Yoshiyuki Kabashima

We first present an empirical study of the Belief Propagation (BP) algorithm, when run on the random field Ising model defined on random regular graphs in the zero temperature limit. We introduce the notion of maximal solutions for the BP…

Disordered Systems and Neural Networks · Physics 2018-02-01 Gabriele Perugini , Federico Ricci-Tersenghi

Inference for probabilistic graphical models is still very much a practical challenge in large domains. The commonly used and effective belief propagation (BP) algorithm and its generalizations often do not converge when applied to hard,…

Artificial Intelligence · Computer Science 2012-07-02 Gal Elidan , Ian McGraw , Daphne Koller

Message passing algorithms, whose iterative nature captures well complicated interactions among interconnected variables in complex systems and extracts information from the fixed point of iterated messages, provide a powerful toolkit in…

Disordered Systems and Neural Networks · Physics 2022-02-28 Chun-Yan Zhao , Yan-Rong Fu , Jin-Hua Zhao