English
Related papers

Related papers: Unifying Message Passing Algorithms Under the Fram…

200 papers

This PhD thesis lays out algebraic and topological structures relevant for the study of probabilistic graphical models. Marginal estimation algorithms are introduced as diffusion equations of the form $\dot u = \delta \varphi$. They…

Mathematical Physics · Physics 2020-09-25 Olivier Peltre

We study the behavior of the belief-propagation (BP) algorithm affected by erroneous data exchange in a wireless sensor network (WSN). The WSN conducts a distributed binary hypothesis test where the joint statistical behavior of the sensor…

Information Theory · Computer Science 2020-04-14 Younes Abdi , Tapani Ristaniemi

In this paper, we provide a distributed frequency offset estimation algorithm based on a variant of belief propagation (BP). Each agent in the network pre-compensates its carrier frequency individually so that there is no frequency offset…

Information Theory · Computer Science 2018-02-13 Jian Du , Shaodan Ma

This letter investigates the problem of energy efficient collaborative strategy for mobile embodied artificial intelligence network (MEAN) over wireless communication. In the considered model, the agents execute the tasks through…

Signal Processing · Electrical Eng. & Systems 2026-05-15 Chenliang Wu , Zhouxiang Zhao , Jiaxiang Wang , Ruopeng Xu , Chen Zhu , Zhaohui Yang , Zhaoyang Zhang

Round complexity is an extensively studied metric of distributed algorithms. In contrast, our knowledge of the \emph{message complexity} of distributed computing problems and its relationship (if any) with round complexity is still quite…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-01 Fabien Dufoulon , Shreyas Pai , Gopal Pandurangan , Sriram Pemmaraju , Peter Robinson

Collective communications, namely the patterns allgatherv, reduce_scatter, and allreduce in message-passing systems are optimised based on measurements at the installation time of the library. The algorithms used are set up in an…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-24 Andreas Jocksch , Noe Ohana , Emmanuel Lanti , Vasileios Karakasis , Laurent Villard

Iterative message passing detection based on expectation propagation(EP) has demonstrated near-optimum performance in many signal processing and communication scenarios. The method remains feasible even for channel impulse responses (CIRs),…

Information Theory · Computer Science 2025-09-23 Jannis Clausius , Luca Schmid , Laurent Schmalen , Stephan ten Brink

An improved inference method for densely connected systems is presented. The approach is based on passing condensed messages between variables, representing macroscopic averages of microscopic messages. We extend previous work that showed…

Information Theory · Computer Science 2009-11-11 Juan P. Neirotti , David Saad

Maximum a posteriori (MAP) inference is a fundamental computational paradigm for statistical inference. In the setting of graphical models, MAP inference entails solving a combinatorial optimization problem to find the most likely…

Machine Learning · Computer Science 2020-03-03 Jonathan N. Lee , Aldo Pacchiano , Michael I. Jordan

This work presents a novel semantic transmission framework in wireless networks, leveraging the joint processing technique. Our framework enables multiple cooperating base stations to efficiently transmit semantic information to multiple…

Information Theory · Computer Science 2024-01-03 Xumin Pu , Tiantian Lei , Wanli Wen , Qianbin Chen

We propose to learn a kernel-based message operator which takes as input all expectation propagation (EP) incoming messages to a factor node and produces an outgoing message. In ordinary EP, computing an outgoing message involves estimating…

Machine Learning · Statistics 2015-03-11 Wittawat Jitkrittum , Arthur Gretton , Nicolas Heess

A new field of research is rapidly expanding at the crossroad between statistical physics, information theory and combinatorial optimization. In particular, the use of cutting edge statistical physics concepts and methods allow one to solve…

Neurons and Cognition · Quantitative Biology 2008-03-28 Marc Mezard , Thierry Mora

Exact inference in the linear regression model with spike and slab priors is often intractable. Expectation propagation (EP) can be used for approximate inference. However, the regular sequential form of EP (R-EP) may fail to converge in…

Machine Learning · Statistics 2011-12-13 José Miguel Hernández-Lobato , Daniel Hernández-Lobato

Belief propagation (BP) is a powerful tool to solve distributed inference problems, though it is limited by short cycles in the corresponding factor graph. Such cycles may lead to incorrect solutions or oscillatory behavior. Only for…

Systems and Control · Computer Science 2018-02-08 Christopher Lindberg , Julien M. Hendrickx , Henk Wymeersch

Compressed sensing (CS) demonstrates that sparse signals can be recovered from underdetermined linear measurements. We focus on the joint sparse recovery problem where multiple signals share the same common sparse support sets, and they are…

Information Theory · Computer Science 2011-02-17 Jongmin Kim , Woohyuk Chang , Bangchul Jung , Dror Baron , Jong Chul Ye

The problem of sparse approximation and the closely related compressed sensing have received tremendous attention in the past decade. Primarily studied from the viewpoint of applied harmonic analysis and signal processing, there have been…

Information Theory · Computer Science 2018-10-23 Ali Çivril

Human migration exhibits complex spatiotemporal dependence driven by environmental and socioeconomic forces. Modeling such patterns at scale requires methods that accommodate many random effects while remaining feasible when raw data or…

Methodology · Statistics 2026-05-29 Lida Chalangar Jalili Dehkharghani , Li-Hsiang Lin

Error mitigation techniques, while instrumental in extending the capabilities of near-term quantum computers, often suffer from exponential resource scaling with noise levels. To address this limitation, we introduce a novel approach,…

Quantum Physics · Physics 2024-09-11 Gaurav Saxena , Thi Ha Kyaw

Message passing on factor graphs is a powerful framework for probabilistic inference, which finds important applications in various scientific domains. The most wide-spread message passing scheme is the sum-product algorithm (SPA) which…

Machine Learning · Computer Science 2023-06-06 Luca Schmid , Joshua Brenk , Laurent Schmalen

Learning interpretable and disentangled representations of data is a key topic in machine learning research. Variational Autoencoder (VAE) is a scalable method for learning directed latent variable models of complex data. It employs a clear…

Machine Learning · Computer Science 2020-06-04 Andriy Serdega , Dae-Shik Kim