English
Related papers

Related papers: Local Message Passing on Frustrated Systems

200 papers

Cross-device training is a crucial subfield of federated learning, where the number of clients can reach into the billions. Standard approaches and local methods are prone to issues such as client drift and insensitivity to data…

Optimization and Control · Mathematics 2024-05-31 Avetik Karagulyan , Egor Shulgin , Abdurakhmon Sadiev , Peter Richtárik

This paper presents a neural-enhanced probabilistic model and corresponding factor graph-based sum-product algorithm for robust localization and tracking in multipath-prone environments. The introduced hybrid probabilistic model consists of…

Signal Processing · Electrical Eng. & Systems 2023-11-30 Alexander Venus , Erik Leitinger , Stefan Tertinek , Klaus Witrisal

Due to the massive number of devices in the M2M communication era, new challenges have been brought to the existing random-access (RA) mechanism, such as severe preamble collisions and resource block (RB) wastes. To address these problems,…

Information Theory · Computer Science 2019-10-09 Zhaoji Zhang , Ying Li , Lei Liu , Huimei Han

We introduce a new type of graphical model that we call a "memory factor network" (MFN). We show how to use MFNs to model the structure inherent in many types of data sets. We also introduce an associated message-passing style algorithm…

Artificial Intelligence · Computer Science 2016-01-19 Patrick Eschenfeldt , Dan Schmidt , Stark Draper , Jonathan Yedidia

Generative models provide a powerful framework for probabilistic reasoning. However, in many domains their use has been hampered by the practical difficulties of inference. This is particularly the case in computer vision, where models of…

Computer Vision and Pattern Recognition · Computer Science 2015-01-28 Varun Jampani , S. M. Ali Eslami , Daniel Tarlow , Pushmeet Kohli , John Winn

Most graph neural network models rely on a particular message passing paradigm, where the idea is to iteratively propagate node representations of a graph to each node in the direct neighborhood. While very prominent, this paradigm leads to…

Machine Learning · Computer Science 2023-01-24 Ralph Abboud , Radoslav Dimitrov , İsmail İlkan Ceylan

Distributed graph signal processing algorithms require the network nodes to communicate by exchanging messages in order to achieve a common objective. These messages have a finite precision in realistic networks, which may necessitate to…

Signal Processing · Electrical Eng. & Systems 2019-09-30 Isabela Cunha Maia Nobre , Pascal Frossard

Despite recent advances in achieving fair representations and predictions through regularization, adversarial debiasing, and contrastive learning in graph neural networks (GNNs), the working mechanism (i.e., message passing) behind GNNs…

Machine Learning · Computer Science 2022-02-10 Zhimeng Jiang , Xiaotian Han , Chao Fan , Zirui Liu , Na Zou , Ali Mostafavi , Xia Hu

Social networks represent nowadays in many contexts the main source of information transmission and the way opinions and actions are influenced. For instance, generic advertisements are way less powerful than suggestions from our contacts.…

Neural and Evolutionary Computing · Computer Science 2021-05-03 Kateryna Konotopska , Giovanni Iacca

The sum-product or belief propagation (BP) algorithm is a widely used message-passing technique for computing approximate marginals in graphical models. We introduce a new technique, called stochastic orthogonal series message-passing…

Information Theory · Computer Science 2012-12-18 Nima Noorshams , Martin J. Wainwright

We present a message passing approach to Expected Free Energy (EFE) minimization on factor graphs, based on the theory introduced in arXiv:2504.14898. By reformulating EFE minimization as Variational Free Energy minimization with epistemic…

Artificial Intelligence · Computer Science 2026-03-03 Wouter W. L. Nuijten , Mykola Lukashchuk , Thijs van de Laar , Bert de Vries

In this work, a new low complexity iterative algorithm for decoding data transmitted over strong phase noise channels is presented. The algorithm is based on the Sum & Product Algorithm (SPA) with phase noise messages modeled as Tikhonov…

Information Theory · Computer Science 2013-06-25 Shachar Shayovitz , Dan Rapaheli

We introduce a novel framework for graph signal processing (GSP) that models signals as graph distribution-valued signals (GDSs), which are probability distributions in the Wasserstein space. This approach overcomes key limitations of…

Machine Learning · Statistics 2026-03-25 Yanan Zhao , Feng Ji , Xingchao Jian , Wee Peng Tay

Compressed sensing aims to undersample certain high-dimensional signals, yet accurately reconstruct them by exploiting signal characteristics. Accurate reconstruction is possible when the object to be recovered is sufficiently sparse in a…

Information Theory · Computer Science 2015-05-13 David L. Donoho , Arian Maleki , Andrea Montanari

We consider belief propagation (BP) as an efficient and scalable tool for state estimation and optimization problems in supply networks such as power grids. BP algorithms make use of factor graph representations, whose assignment to the…

Artificial Intelligence · Computer Science 2022-06-09 Tim Ritmeester , Hildegard Meyer-Ortmanns

Undirected graphical models are a widely used class of probabilistic models in machine learning that capture prior knowledge or putative pairwise interactions between variables. Those interactions are encoded in a graph for pairwise…

Statistics Theory · Mathematics 2025-03-21 Grégoire Sergeant-Perthuis , Toby St Clere Smithe , Léo Boitel

For the problem of binary linear classification and feature selection, we propose algorithmic approaches to classifier design based on the generalized approximate message passing (GAMP) algorithm, recently proposed in the context of…

Information Theory · Computer Science 2015-06-18 Justin Ziniel , Philip Schniter , Per Sederberg

We initiate the study of deterministic distributed graph algorithms with predictions in synchronous message passing systems. The process at each node in the graph is given a prediction, which is some extra information about the problem…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-01 Joan Boyar , Faith Ellen , Kim S. Larsen

A localized method to distribute paths on random graphs is devised, aimed at finding the shortest paths between given source/destination pairs while avoiding path overlaps at nodes. We propose a method based on message-passing techniques to…

Disordered Systems and Neural Networks · Physics 2014-10-17 Caterina De Bacco , Silvio Franz , David Saad , Chi Ho Yeung

Distributed computing is a standard way to scale up machine learning and data science algorithms to process large amounts of data. In such settings, avoiding communication amongst machines is paramount for achieving high performance. Rather…

Machine Learning · Statistics 2021-05-04 Vasileios Charisopoulos , Austin R. Benson , Anil Damle