English
Related papers

Related papers: Complete convergence of message passing algorithms…

200 papers

Diffusion adaptation is a powerful strategy for distributed estimation and learning over networks. Motivated by the concept of combining adaptive filters, this work proposes a combination framework that aggregates the operation of multiple…

Signal Processing · Electrical Eng. & Systems 2020-02-11 Danqi Jin , Jie Chen , Cedric Richard , Jingdong Chen , Ali H. Sayed

Part I of this work [2] developed the exact diffusion algorithm to remove the bias that is characteristic of distributed solutions for deterministic optimization problems. The algorithm was shown to be applicable to a larger set of…

Optimization and Control · Mathematics 2017-12-27 Kun Yuan , Bicheng Ying , Xiaochuan Zhao , Ali H. Sayed

A novel long-lived distributed problem, called Team Formation (TF), is introduced together with a message- and time-efficient randomized algorithm. The problem is defined over the asynchronous model with a complete communication graph,…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-19 Yuval Emek , Shay Kutten , Ido Rafael , Gadi Taubenfeld

This paper studies the convergence conditions and properties of the distributed adaptive signal fusion (DASF) algorithm, the framework itself having been introduced in a `Part I' companion paper. The DASF algorithm can be used to solve…

Signal Processing · Electrical Eng. & Systems 2023-05-12 Cem Ates Musluoglu , Charles Hovine , Alexander Bertrand

Parallel applications with irregular and time-varying workloads often suffer from load imbalance. Dynamic load balancing techniques address this challenge by redistributing work during execution. We present a new type of distributed…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-25 Maya Taylor , Kavitha Chandrasekar , Laxmikant V. Kale

We propose a hybrid message passing method for distributed cooperative localization and tracking of mobile agents. Belief propagation and mean field message passing are employed for, respectively, the motion-related and measurement-related…

Systems and Control · Computer Science 2016-05-25 Burak Çakmak , Daniel N. Urup , Florian Meyer , Troels Pedersen , Bernard H. Fleury , Franz Hlawatsch

In this paper we address the complexity of solving linear programming problems with a set of differential equations that converge to a fixed point that represents the optimal solution. Assuming a probabilistic model, where the inputs are…

Computational Complexity · Computer Science 2007-05-23 Asa Ben-Hur , Joshua Feinberg , Shmuel Fishman , Hava T. Siegelmann

Constraint propagation algorithms form an important part of most of the constraint programming systems. We provide here a simple, yet very general framework that allows us to explain several constraint propagation algorithms in a systematic…

Performance · Computer Science 2007-05-23 Krzysztof R. Apt

We describe an algorithm to solve the problem of Boolean CNF-Satisfiability when the input formula is chosen randomly. We build upon the algorithms of Sch{\"{o}}ning 1999 and Dantsin et al.~in 2002. The Sch{\"{o}}ning algorithm works by…

Computational Complexity · Computer Science 2019-03-27 Andrea Lincoln , Adam Yedidia

We propose consensus propagation, an asynchronous distributed protocol for averaging numbers across a network. We establish convergence, characterize the convergence rate for regular graphs, and demonstrate that the protocol exhibits better…

Information Theory · Computer Science 2007-07-13 Ciamac C. Moallemi , Benjamin Van Roy

Distributed allocation finds applications in many scenarios including CPU scheduling, distributed energy resource management, and networked coverage control. In this paper, we propose a fast convergent optimization algorithm with a tunable…

Signal Processing · Electrical Eng. & Systems 2024-01-30 Mohammadreza Doostmohammadian , Alireza Aghasi

Message-passing Graph Neural Networks (GNNs), which collect information from adjacent nodes achieve dismal performance on heterophilic graphs. Various schemes have been proposed to solve this problem, and propagating signed information on…

Machine Learning · Computer Science 2024-10-01 Yoonhyuk Choi , Jiho Choi , Taewook Ko , Chong-Kwon Kim

We propose an efficient nonparametric strategy for learning a message operator in expectation propagation (EP), which takes as input the set of incoming messages to a factor node, and produces an outgoing message as output. This learned…

We show that throughout the satisfiable phase the normalised number of satisfying assignments of a random $2$-SAT formula converges in probability to an expression predicted by the cavity method from statistical physics. The proof is based…

Inference for probabilistic graphical models is still very much a practical challenge in large domains. The commonly used and effective belief propagation (BP) algorithm and its generalizations often do not converge when applied to hard,…

Artificial Intelligence · Computer Science 2012-07-02 Gal Elidan , Ian McGraw , Daphne Koller

We study the convergence of message passing graph neural networks on random graph models to their continuous counterpart as the number of nodes tends to infinity. Until now, this convergence was only known for architectures with aggregation…

Machine Learning · Statistics 2025-02-13 Matthieu Cordonnier , Nicolas Keriven , Nicolas Tremblay , Samuel Vaiter

We present new message passing algorithms for performing inference with graphical models. Our methods are designed for the most difficult inference problems where loopy belief propagation and other heuristics fail to converge. Belief…

Artificial Intelligence · Computer Science 2022-07-19 Anna Grim , Pedro Felzenszwalb

Many procedures for SAT and SAT-related problems -- in particular for those requiring the complete enumeration of satisfying truth assignments -- rely their efficiency on the detection of partial assignments satisfying an input formula. In…

Logic in Computer Science · Computer Science 2020-03-10 Roberto Sebastiani

In this paper we consider a network of processors aiming at cooperatively solving linear programming problems subject to uncertainty. Each node only knows a common cost function and its local uncertain constraint set. We propose a…

Optimization and Control · Mathematics 2019-08-27 Mohammadreza Chamanbaz , Giuseppe Notarstefano , Roland Bouffanais

This paper considers inference over distributed linear Gaussian models using factor graphs and Gaussian belief propagation (BP). The distributed inference algorithm involves only local computation of the information matrix and of the mean…

Machine Learning · Statistics 2018-01-01 Jian Du , Shaodan Ma , Yik-Chung Wu , Soummya Kar , José M. F. Moura