English
Related papers

Related papers: Resilient Distributed Diffusion for Multi-task Est…

200 papers

Diffusion adaptation is a powerful strategy for distributed estimation and learning over networks. Motivated by the concept of combining adaptive filters, this work proposes a combination framework that aggregates the operation of multiple…

Signal Processing · Electrical Eng. & Systems 2020-02-11 Danqi Jin , Jie Chen , Cedric Richard , Jingdong Chen , Ali H. Sayed

In this work we analyze the mean-square performance of different strategies for distributed estimation over least-mean-squares (LMS) adaptive networks. The results highlight some useful properties for distributed adaptation in comparison to…

Information Theory · Computer Science 2015-06-05 Xiaochuan Zhao , Ali H. Sayed

Part I of this paper formulated a multitask optimization problem where agents in the network have individual objectives to meet, or individual parameter vectors to estimate, subject to a smoothness condition over the graph. A diffusion…

Multiagent Systems · Computer Science 2019-11-18 Roula Nassif , Stefan Vlaski , Cedric Richard , Ali H. Sayed

Diffusion learning is a framework that endows edge devices with advanced intelligence. By processing and analyzing data locally and allowing each agent to communicate with its immediate neighbors, diffusion effectively protects the privacy…

Machine Learning · Computer Science 2025-05-19 Elsa Rizk , Kun Yuan , Ali H. Sayed

Distributed control increases system scalability, flexibility, and redundancy. Foundational to such decentralisation is consensus formation, by which decision-making and coordination are achieved. However, decentralised multi-agent systems…

Multiagent Systems · Computer Science 2024-03-11 Agathe Bouis , Christopher Lowe , Ruaridh A. Clark , Malcolm Macdonald

The recommendation methods based on network diffusion have been shown to perform well in both recommendation accuracy and diversity. Nowdays, numerous extensions have been made to further improve the performance of such methods. However, to…

Physics and Society · Physics 2019-08-13 Peng Zhang , Leyang Xue , An Zeng

Parallel applications with irregular and time-varying workloads often suffer from load imbalance. Dynamic load balancing techniques address this challenge by redistributing work during execution. We present a new type of distributed…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-25 Maya Taylor , Kavitha Chandrasekar , Laxmikant V. Kale

Data-dependent metrics are powerful tools for learning the underlying structure of high-dimensional data. This article develops and analyzes a data-dependent metric known as diffusion state distance (DSD), which compares points using a…

Machine Learning · Statistics 2020-03-10 Lenore Cowen , Kapil Devkota , Xiaozhe Hu , James M. Murphy , Kaiyi Wu

Adaptive networks rely on in-network and collaborative processing among distributed agents to deliver enhanced performance in estimation and inference tasks. Information is exchanged among the nodes, usually over noisy links. The…

Optimization and Control · Mathematics 2015-06-03 Xiaochuan Zhao , Sheng-Yuan Tu , Ali H. Sayed

We consider distributed multitask learning problems over a network of agents where each agent is interested in estimating its own parameter vector, also called task, and where the tasks at neighboring agents are related according to a set…

Multiagent Systems · Computer Science 2017-10-11 Roula Nassif , Cédric Richard , André Ferrari , Ali H. Sayed

In this paper, we deal with distributed estimation problems in diffusion networks with heterogeneous nodes, i.e., nodes that either implement different adaptive rules or differ in some other aspect such as the filter structure or length, or…

Systems and Control · Computer Science 2017-09-05 Jesus Fernandez-Bes , Jerónimo Arenas-García , Magno T. M. Silva , Luis A. Azpicueta-Ruiz

Distributed learning is the problem of inferring a function in the case where training data is distributed among multiple geographically separated sources. Particularly, the focus is on designing learning strategies with low computational…

Machine Learning · Statistics 2016-07-22 Simone Scardapane

This paper studies resilient multi-agent distributed estimation of an unknown vector parameter when a subset of the agents is adversarial. We present and analyze a Flag Raising Distributed Estimator ($\mathcal{FRDE}$) that allows the agents…

Optimization and Control · Mathematics 2018-05-09 Yuan Chen , Soummya Kar , José M. F. Moura

In this work, we revisit a classical distributed gradient-descent algorithm, introducing an interesting class of perturbed multi-agent systems. The state of each subsystem represents a local estimate of a solution to the global optimization…

Optimization and Control · Mathematics 2025-09-04 Tarek Bazizi , Mohamed Maghenem , Paolo Frasca , Antonio Lorìa , Elena Panteley

Diffusion models have demonstrated highly-expressive generative capabilities in vision and NLP. Recent studies in reinforcement learning (RL) have shown that diffusion models are also powerful in modeling complex policies or trajectories in…

Machine Learning · Computer Science 2023-10-11 Haoran He , Chenjia Bai , Kang Xu , Zhuoran Yang , Weinan Zhang , Dong Wang , Bin Zhao , Xuelong Li

Representation learning is a widely adopted framework for learning in data-scarce environments to obtain a feature extractor or representation from various different yet related tasks. Despite extensive research on representation learning,…

Machine Learning · Computer Science 2025-12-30 Donghwa Kang , Shana Moothedath

Neural diffusion processes provide a scalable, non-Gaussian approach to modelling distributions over functions, but existing formulations are limited to single-task inference and do not capture dependencies across related tasks. In many…

Machine Learning · Computer Science 2026-01-19 Joseph Rawson , Domniki Ladopoulou , Petros Dellaportas

The paper considers a problem of detecting and mitigating biasing attacks on networks of state observers targeting cooperative state estimation algorithms. The problem is cast within the recently developed framework of distributed…

Systems and Control · Computer Science 2018-10-11 Mohammad Deghat , Valery Ugrinovskii , Iman Shames , Cedric Langbort

We study robust mean estimation in an online and distributed scenario in the presence of adversarial data attacks. At each time step, each agent in a network receives a potentially corrupted data point, where the data points were originally…

Cryptography and Security · Computer Science 2022-09-21 Tong Yao , Shreyas Sundaram

This work examines the close interplay between cooperation and adaptation for distributed detection schemes over fully decentralized networks. The combined attributes of cooperation and adaptation are necessary to enable networks of…

Information Theory · Computer Science 2016-11-15 Vincenzo Matta , Paolo Braca , Stefano Marano , Ali H. Sayed