English
Related papers

Related papers: Diffusion LMS for clustered multitask networks

200 papers

We propose a multi-hop diffusion strategy for a sensor network to perform distributed least mean-squares (LMS) estimation under local and network-wide energy constraints. At each iteration of the strategy, each node can combine intermediate…

Optimization and Control · Mathematics 2023-07-19 Wuhua Hu , Wee Peng Tay

This paper considers the problem of detecting impaired and noisy nodes over network. In a distributed algorithm, lots of processing units are incorporating and communicating with each other to reach a global goal. Due to each one's state in…

Multiagent Systems · Computer Science 2019-10-23 Mahdi Shamsi , Alireza Moslemi Haghighi , Farokh Marvasti

Distributed processing over networks relies on in-network processing and cooperation among neighboring agents. Cooperation is beneficial when agents share a common objective. However, in many applications agents may belong to different…

Optimization and Control · Mathematics 2023-07-19 Xiaochuan Zhao , Ali H. Sayed

In this paper, a novel diffusion estimation algorithm is proposed from a probabilistic perspective by combining diffusion strategy and the probabilistic least-mean-squares (PLMS) at all agents. The proposed method diffusion probabilistic…

Signal Processing · Electrical Eng. & Systems 2019-08-27 Sihai Guan , Chun Meng , Bharat Biswal

In this paper, we present distributed generalized clustering algorithms that can handle large scale data across multiple machines in spite of straggling or unreliable machines. We propose a novel data assignment scheme that enables us to…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-03-17 Venkata Gandikota , Arya Mazumdar , Ankit Singh Rawat

This paper addresses the problem of distributed learning under communication constraints, motivated by distributed signal processing in wireless sensor networks and data mining with distributed databases. After formalizing a general model…

Machine Learning · Computer Science 2016-11-15 Joel B. Predd , Sanjeev R. Kulkarni , H. Vincent Poor

We consider a distributed multi-task learning scheme that accounts for multiple linear model estimation tasks with heterogeneous and/or correlated data streams. We assume that nodes can be partitioned into groups corresponding to different…

Multiagent Systems · Computer Science 2024-10-07 Lingzhou Hong , Alfredo Garcia

Partial diffusion scheme is an effective method for reducing computational load and power consumption in adaptive network implementation. The Information is exchanged among the nodes, usually over noisy links. In this paper, we consider a…

Systems and Control · Computer Science 2015-12-01 Vahid Vadidpour , Amir Rastegarnia , Azam Khalili , Saeid Sanei

The diffusion based distributed learning approaches have been found to be a viable solution for learning over linearly separable datasets over a network. However, approaches till date are suitable for linearly separable datasets and need to…

Systems and Control · Computer Science 2015-09-15 Rangeet Mitra , Vimal Bhatia

We consider the problem of distributed dictionary learning, where a set of nodes is required to collectively learn a common dictionary from noisy measurements. This approach may be useful in several contexts including sensor networks.…

Machine Learning · Statistics 2013-04-15 Pierre Chainais , Cédric Richard

In this paper, a family of novel diffusion adaptive estimation algorithm is proposed from the asymmetric cost function perspective by combining diffusion strategy and the linear-linear cost (LLC), quadratic-quadratic cost (QQC), and…

Machine Learning · Computer Science 2021-07-08 Sihai Guan , Qing Cheng , Yong Zhao

Part I of this work [2] developed the exact diffusion algorithm to remove the bias that is characteristic of distributed solutions for deterministic optimization problems. The algorithm was shown to be applicable to a larger set of…

Optimization and Control · Mathematics 2017-12-27 Kun Yuan , Bicheng Ying , Xiaochuan Zhao , Ali H. Sayed

Part I of this paper formulated a multitask optimization problem where agents in the network have individual objectives to meet, or individual parameter vectors to estimate, subject to a smoothness condition over the graph. A diffusion…

Multiagent Systems · Computer Science 2019-11-18 Roula Nassif , Stefan Vlaski , Cedric Richard , Ali H. Sayed

This paper investigates the problem of distributed stochastic approximation in multi-agent systems. The algorithm under study consists of two steps: a local stochastic approximation step and a diffusion step which drives the network to a…

Multiagent Systems · Computer Science 2014-10-28 Gemma Morral , Pascal Bianchi , Gersende Fort

Multilayer networks provide a more comprehensive framework for exploring real-world and engineering systems than traditional single-layer networks, consisting of multiple interacting networks. However, despite significant research in…

Optimization and Control · Mathematics 2024-11-12 C. D. Rodríguez-Camargo , A. F. Urquijo-Rodríguez , E. A. Mojica-Nava

Distributed estimation and processing in networks modeled by graphs have received a great deal of interest recently, due to the benefits of decentralised processing in terms of performance and robustness to communications link failure…

Multiagent Systems · Computer Science 2016-11-29 C. T. Healy , R. C. de Lamare

In recent years, the multitask diffusion least mean square (MD-LMS) algorithm has been extensively applied in the distributed parameter estimation and target tracking of multitask network. However, its performance is mainly limited by two…

Signal Processing · Electrical Eng. & Systems 2022-10-21 Wenjing Xu , Haiquan Zhao , Shaohui Lv

Diffusion adaptation is a powerful strategy for distributed estimation and learning over networks. Motivated by the concept of combining adaptive filters, this work proposes a combination framework that aggregates the operation of multiple…

Signal Processing · Electrical Eng. & Systems 2020-02-11 Danqi Jin , Jie Chen , Cedric Richard , Jingdong Chen , Ali H. Sayed

In this paper, we study the distributed adaptive estimation problem of continuous-time stochastic dynamic systems over sensor networks where each agent can only communicate with its local neighbors. A distributed least squares (LS)…

Systems and Control · Electrical Eng. & Systems 2023-09-07 Xinghua Zhu , Zhixin Liu

This letter presents an improved version of diffusion least mean ppower (LMP) algorithm for distributed estimation. Instead of sum of mean square errors, a weighted sum of mean square error is defined as the cost function for global and…

Machine Learning · Statistics 2016-08-09 H. Zayyani , M. Korki