English
Related papers

Related papers: Study of Sparsity-Aware Distributed Conjugate Grad…

200 papers

We consider a network of sensors deployed to sense a spatio-temporal field and estimate a parameter of interest. We are interested in the case where the temporal process sensed by each sensor can be modeled as a state-space process that is…

Distributed, Parallel, and Cluster Computing · Computer Science 2008-04-12 S. Sundhar Ram , V. V. Veeravalli , A. Nedic

This work presents a distributed algorithm for nonlinear adaptive learning. In particular, a set of nodes obtain measurements, sequentially one per time step, which are related via a nonlinear function; their goal is to collectively…

Information Theory · Computer Science 2016-02-09 Symeon Chouvardas , Moez Draief

In a distributed network environment, the diffusion-least mean squares (LMS) algorithm gives faster convergence than the original LMS algorithm. It has also been observed that, the diffusion-LMS generally outperforms other distributed LMS…

Machine Learning · Computer Science 2015-09-07 Rangeet Mitra , Vimal Bhatia

This paper takes a different approach for the distributed linear parameter estimation over a multi-agent network. The parameter vector is considered to be stochastic with a Gaussian distribution. The sensor measurements at each agent are…

Systems and Control · Electrical Eng. & Systems 2022-04-19 Subhro Das

In this paper, we study the problem where a group of agents aim to collaboratively learn a common static latent function through streaming data. We propose a lightweight distributed Gaussian process regression (GPR) algorithm that is…

Machine Learning · Computer Science 2023-07-11 Zhenyuan Yuan , Minghui Zhu

We study diffusion and consensus based optimization of a sum of unknown convex objective functions over distributed networks. The only access to these functions is through stochastic gradient oracles, each of which is only available at a…

Numerical Analysis · Computer Science 2015-09-01 N. Denizcan Vanli , Muhammed O. Sayin , Suleyman S. Kozat

In this paper, we propose two novel p-norm penalty least mean square (Lp-LMS) algorithms as supplements of the conventional Lp-LMS algorithm established for sparse adaptive filtering recently. A gradient comparator is employed to…

Systems and Control · Computer Science 2015-03-11 Yong Feng , Jiasong Wu , Rui Zeng , Limin Luo , Huazhong Shu

This work examines the mean-square error performance of diffusion stochastic algorithms under a generalized coordinate-descent scheme. In this setting, the adaptation step by each agent is limited to a random subset of the coordinates of…

Multiagent Systems · Computer Science 2017-10-12 Chengcheng Wang , Yonggang Zhang , Bicheng Ying , Ali H. Sayed

Various distributed optimization methods have been developed for solving problems which have simple local constraint sets and whose objective function is the sum of local cost functions of distributed agents in a network. Motivated by…

Systems and Control · Computer Science 2016-11-17 Tsung-Hui Chang , Angelia Nedić , Anna Scaglione

This work proposes diffusion normalized least mean M-estimate algorithm based on the modified Huber function, which can equip distributed networks with robust learning capability in the presence of impulsive interference. In order to…

Machine Learning · Computer Science 2020-04-21 Y. Yu , H. He , T. Yang , X. Wang , R. C. de Lamare

We propose an adaptive diffusion mechanism to optimize a global cost function in a distributed manner over a network of nodes. The cost function is assumed to consist of a collection of individual components. Diffusion adaptation allows the…

Optimization and Control · Mathematics 2015-06-03 Jianshu Chen , Ali H. Sayed

Multilayer networks provide a more comprehensive framework for exploring real-world and engineering systems than traditional single-layer networks, consisting of multiple interacting networks. However, despite significant research in…

Optimization and Control · Mathematics 2024-11-12 C. D. Rodríguez-Camargo , A. F. Urquijo-Rodríguez , E. A. Mojica-Nava

In this article, we propose a new approach, optimize then agree for minimizing a sum $ f = \sum_{i=1}^n f_i(x)$ of convex objective functions over a directed graph. The optimize then agree approach decouples the optimization step and the…

Systems and Control · Electrical Eng. & Systems 2021-05-27 Vivek Khatana , Govind Saraswat , Sourav Patel , Murti V. Salapaka

This paper considers a distributed stochastic strongly convex optimization, where agents connected over a network aim to cooperatively minimize the average of all agents' local cost functions. Due to the stochasticity of gradient estimation…

Optimization and Control · Mathematics 2020-02-17 Jinlong Lei , Peng Yi , Jie Chen , Yiguang Hong

In this paper a novel distributed algorithm for blind macro calibration in sensor networks based on output synchronization is proposed. The algorithm is formulated as a set of gradient-type recursions for estimating parameters of sensor…

Systems and Control · Computer Science 2016-03-27 Miloš S. Stanković , Srđan S. Stanković , Karl Henrik Johansson

Broadband wireless channels usually have the sparse nature. Based on the assumption of Gaussian noise model, adaptive filtering algorithms for reconstruction sparse channels were proposed to take advantage of channel sparsity. However,…

Information Theory · Computer Science 2015-02-20 Guan Gui , Li Xu , Wentao Ma , Badong Chen

In this paper, a novel diffusion estimation algorithm is proposed from a probabilistic perspective by combining diffusion strategy and the probabilistic least-mean-squares (PLMS) at all agents. The proposed method diffusion probabilistic…

Signal Processing · Electrical Eng. & Systems 2019-08-27 Sihai Guan , Chun Meng , Bharat Biswal

In multicenter research, individual-level data are often protected against sharing across sites. To overcome the barrier of data sharing, many distributed algorithms, which only require sharing aggregated information, have been developed.…

Methodology · Statistics 2021-03-25 Rui Duan , Yang Ning , Yong Chen

We propose an adaptive scheme for distributed learning of nonlinear functions by a network of nodes. The proposed algorithm consists of a local adaptation stage utilizing multiple kernels with projections onto hyperslabs and a diffusion…

Signal Processing · Electrical Eng. & Systems 2018-09-05 Ban-Sok Shin , Masahiro Yukawa , Renato Luis Garrido Cavalcante , Armin Dekorsy

This paper presents adaptive link selection algorithms for distributed estimation and considers their application to wireless sensor networks and smart grids. In particular, exhaustive search--based least--mean--squares(LMS)/recursive least…

Systems and Control · Computer Science 2015-10-20 S. Xu , R. C. de Lamare , H. V. Poor