English
Related papers

Related papers: Convergence of a Distributed Least Squares

200 papers

Adaptive algorithms based on in-network processing over networks are useful for online parameter estimation of historical data (e.g., noise covariance) in predictive control and machine learning areas. This paper focuses on the distributed…

Optimization and Control · Mathematics 2020-04-01 Jiahong Li , Nan Ma , Fang Deng

In this work, we develop a distributed least squares approximation (DLSA) method that is able to solve a large family of regression problems (e.g., linear regression, logistic regression, and Cox's model) on a distributed system. By…

Methodology · Statistics 2021-05-11 Xuening Zhu , Feng Li , Hansheng Wang

In multi-task adversarial networks, the accurate estimation of unknown parameters in a distributed algorithm is hindered by attacked nodes or links. To tackle this challenge, this brief proposes a low-communication resilient distributed…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-06 Wei Li , Limei Hu , Feng Chen , Ye Yao

This paper investigates some theoretical properties of the Partial Least Square (PLS) method. We focus our attention on the single component case, that provides a useful framework to understand the underlying mechanism. We provide a…

Statistics Theory · Mathematics 2023-10-17 Luca Castelli , Clément Marteau , Irène Gannaz

In this work, we propose a novel discrete-time distributed algorithm for finding least-squares solutions of linear algebraic equations with a scheduling protocol to further enhance its scalability. Each agent in the network is assumed to…

Systems and Control · Electrical Eng. & Systems 2025-10-24 Shenyu Liu

The paper considers gossip distributed estimation of a (static) distributed random field (a.k.a., large scale unknown parameter vector) observed by sparsely interconnected sensors, each of which only observes a small fraction of the field.…

Information Theory · Computer Science 2015-05-20 Soummya Kar , Jose' M. F. Moura

This paper studies distributed adaptive estimation over sensor networks with partially unknown source dynamics. We present parallel continuous-time and discrete-time designs in which each node runs a local adaptive observer and exchanges…

Systems and Control · Electrical Eng. & Systems 2026-05-18 Moh Kamalul Wafi , Hamidreza Montazeri Hedesh , Milad Siami

Feedback mechanism based algorithms are frequently used to solve network optimization problems. These schemes involve users and network exchanging information (e.g. requests for bandwidth allocation and pricing) to achieve convergence…

Networking and Internet Architecture · Computer Science 2016-04-12 Hengky Susanto , ByungGuk Kim

We study a distributed node-specific parameter estimation problem where each node in a wireless sensor network is interested in the simultaneous estimation of different vectors of parameters that can be of local interest, of common interest…

Systems and Control · Computer Science 2015-10-06 Jorge Plata-Chaves , Mohamad Hasan Bahari , Marc Moonen , Alexander Bertrand

We study the problem of collaboratively learning least squares estimates for $m$ agents. Each agent observes a different subset of the features$\unicode{x2013}$e.g., containing data collected from sensors of varying resolution. Our goal is…

Machine Learning · Statistics 2023-07-25 Chen Cheng , Gary Cheng , John Duchi

The goal of this paper is to propose novel strategies for adaptive learning of signals defined over graphs, which are observed over a (randomly time-varying) subset of vertices. We recast two classical adaptive algorithms in the graph…

Machine Learning · Computer Science 2018-08-01 Paolo Di Lorenzo , Paolo Banelli , Elvin Isufi , Sergio Barbarossa , Geert Leus

We propose a multi-hop diffusion strategy for a sensor network to perform distributed least mean-squares (LMS) estimation under local and network-wide energy constraints. At each iteration of the strategy, each node can combine intermediate…

Optimization and Control · Mathematics 2023-07-19 Wuhua Hu , Wee Peng Tay

In a distributed network environment, the diffusion-least mean squares (LMS) algorithm gives faster convergence than the original LMS algorithm. It has also been observed that, the diffusion-LMS generally outperforms other distributed LMS…

Machine Learning · Computer Science 2015-09-07 Rangeet Mitra , Vimal Bhatia

In this article we study the asymptotic behaviour of the least square estimator in a linear regression model based on random observation instances. We provide mild assumptions on the moments and dependence structure on the randomly spaced…

Statistics Theory · Mathematics 2021-10-07 Karine Bertin , Soledad Torres , Lauri Viitasaari

A power constrained sensor network that consists of multiple sensor nodes and a fusion center (FC) is considered, where the goal is to estimate a random parameter of interest. In contrast to the distributed framework, the sensor nodes may…

Information Theory · Computer Science 2012-07-03 Swarnendu Kar , Pramod K. Varshney

Decentralized state estimation in a communication-constrained sensor network is considered. The exchanged estimates are dimension-reduced to reduce the communication load using a linear mapping to a lower-dimensional space. The mean squared…

Systems and Control · Electrical Eng. & Systems 2023-12-13 Robin Forsling , Fredrik Gustafsson , Zoran Sjanic , Gustaf Hendeby

A distributed adaptive algorithm for estimation of sparse unknown parameters in the presence of nonGaussian noise is proposed in this paper based on normalized least mean fourth (NLMF) criterion. At the first step, local adaptive NLMF…

Information Theory · Computer Science 2015-12-09 Mojtaba Hajiabadi

We consider a network scenario in which agents can evaluate each other according to a score graph that models some interactions. The goal is to design a distributed protocol, run by the agents, that allows them to learn their unknown state…

Systems and Control · Computer Science 2018-06-05 Francesco Sasso , Angelo Coluccia , Giuseppe Notarstefano

State estimation for a class of linear time-invariant systems with distributed output measurements (distributed sensors) and unknown inputs is addressed in this paper. The objective is to design a network of observers such that the state…

Systems and Control · Electrical Eng. & Systems 2021-10-12 Guitao Yang , Angelo Barboni , Hamed Rezaee , Thomas Parisini

Important applications in robotic and sensor networks require distributed algorithms to solve the so-called relative localization problem: a node-indexed vector has to be reconstructed from measurements of differences between neighbor…

Systems and Control · Computer Science 2013-03-26 Wilbert Samuel Rossi , Paolo Frasca , Fabio Fagnani