English
Related papers

Related papers: Distributed Recursive Least-Squares: Stability and…

200 papers

A distributed adaptive algorithm is proposed to solve a node-specific parameter estimation problem where nodes are interested in estimating parameters of local interest, parameters of common interest to a subset of nodes and parameters of…

Computers and Society · Computer Science 2023-07-19 Jorge Plata-Chaves , Nikola Bogdanovic , Kostas Berberidis

This paper investigates the optimality analysis of the recursive least-squares (RLS) algorithm for autoregressive systems with exogenous inputs (ARX systems). A key challenge in analyzing is managing the potential unboundedness of the…

Optimization and Control · Mathematics 2025-05-27 Xingrui Liu , Jieming Ke , Yanlong Zhao

Sparse structures are widely recognized and utilized in channel estimation. Two typical mechanisms, namely proportionate updating (PU) and zero-attracting (ZA) techniques, achieve better performance, but their computational complexity are…

Signal Processing · Electrical Eng. & Systems 2023-05-08 Zhen Qin

The rapid development of signal processing on graphs provides a new perspective for processing large-scale data associated with irregular domains. In many practical applications, it is necessary to handle massive data sets through complex…

Information Theory · Computer Science 2023-07-19 Xiaohan Wang , Mengdi Wang , Yuantao Gu

This paper proposes a distributed weighted regularized least squares algorithm (DWRLS) based on spherical radial basis functions and spherical quadrature rules to tackle spherical data that are stored across numerous local servers and…

Machine Learning · Computer Science 2022-11-15 Han Feng , Shao-Bo Lin , Ding-Xuan Zhou

The deluge of networked data motivates the development of algorithms for computation- and communication-efficient information processing. In this context, three data-adaptive censoring strategies are introduced to considerably reduce the…

Systems and Control · Computer Science 2018-01-16 Zifeng Wang , Zheng Yu , Qing Ling , Dimitris Berberidis , Georgios B. Giannakis

Recursive least squares (RLS) algorithms were once widely used for training small-scale neural networks, due to their fast convergence. However, previous RLS algorithms are unsuitable for training deep neural networks (DNNs), since they…

Machine Learning · Computer Science 2021-09-08 Chunyuan Zhang , Qi Song , Hui Zhou , Yigui Ou , Hongyao Deng , Laurence Tianruo Yang

In this work, we obtain sufficient conditions for the "stability" of our recently proposed algorithms, Least Squares Compressive Sensing residual (LS-CS) and modified-CS, for recursively reconstructing sparse signal sequences from noisy…

Information Theory · Computer Science 2015-03-19 Namrata Vaswani

Adaptive algorithms based on in-network processing over networks are useful for online parameter estimation of historical data (e.g., noise covariance) in predictive control and machine learning areas. This paper focuses on the distributed…

Optimization and Control · Mathematics 2020-04-01 Jiahong Li , Nan Ma , Fang Deng

We consider a network of sensors deployed to sense a spatio-temporal field and estimate a parameter of interest. We are interested in the case where the temporal process sensed by each sensor can be modeled as a state-space process that is…

Distributed, Parallel, and Cluster Computing · Computer Science 2008-04-12 S. Sundhar Ram , V. V. Veeravalli , A. Nedic

This work presents joint iterative power allocation and interference suppression algorithms for DS-CDMA networks which employ multiple relays and the amplify and forward cooperation strategy. We propose a joint constrained optimization…

Information Theory · Computer Science 2013-04-10 R. C. de Lamare , S. Li

In this paper, we present a diffusion multi-rate least-mean-square (LMS) algorithm, named DMLMS, which is an effective solution for distributed estimation when two or more observation sequences are available with different sampling rates.…

Systems and Control · Computer Science 2020-03-31 Lu Lu , Xiaomin Yang , Rongzhu Zhang

The classical iteratively reweighted least-squares (IRLS) algorithm aims to recover an unknown signal from linear measurements by performing a sequence of weighted least squares problems, where the weights are recursively updated at each…

Machine Learning · Statistics 2024-06-06 Chiraag Kaushik , Justin Romberg , Vidya Muthukumar

In this work, we develop a distributed least squares approximation (DLSA) method that is able to solve a large family of regression problems (e.g., linear regression, logistic regression, and Cox's model) on a distributed system. By…

Methodology · Statistics 2021-05-11 Xuening Zhu , Feng Li , Hansheng Wang

The recursive least-squares (RLS) algorithm is one of the most well-known algorithms used in adaptive filtering, system identification and adaptive control. Its popularity is mainly due to its fast convergence speed, which is considered to…

Machine Learning · Computer Science 2011-06-06 H. He , D. Hu , X. Xu

Underwater communication signals typically suffer from distortion due to motion-induced Doppler. Especially in shallow water environments, recovering the signal is challenging due to the time-varying Doppler effects distorting each path…

Signal Processing · Electrical Eng. & Systems 2023-05-31 Jae Won Choi , Girish Chowdhary , Andrew C. Singer , Hari Vishnu , Amir Weiss , Gregory W. Wornell , Grant Deane

We study the problem of distributed adaptive estimation over networks where nodes cooperate to estimate physical parameters that can vary over both space and time domains. We use a set of basis functions to characterize the space-varying…

Systems and Control · Computer Science 2015-07-22 Reza Abdolee , Benoit Champagne , Ali H. Sayed

The so-called constrained least mean-square algorithm is one of the most commonly used linear-equality-constrained adaptive filtering algorithms. Its main advantages are adaptability and relative simplicity. In order to gain analytical…

Systems and Control · Computer Science 2015-02-26 Reza Arablouei , Kutluyıl Doğançay , Stefan Werner

The least mean-square (LMS) filter is one of the most common adaptive linear estimation algorithms. In many practical scenarios, and particularly in digital communications systems, the signal of interest (SOI) and the input signal are…

Systems and Control · Computer Science 2018-11-28 Nir Shlezinger , Koby Todros

In large-scale data processing scenarios, data often arrive in sequential streams generated by complex systems that exhibit drifting distributions and time-varying system parameters. This nonstationarity challenges theoretical analysis, as…

Machine Learning · Computer Science 2026-02-13 Yifei Jin , Xin Zheng , Lei Guo