English
Related papers

Related papers: Transient Error Analysis of the LMS and RLS Algori…

200 papers

Zero-attracting least-mean-square (ZA-LMS) algorithm has been widely used for online sparse system identification. It combines the LMS framework and $\ell_1$-norm regularization to promote sparsity, and relies on subgradient iterations.…

Performance · Computer Science 2016-12-21 Jie Chen , Cedric Richard , Yingying Song , David Brie

In this paper, we propose two novel p-norm penalty least mean square (Lp-LMS) algorithms as supplements of the conventional Lp-LMS algorithm established for sparse adaptive filtering recently. A gradient comparator is employed to…

Systems and Control · Computer Science 2015-03-11 Yong Feng , Jiasong Wu , Rui Zeng , Limin Luo , Huazhong Shu

Performance analysis of $l_0$ norm constrained Recursive least Squares (RLS) algorithm is attempted in this paper. Though the performance pretty attractive compared to its various alternatives, no thorough study of theoretical analysis has…

Information Theory · Computer Science 2016-02-11 Samrat Mukhopadhyay , Bijit Kumar Das , Mrityunjoy Chakraborty

This paper introduces a novel adaptive framework for processing dynamic flow signals over simplicial complexes, extending classical least-mean-squares (LMS) methods to high-order topological domains. Building on discrete Hodge theory, we…

Signal Processing · Electrical Eng. & Systems 2025-05-30 Lorenzo Marinucci , Claudio Battiloro , Paolo Di Lorenzo

This article presents the formulation and steady-state analysis of the distributed estimation algorithms based on the diffusion cooperation scheme in the presence of errors due to the unreliable data transfer among nodes. In particular, we…

Systems and Control · Computer Science 2013-10-29 Saeed Ghazanfari-Rad , Fabrice Labeau

The LMS algorithm is one of the most widely used techniques in adaptive filtering. Accurate modeling of the algorithm in various circumstances is paramount to achieving an efficient adaptive Wiener filter design process. In the recent…

Signal Processing · Electrical Eng. & Systems 2020-10-22 Enrique T. R. Pinto , Leonardo S. Resende

In the presence of impulsive noise, and missing observations, accurate online prediction of time-varying graph signals poses a crucial challenge in numerous application domains. We propose the Adaptive Least Mean $p^{th}$ Power Graph Neural…

Machine Learning · Computer Science 2024-11-26 Yi Yan , Changran Peng , Ercan E. Kuruoglu

We investigate the performance of distributed least-mean square (LMS) algorithms for parameter estimation over sensor networks where the regression data of each node are corrupted by white measurement noise. Under this condition, we show…

Systems and Control · Computer Science 2016-11-18 Reza Abdolee , Benoit Champagne

This paper investigates the optimality analysis of the recursive least-squares (RLS) algorithm for autoregressive systems with exogenous inputs (ARX systems). A key challenge in analyzing is managing the potential unboundedness of the…

Optimization and Control · Mathematics 2025-05-27 Xingrui Liu , Jieming Ke , Yanlong Zhao

Traditional recursive least square (RLS) adaptive filtering is widely used to estimate the impulse responses (IR) of an unknown system. Nevertheless, the RLS estimator shows poor performance when tracking rapidly time-varying systems. In…

Signal Processing · Electrical Eng. & Systems 2021-10-25 Mohammad Towliat , Zheng Guo , Leonard J. Cimini , Xiang-Gen Xia , Aijun Song

As one of the recently proposed algorithms for sparse system identification, $l_0$ norm constraint Least Mean Square ($l_0$-LMS) algorithm modifies the cost function of the traditional method with a penalty of tap-weight sparsity. The…

Information Theory · Computer Science 2015-06-04 Guolong Su , Jian Jin , Yuantao Gu , Jian Wang

Graph signal processing (GSP) deals with the representation, analysis, and processing of structured data, i.e. graph signals that are defined on the vertex set of a generic graph. A crucial prerequisite for applying various GSP and graph…

Signal Processing · Electrical Eng. & Systems 2024-10-28 Lital Dabush , Tirza Routtenberg

This work addresses the problem of graph learning from data following a Gaussian Graphical Model (GGM) with a time-varying mean. Graphical Lasso (GL), the standard method for estimating sparse precision matrices, assumes that the observed…

Machine Learning · Computer Science 2025-03-26 Samuel Rey , Ernesto Curbelo , Luca Martino , Fernando Llorente , Antonio G. Marques

This work introduces the LLM Online Spatial-temporal Reconstruction (LLM-OSR) framework, which integrates Graph Signal Processing (GSP) and Large Language Models (LLMs) for online spatial-temporal signal reconstruction. The LLM-OSR utilizes…

Machine Learning · Computer Science 2024-11-26 Yi Yan , Dayu Qin , Ercan Engin Kuruoglu

Within the context of recursive least squares (RLS) parameter estimation, the goal of the present paper is to study the effect of regularization-induced bias on the transient and asymptotic accuracy of the parameter estimates. We consider…

Systems and Control · Electrical Eng. & Systems 2021-09-01 Brian Lai , Syed Aseem Ul Islam , Dennis S. Bernstein

This paper proposes Graph Signal Adaptive Message Passing (GSAMP), a novel message passing method that simultaneously conducts online prediction, missing data imputation, and noise removal on time-varying graph signals. Unlike conventional…

Signal Processing · Electrical Eng. & Systems 2024-11-26 Yi Yan , Changran Peng , Ercan Engin Kuruoglu

Convergence of the diffusion RLS (DRLS) algorithm to steady-state has been extensively studied in the literature, whereas no analysis of its transient convergence behavior has been reported yet. In this letter, we conduct a theoretical…

Signal Processing · Electrical Eng. & Systems 2021-07-07 Wei Gao , Jie Chen , Cédric Richard

State-space models (SSMs) are a common tool for modeling multi-variate discrete-time signals. The linear-Gaussian (LG) SSM is widely applied as it allows for a closed-form solution at inference, if the model parameters are known. However,…

Computational Engineering, Finance, and Science · Computer Science 2023-03-23 Emilie Chouzenoux , Victor Elvira

In presence of sparse noise we propose kernel regression for predicting output vectors which are smooth over a given graph. Sparse noise models the training outputs being corrupted either with missing samples or large perturbations. The…

Machine Learning · Statistics 2018-11-07 Arun Venkitaraman , Pascal Frossard , Saikat Chatterjee

Introduction Several speech processing algorithms assume the signal is stationary during short intervals (approximately 20 to 30 ms). This assumption is valid for several applications, but it is too restrictive in some contexts. This work…

Audio and Speech Processing · Electrical Eng. & Systems 2018-12-10 Aldebaro Klautau