English
Related papers

Related papers: Multi-Layered Recursive Least Squares for Time-Var…

200 papers

In linear regression, the least squares (LS) estimator has certain optimality properties if the errors are normally distributed. This assumption is often violated in practice, partly caused by data outliers. Robust estimators can cope with…

Methodology · Statistics 2020-07-01 Sukru Acitas , Peter Filzmoser , Birdal Senoglu

This paper considers the channel estimation of a single user in a MISO system with an intelligent reflecting surface (IRS). The performances of the minimum variance unbiased (MVU) and minimum mean square error (MMSE) estimators using the…

Information Theory · Computer Science 2023-09-01 Rıfat Volkan Şenyuva

Reconfigurable intelligent surface (RIS) is a promising technique to improve the performance of future wireless communication systems at low energy consumption. To reap the potential benefits of RIS-aided beamforming, it is vital to enhance…

Information Theory · Computer Science 2024-04-01 Zhenyao He , Jindan Xu , Hong Shen , Wei Xu , Chau Yuen , Marco Di Renzo

Learning depends on the ability to acquire and assimilate new information. This ability depends---somewhat counterintuitively---on the ability to forget. In particular, effective forgetting requires the ability to recognize and utilize new…

Optimization and Control · Mathematics 2021-04-05 Ankit Goel , Adam L. Bruce , Dennis S. Bernstein

This paper focuses on the problem of recursive nonlinear least squares parameter estimation in multi-agent networks, in which the individual agents observe sequentially over time an independent and identically distributed (i.i.d.)…

Optimization and Control · Mathematics 2016-10-20 Anit Kumar Sahu , Soummya Kar , Jose' M. F. Moura , H. Vincent Poor

This paper proposes a recursive interval-valued estimation framework for identifying the parameters of linearly parameterized systems which may be slowly time-varying. It is assumed that the model error (which may consist in measurement…

Systems and Control · Electrical Eng. & Systems 2022-06-22 Laurent Bako , Seydi Ndiaye , Eric Blanco

Traditionally, batch least squares (BLS) and recursive least squares (RLS) are used for identification of a vector of parameters that form a linear model. In some situations, however, it is of interest to identify parameters in a matrix…

Signal Processing · Electrical Eng. & Systems 2024-06-11 Brian Lai , Dennis S. Bernstein

Distributed adaptive signal processing has attracted much attention in the recent decade owing to its effectiveness in many decentralized real-time applications in networked systems. Because many natural signals are highly sparse with most…

Optimization and Control · Mathematics 2017-11-22 Xuanyu Cao , K. J. Ray Liu

Least mean square (LMS) type adaptive algorithms have attracted much attention due to their low computational complexity. In the scenarios of sparse channel estimation, zero-attracting LMS (ZA-LMS), reweighted ZA-LMS (RZA-LMS) and…

Systems and Control · Computer Science 2015-04-14 Beiyi Liu , Guan Gui , Li Xu

High-dimensional time-series data are becoming increasingly abundant across a wide variety of domains, spanning economics, neuroscience, particle physics, and cosmology. Fitting statistical models to such data, to enable parameter…

We consider the problem of reconstructing rank-one matrices from random linear measurements, a task that appears in a variety of problems in signal processing, statistics, and machine learning. In this paper, we focus on the Alternating…

Machine Learning · Computer Science 2022-04-26 Kiryung Lee , Dominik Stöger

We address the problem of sparse recovery in an online setting, where random linear measurements of a sparse signal are revealed sequentially and the objective is to recover the underlying signal. We propose a reweighted least squares (RLS)…

Machine Learning · Computer Science 2017-06-30 Subhadip Mukherjee , Deepak R. , Huaijin Chen , Ashok Veeraraghavan , Chandra Sekhar Seelamantula

This paper extends recursive least squares (RLS) to include time-varying regularization. This extension provides flexibility for updating the least squares regularization term in real time. Existing results with constant regularization…

Signal Processing · Electrical Eng. & Systems 2025-01-09 Brian Lai , Dimitra Panagou , Dennis S. Bernstein

This paper introduces two novel approaches for Online Multi-Task Learning (MTL) Regression Problems. We employ a high performance graph-based MTL formulation and develop two alternative recursive versions based on the Weighted Recursive…

Machine Learning · Statistics 2024-03-19 Gabriel R. Lencione , Fernando J. Von Zuben

The recursive least-squares algorithm with $\ell_1$-norm regularization ($\ell_1$-RLS) exhibits excellent performance in terms of convergence rate and steady-state error in identification of sparse systems. Nevertheless few works have…

Signal Processing · Electrical Eng. & Systems 2022-02-02 Wei Gao , Jie Chen , Cédric Richard , Wentao Shi , Qunfei Zhang

This paper presents subspace of information forgetting recursive least squares (SIFt-RLS), a directional forgetting algorithm which, at each step, forgets only in row space of the regressor matrix, or the \textit{information subspace}. As a…

Signal Processing · Electrical Eng. & Systems 2024-04-18 Brian Lai , Dennis S. Bernstein

Recently, the proposal of the least mean square (LMS) and recursive least squares (RLS) algorithm for graph signal processing (GSP) provides excellent solutions for processing signals defined on irregular structures such as sensor networks.…

Signal Processing · Electrical Eng. & Systems 2025-06-03 Haiquan Zhao , Chengjin Li

In order to improve the performance of Least Mean Square (LMS) based system identification of sparse systems, a new adaptive algorithm is proposed which utilizes the sparsity property of such systems. A general approximating approach on…

Information Theory · Computer Science 2015-06-15 Yuantao Gu , Jian Jin , Shunliang Mei

In this paper, we study the problem of multipath channel estimation for direct sequence spread spectrum signals. To resolve multipath components arriving within a short interval, we propose a new algorithm called the least-squares based…

Information Theory · Computer Science 2015-03-19 Wooseok Nam , Seung-Hyun Kong

Sparse adaptive filtering has gained much attention due to its wide applicability in the field of signal processing. Among the main algorithm families, sparse norm constraint adaptive filters develop rapidly in recent years. However, when…

Systems and Control · Computer Science 2015-09-29 Yong Feng , Fei Chen , Rui Zeng , Jiasong Wu , Huazhong Shu