English
Related papers

Related papers: Sparsity-Aware Adaptive Algorithms Based on Altern…

200 papers

We consider adaptive system identification problems with convex constraints and propose a family of regularized Least-Mean-Square (LMS) algorithms. We show that with a properly selected regularization parameter the regularized LMS provably…

Methodology · Statistics 2010-12-24 Yilun Chen , Yuantao Gu , Alfred O. Hero

The proportionate normalized least mean square (PNLMS) algorithm and its variants are by far the most popular adaptive filters that are used to identify sparse systems. The convergence speed of the PNLMS algorithm, though very high…

Information Theory · Computer Science 2015-07-13 Rajib Lochan Das , Mrityunjoy Chackraborty

This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible. Numerous renowned algorithms for tackling the compressed sensing problem…

Information Theory · Computer Science 2026-03-11 Xu Zhu , Yufei Ma , Xiaoguang Li , Tiejun Li

We introduce a fast iterative non-local shrinkage algorithm to recover MRI data from undersampled Fourier measurements. This approach is enabled by the reformulation of current non-local schemes as an alternating algorithm to minimize a…

Computer Vision and Pattern Recognition · Computer Science 2014-05-22 Yasir Q. Moshin , Greg Ongie , Mathews Jacob

Invariable step size based least-mean-square error (ISS-LMS) was considered as a very simple adaptive filtering algorithm and hence it has been widely utilized in many applications, such as adaptive channel estimation. It is well known that…

Information Theory · Computer Science 2015-01-29 Beiyi Liu , Guan Gui , Li Xu , Nobuhiro Shimoi

The least-mean-squares (LMS) algorithm is the most popular algorithm in adaptive filtering. Several variable step-size strategies have been suggested to improve the performance of the LMS algorithm. These strategies enhance the performance…

Data Structures and Algorithms · Computer Science 2017-03-22 Muhammad Omer Bin Saeed

In this paper, we propose a novel element-wise subset selection method for the alternating least squares (ALS) algorithm, focusing on low-rank matrix factorization involving matrices with missing values, as commonly encountered in…

Methodology · Statistics 2025-11-12 Dunyao Xue , Mengyu Li , Cheng Meng , Jingyi Zhang

In this paper, a new family of proportionate normalized least mean square (PNLMS) adaptive algorithms that improve the performance of identifying block-sparse systems is proposed. The main proposed algorithm, called block-sparse PNLMS…

Information Theory · Computer Science 2015-12-01 Jianming Liu , Steven L. Grant

Sharpness-aware minimization (SAM), which searches for flat minima by min-max optimization, has been shown to be useful in improving model generalization. However, since each SAM update requires computing two gradients, its computational…

Machine Learning · Computer Science 2023-05-01 Weisen Jiang , Hansi Yang , Yu Zhang , James Kwok

Broadband wireless channels usually have the sparse nature. Based on the assumption of Gaussian noise model, adaptive filtering algorithms for reconstruction sparse channels were proposed to take advantage of channel sparsity. However,…

Information Theory · Computer Science 2015-02-20 Guan Gui , Li Xu , Wentao Ma , Badong Chen

Least mean square (LMS) type adaptive algorithms have attracted much attention due to their low computational complexity. In the scenarios of sparse channel estimation, zero-attracting LMS (ZA-LMS), reweighted ZA-LMS (RZA-LMS) and…

Systems and Control · Computer Science 2015-04-14 Beiyi Liu , Guan Gui , Li Xu

We introduce a probabilistic approach to the LMS filter. By means of an efficient approximation, this approach provides an adaptable step-size LMS algorithm together with a measure of uncertainty about the estimation. In addition, the…

Machine Learning · Statistics 2016-04-11 Jesus Fernandez-Bes , Víctor Elvira , Steven Van Vaerenbergh

This paper describes a novel technique for promoting sparsity in the modified filtered-x algorithms required for active noise control. The proposed algorithms are based on recent techniques incorporating approximations to the \ell_0-norm in…

Sound · Computer Science 2014-05-28 A. Gully , R. C. de Lamare

In many application of noise cancellation, the changes in signal characteristics could be quite fast. This requires the utilization of adaptive algorithms, which converge rapidly. Least Mean Squares (LMS) and Normalized Least Mean Squares…

Sound · Computer Science 2011-06-07 Sayed. A. Hadei , M. lotfizad

This paper presents a novel adaptive reduced-rank multi-input-multi-output (MIMO) decision feedback equalization structure based on joint iterative optimization of adaptive estimators. The novel reduced-rank equalization structure consists…

Information Theory · Computer Science 2013-04-30 Rodrigo C. de Lamare , Are Hjorungnes , Raimundo Sampaio-Neto

In high sample-rate applications of the least-mean-square (LMS) adaptive filtering algorithm, pipelining or/and block processing is required. As opposed to earlier work, pipelining and block processing are jointly considered to obtain what…

Signal Processing · Electrical Eng. & Systems 2023-06-22 Mohd. Tasleem Khan , Oscar Gustafsson

This paper proposes a unified sparsity-aware robust recursive least-squares RLS (S-RRLS) algorithm for the identification of sparse systems under impulsive noise. The proposed algorithm generalizes multiple algorithms only by replacing the…

Signal Processing · Electrical Eng. & Systems 2022-05-11 Y. Yu , L. Lu , Y. Zakharov , R. C. de Lamare , B. Chen

Extremum seeking (ES) optimization approach has been very popular due to its non-model based analysis and implementation. This approach has been mostly used with gradient based search algorithms. Since least squares (LS) algorithms are…

Systems and Control · Electrical Eng. & Systems 2020-03-10 Nursefa Zengin , Baris Fidan

The so-called constrained least mean-square algorithm is one of the most commonly used linear-equality-constrained adaptive filtering algorithms. Its main advantages are adaptability and relative simplicity. In order to gain analytical…

Systems and Control · Computer Science 2015-02-26 Reza Arablouei , Kutluyıl Doğançay , Stefan Werner

This work presents a new variation of the commonly used Least Mean Squares Algorithm (LMS) for the identification of sparse signals with an a-priori known sparsity using a hard threshold operator in every iteration. It examines some useful…

Systems and Control · Computer Science 2016-08-04 Lampros Flokas , Petros Maragos