English
Related papers

Related papers: Performance Analysis of l_0 Norm Constraint Least …

200 papers

Significant attention has been given to minimizing a penalized least squares criterion for estimating sparse solutions to large linear systems of equations. The penalty is responsible for inducing sparsity and the natural choice is the…

Machine Learning · Statistics 2015-03-20 Goran Marjanovic , Magnus O. Ulfarsson , Alfred O. Hero

In this paper, we present the convergence analysis of proportionate-type least mean square (Pt-LMS) algorithm that identifies the sparse system effectively and more suitable for real time VLSI applications. Both first and second order…

Systems and Control · Computer Science 2015-12-15 Vinay Chakravarthi Gogineni , Subrahmanyam Mula

To exploit the sparsity of the considered system, the diffusion proportionate-type least mean square (PtLMS) algorithms assign different gains to each tap in the convergence stage while the diffusion sparsity-constrained LMS (ScLMS)…

Information Theory · Computer Science 2017-03-27 Zongsheng Zheng , Zhigang Liu

Channel state information (CSI) is very crucial for any wireless communication systems. Typically, CSI can be characterized at the receiver side using channel impulse response (CIR). Many observations have shown that the CIR of broadband…

Signal Processing · Electrical Eng. & Systems 2018-12-12 Ahmed M. Abd El-Moaty , Azzedine Zerguine

In this paper, the recursive least squares (RLS) algorithm is considered in the sparse system identification setting. The cost function of RLS algorithm is regularized by a $p$-norm-like ($0 \leq p \leq 1$) constraint of the estimated…

Information Theory · Computer Science 2023-12-12 Shuyang Jiang , Kung Yao

Broadband signal transmission over frequency-selective fading channel often requires accurate channel state information at receiver. One of the most attracting adaptive channel estimation methods is least mean square (LMS) algorithm.…

Information Theory · Computer Science 2013-04-16 Guan Gui , Abolfazl Mehbodniya , Fumiyuki Adachi

We study the effect of fading in the communication channels between nodes on the performance of the incremental least mean square (ILMS) algorithm. We derive steady-state performance metrics, including the mean-square deviation (MSD),…

Systems and Control · Computer Science 2015-08-11 Azam Khalili , Amir Rastegarnia

We investigate the performance of distributed least-mean square (LMS) algorithms for parameter estimation over sensor networks where the regression data of each node are corrupted by white measurement noise. Under this condition, we show…

Systems and Control · Computer Science 2016-11-18 Reza Abdolee , Benoit Champagne

In real-time applications the characteristics and properties of a signal vary inconsistently. So, to maintain the integrity of such signals there is a need for effective adaptive filters. The conventional Least Mean Squared(LMS) algorithm…

Signal Processing · Electrical Eng. & Systems 2021-12-01 R Sankara Prasad

To overcome the tradeoff of the conventional normalized least mean square (NLMS) algorithm between fast convergence rate and low steady-state misalignment, this paper proposes a variable step size (VSS) NLMS algorithm by devising a new…

Systems and Control · Computer Science 2015-04-22 Yi Yu , Haiquan Zhao

Broadband wireless channels usually have the sparse nature. Based on the assumption of Gaussian noise model, adaptive filtering algorithms for reconstruction sparse channels were proposed to take advantage of channel sparsity. However,…

Information Theory · Computer Science 2015-02-20 Guan Gui , Li Xu , Wentao Ma , Badong Chen

Sparse linear regression, which entails finding a sparse solution to an underdetermined system of linear equations, can formally be expressed as an $l_0$-constrained least-squares problem. The Orthogonal Least-Squares (OLS) algorithm…

Machine Learning · Statistics 2016-08-01 Abolfazl Hashemi , Haris Vikalo

The least mean-square (LMS) filter is one of the most common adaptive linear estimation algorithms. In many practical scenarios, and particularly in digital communications systems, the signal of interest (SOI) and the input signal are…

Systems and Control · Computer Science 2018-11-28 Nir Shlezinger , Koby Todros

Least mean square (LMS) type adaptive algorithms have attracted much attention due to their low computational complexity. In the scenarios of sparse channel estimation, zero-attracting LMS (ZA-LMS), reweighted ZA-LMS (RZA-LMS) and…

Systems and Control · Computer Science 2015-04-14 Beiyi Liu , Guan Gui , Li Xu

The recursive least-squares algorithm with $\ell_1$-norm regularization ($\ell_1$-RLS) exhibits excellent performance in terms of convergence rate and steady-state error in identification of sparse systems. Nevertheless few works have…

Signal Processing · Electrical Eng. & Systems 2022-02-02 Wei Gao , Jie Chen , Cédric Richard , Wentao Shi , Qunfei Zhang

When the input signal is correlated input signals, and the input and output signal is contaminated by Gaussian noise, the total least squares normalized subband adaptive filter (TLS-NSAF) algorithm shows good performance. However, when it…

Signal Processing · Electrical Eng. & Systems 2023-07-21 Haiquan Zhao , Zian Cao , Yida Chen

Limited by fixed step-size and sparsity penalty factor, the conventional sparsity-aware normalized subband adaptive filtering (NSAF) type algorithms suffer from trade-off requirements of high filtering accurateness and quicker convergence…

Systems and Control · Electrical Eng. & Systems 2024-10-28 Dongxu Liu , Haiquan Zhao , Yang Zhou

The Broad Learning System (BLS) has gained significant attention for its computational efficiency and less network parameters compared to deep learning structures. However, the standard BLS relies on the pseudoinverse solution, which…

Systems and Control · Electrical Eng. & Systems 2025-11-25 Zijing Li

The $L_0$-regularized least squares problem (a.k.a. best subsets) is central to sparse statistical learning and has attracted significant attention across the wider statistics, machine learning, and optimization communities. Recent work has…

Computation · Statistics 2020-01-28 Hussein Hazimeh , Rahul Mazumder

We propose a version of least-mean-square (LMS) algorithm for sparse system identification. Our algorithm called online linearized Bregman iteration (OLBI) is derived from minimizing the cumulative prediction error squared along with an…

Information Theory · Computer Science 2012-10-03 Tao Hu , Dmitri B. Chklovskii