English
Related papers

Related papers: Adaptive Parameters Adjustment for Group Reweighte…

200 papers

This article proposes novel sparsity-aware space-time adaptive processing (SA-STAP) algorithms with $l_1$-norm regularization for airborne phased-array radar applications. The proposed SA-STAP algorithms suppose that a number of samples of…

Information Theory · Computer Science 2013-04-16 Z. Yang , R. C. de Lamare

Sparse penalized quantile regression provides an effective framework for variable selection and robust estimation in high-dimensional data analysis. When ex planatory variables are organized into groups, achieving sparsity both within and…

Computation · Statistics 2026-04-23 Huayan Kou , Yuwen Gu , Yi Lian , Rui Zhang , Jun Fan

The least-absolute shrinkage and selection operator (LASSO) is a regularization technique for estimating sparse signals of interest emerging in various applications and can be efficiently solved via the alternating direction method of…

Information Theory · Computer Science 2022-08-25 Huiyue Yi , Yan Xu , Wuxiong Zhang , Hui Xu

Low-rank and sparse composite approximation is a natural idea to compress Large Language Models (LLMs). However, such an idea faces two primary challenges that adversely affect the performance of existing methods. The first challenge…

Machine Learning · Computer Science 2026-02-27 Changhai Zhou , Qian Qiao , Yuhua Zhou , Yuxin Wu , Shichao Weng , Weizhong Zhang , Cheng Jin

The concepts of sparsity, and regularised estimation, have proven useful in many high-dimensional statistical applications. Dynamic factor models (DFMs) provide a parsimonious approach to modelling high-dimensional time series, however, it…

Methodology · Statistics 2023-03-22 Luke Mosley , Tak-Shing T. Chan , Alex Gibberd

In this paper, we propose a double iteratively reweighted algorithm to solve nonconvex and nonsmooth optimization problems, where both the objectives and constraint functions are formulated by concave compositions to promote group-sparse…

Optimization and Control · Mathematics 2025-11-25 Wanqin Nie , Kai Tu , Minglu Ye , Shuqin Sun

This paper proposes a new leaky least mean square (leaky LMS, LLMS) algorithm in which a norm penalty is introduced to force the solution to be sparse in the application of system identification. The leaky LMS algorithm is derived because…

Systems and Control · Computer Science 2015-03-05 Yong Feng , Rui Zeng , Jiasong Wu

A new Lp-norm constraint least mean square (Lp-LMS) algorithm with new strategy of varying p is presented, which is applied to system identification in this letter. The parameter p is iteratively adjusted by the gradient method applied to…

Systems and Control · Computer Science 2016-03-31 Yong Feng , Fei Chen , Jiasong Wu

We consider the problem of sparse variable selection in nonparametric additive models, with the prior knowledge of the structure among the covariates to encourage those variables within a group to be selected jointly. Previous works either…

Machine Learning · Computer Science 2012-06-22 Junming Yin , Xi Chen , Eric Xing

In this paper, we propose a novel leaky least mean square (leaky LMS, LLMS) algorithm which employs a p-norm-like constraint to force the solution to be sparse in the application of system identification. As an extension of the LMS…

Systems and Control · Computer Science 2015-03-06 Yong Feng , Rui Zeng , Jiasong Wu

Signal reconstruction in compressive sensing involves finding a sparse solution that satisfies a set of linear constraints. Several approaches to this problem have been considered in existing reconstruction algorithms. They each provide a…

Information Theory · Computer Science 2013-03-15 Christian Schou Oxvig , Patrick Steffen Pedersen , Thomas Arildsen , Torben Larsen

Nonnegative matrix factorization (NMF) has become a ubiquitous tool for data analysis. An important variant is the sparse NMF problem which arises when we explicitly require the learnt features to be sparse. A natural measure of sparsity is…

Machine Learning · Computer Science 2013-03-20 Vamsi K. Potluru , Sergey M. Plis , Jonathan Le Roux , Barak A. Pearlmutter , Vince D. Calhoun , Thomas P. Hayes

Nonlinear adaptive filters often show some sparse behavior due to the fact that not all the coefficients are equally useful for the modeling of any nonlinearity. Recently, a class of proportionate algorithms has been proposed for nonlinear…

Signal Processing · Electrical Eng. & Systems 2022-12-16 Danilo Comminiello , Michele Scarpiniti , Simone Scardapane , Luis A. Azpicueta-Ruiz , Aurelio Uncini

Recovery of arbitrarily positioned samples that are missing in sparse signals recently attracted significant research interest. Sparse signals with heavily corrupted arbitrary positioned samples could be analyzed in the same way as…

Information Theory · Computer Science 2013-09-24 Ljubisa Stankovic , Milos Dakovic , Stefan Vujovic

Broadband frequency-selective fading channels usually have the inherent sparse nature. By exploiting the sparsity, adaptive sparse channel estimation (ASCE) algorithms, e.g., least mean square with reweighted L1-norm constraint (LMS-RL1)…

Information Theory · Computer Science 2015-04-29 Guan Gui , Li Xu

In this paper, we propose two novel p-norm penalty least mean square (Lp-LMS) algorithms as supplements of the conventional Lp-LMS algorithm established for sparse adaptive filtering recently. A gradient comparator is employed to…

Systems and Control · Computer Science 2015-03-11 Yong Feng , Jiasong Wu , Rui Zeng , Limin Luo , Huazhong Shu

Based on the methodological similarity between sparse signal reconstruction and system identification, a new approach for sparse signal reconstruction in compressive sensing (CS) is proposed in this paper. This approach employs a stochastic…

Information Theory · Computer Science 2015-06-15 Jian Jin , Yuantao Gu , Shunliang Mei

In this paper, we focus our attention on the high-dimensional double sparse linear regression, that is, a combination of element-wise and group-wise sparsity. To address this problem, we propose an IHT-style (iterative hard thresholding)…

Statistics Theory · Mathematics 2024-12-10 Yanhang Zhang , Zhifan Li , Shixiang Liu , Jianxin Yin

Sparse additive models have attracted much attention in high-dimensional data analysis due to their flexible representation and strong interpretability. However, most existing models are limited to single-level learning under the…

Machine Learning · Computer Science 2026-04-23 Xuelin Zhang , Xinyue Liu , Lingjuan Wu , Hong Chen

This paper proposes a new variable step-size (VSS) scheme for the recently introduced zero-point attracting projection (ZAP) algorithm. The proposed variable step-size ZAPs are based on the gradient of the estimated filter coefficients…

Other Computer Science · Computer Science 2013-12-11 Jianming Liu , Steven L Grant