English
Related papers

Related papers: Heavy-Ball-Based Hard Thresholding Algorithms for …

200 papers

In this paper we consider the problem of exact recovery of a fixed sparse vector with the measurement matrices sequentially arriving along with corresponding measurements. We propose an extension of the iterative hard thresholding (IHT)…

Information Theory · Computer Science 2021-03-02 Samrat Mukhopadhyay

Iterative Hard Thresholding (IHT) is a class of projected gradient descent methods for optimizing sparsity-constrained minimization models, with the best known efficiency and scalability in practice. As far as we know, the existing…

Machine Learning · Computer Science 2017-06-22 Bo Liu , Xiao-Tong Yuan , Lezi Wang , Qingshan Liu , Dimitris N. Metaxas

The use of M-estimators in generalized linear regression models in high dimensional settings requires risk minimization with hard $L_0$ constraints. Of the known methods, the class of projected gradient descent (also known as iterative hard…

Machine Learning · Computer Science 2014-10-22 Prateek Jain , Ambuj Tewari , Purushottam Kar

The algorithms based on the technique of optimal $k$-thresholding (OT) were recently proposed for signal recovery, and they are very different from the traditional family of hard thresholding methods. However, the computational cost for…

Information Theory · Computer Science 2022-07-21 Yun-Bin Zhao , Zhi-Quan Luo

Sparse signal recovery is one of the most fundamental problems in various applications, including medical imaging and remote sensing. Many greedy algorithms based on the family of hard thresholding operators have been developed to solve the…

Signal Processing · Electrical Eng. & Systems 2023-06-09 Rachel Grotheer , Shuang Li , Anna Ma , Deanna Needell , Jing Qin

Sparse phase retrieval plays an important role in many fields of applied science and thus attracts lots of attention. In this paper, we propose a \underline{sto}chastic alte\underline{r}nating \underline{m}inimizing method for…

Machine Learning · Statistics 2019-06-17 Jianfeng Cai , Yuling Jiao , Xiliang Lu , Juntao You

Sparse signals can be possibly reconstructed by an algorithm which merges a traditional nonlinear optimization method and a certain thresholding technique. Different from existing thresholding methods, a novel thresholding technique…

Signal Processing · Electrical Eng. & Systems 2021-04-07 Nan Meng , Yun-Bin Zhao

In this paper, we analyze the generalization performance of the Iterative Hard Thresholding (IHT) algorithm widely used for sparse recovery problems. The parameter estimation and sparsity recovery consistency of IHT has long been known in…

Machine Learning · Statistics 2022-03-18 Xiao-Tong Yuan , Ping Li

We propose a new iterative greedy algorithm for reconstructions of sparse signals with or without noisy perturbations in compressed sensing. The proposed algorithm, called \emph{subspace thresholding pursuit} (STP) in this paper, is a…

Information Theory · Computer Science 2014-05-22 Chao-Bing Song , Shu-Tao Xia , Xin-Ji Liu

This paper introduces recovery thresholding hyperinterpolations, a novel class of methods for sparse signal reconstruction in the presence of noise. We develop a framework that integrates thresholding operators--including hard thresholding,…

Numerical Analysis · Mathematics 2025-07-25 Congpei An , Jiashu Ran

Hard Thresholding Pursuit (HTP) has aroused increasing attention for its robust theoretical guarantees and impressive numerical performance in non-convex optimization. In this paper, we introduce a novel tuning-free procedure, named…

Statistics Theory · Mathematics 2025-01-07 Yanhang Zhang , Zhifan Li , Shixiang Liu , Xueqin Wang , Jianxin Yin

It is well known that $\ell_1$ minimization can be used to recover sufficiently sparse unknown signals from compressed linear measurements. In fact, exact thresholds on the sparsity, as a function of the ratio between the system dimensions,…

Information Theory · Computer Science 2011-11-08 M. Amin Khajehnejad , Weiyu Xu , A. Salman Avestimehr , Babak Hassibi

In this paper, we present modifications of the iterative hard thresholding (IHT) method for recovery of jointly row-sparse and low-rank matrices. In particular a Riemannian version of IHT is considered which significantly reduces…

Optimization and Control · Mathematics 2022-10-03 Henrik Eisenmann , Felix Krahmer , Max Pfeffer , André Uschmajew

Nonnegative sparse signal recovery has been extensively studied due to its broad applications. Recent work has integrated rectified linear unit (ReLU) techniques to enhance existing recovery algorithms. We merge Newton-type thresholding…

Signal Processing · Electrical Eng. & Systems 2026-02-19 Ning Bian , Zhong-Feng Sun , Yun-Bin Zhao , Jin-Chuan Zhou , Nan Meng

We consider the problem of recovering signals from their power spectral density. This is a classical problem referred to in literature as the phase retrieval problem, and is of paramount importance in many fields of applied sciences. In…

Information Theory · Computer Science 2013-11-12 Kishore Jaganathan , Samet Oymak , Babak Hassibi

In this note, we analyze an iterative soft / hard thresholding algorithm with homotopy continuation for recovering a sparse signal $x^\dag$ from noisy data of a noise level $\epsilon$. Under suitable regularity and sparsity conditions, we…

Numerical Analysis · Mathematics 2017-05-24 Yuling Jiao , Bangti Jin , Xiliang Lu

We study the sparse phase retrieval problem, which seeks to recover a sparse signal from a limited set of magnitude-only measurements. In contrast to prevalent sparse phase retrieval algorithms that primarily use first-order methods, we…

Information Theory · Computer Science 2024-03-20 Jian-Feng Cai , Yu Long , Ruixue Wen , Jiaxi Ying

Compressed sensing is a technique to sample compressible signals below the Nyquist rate, whilst still allowing near optimal reconstruction of the signal. In this paper we present a theoretical analysis of the iterative hard thresholding…

Information Theory · Computer Science 2008-05-06 Thomas Blumensath , Mike E. Davies

Sparse signal recovery from a small number of random measurements is a well known NP-hard to solve combinatorial optimization problem, with important applications in signal and image processing. The standard approach to the sparse signal…

Data Analysis, Statistics and Probability · Physics 2013-04-09 M. Andrecut

Solving sparse recovery problem with high oversampling ratio is hard. We show that it is theoretically possible and we propose two modified HTP algorithms with such performances.

Numerical Analysis · Mathematics 2017-06-27 Wenbin Zhang