English
Related papers

Related papers: Dynamic Sample Complexity for Exact Sparse Recover…

200 papers

Iterative algorithms based on thresholding, feedback and null space tuning (NST+HT+FB) for sparse signal recovery are exceedingly effective and fast, particularly for large scale problems. The core algorithm is shown to converge in finitely…

Numerical Analysis · Mathematics 2017-11-08 Ningning Han , Shidong Li , Zhanjie Song , Hong Wang

Compressed sensing has been a very successful high-dimensional signal acquisition and recovery technique that relies on linear operations. However, the actual measurements of signals have to be quantized before storing or processing.…

Information Theory · Computer Science 2026-01-09 Namiko Matsumoto , Arya Mazumdar

A major enterprise in compressed sensing and sparse approximation is the design and analysis of computationally tractable algorithms for recovering sparse, exact or approximate, solutions of underdetermined linear systems of equations. Many…

Information Theory · Computer Science 2010-04-13 Jeffrey D. Blanchard , Coralia Cartis , Jared Tanner , Andrew Thompson

Quadratic regression involves modeling the response as a (generalized) linear function of not only the features $x^{j_1}$ but also of quadratic terms $x^{j_1}x^{j_2}$. The inclusion of such higher-order "interaction terms" in regression…

Machine Learning · Computer Science 2019-11-11 Shuo Yang , Yanyao Shen , Sujay Sanghavi

In this article we study the problem of signal recovery for group models. More precisely for a given set of groups, each containing a small subset of indices, and for given linear sketches of the true signal vector which is known to be…

Optimization and Control · Mathematics 2020-02-28 Bubacarr Bah , Jannis Kurtz , Oliver Schaudt

Matrix recovery from sparse observations is an extensively studied topic emerging in various applications, such as recommendation system and signal processing, which includes the matrix completion and compressed sensing models as special…

Methodology · Statistics 2026-04-13 Ziyuan Chen , Ying Yang , Fang Yao

The hard thresholding technique plays a vital role in the development of algorithms for sparse signal recovery. By merging this technique and heavy-ball acceleration method which is a multi-step extension of the traditional gradient descent…

Information Theory · Computer Science 2022-04-21 Zhong-Feng Sun , Jin-Chuan Zhou , Yun-Bin Zhao , Nan Meng

In this paper, we focus our attention on the high-dimensional double sparse linear regression, that is, a combination of element-wise and group-wise sparsity. To address this problem, we propose an IHT-style (iterative hard thresholding)…

Statistics Theory · Mathematics 2024-12-10 Yanhang Zhang , Zhifan Li , Shixiang Liu , Jianxin Yin

We develop mask iterative hard thresholding algorithms (mask IHT and mask DORE) for sparse image reconstruction of objects with known contour. The measurements follow a noisy underdetermined linear model common in the compressive sampling…

Machine Learning · Statistics 2011-12-05 Aleksandar Dogandzic , Renliang Gu , Kun Qiu

Compressed sensing (CS) or sparse signal reconstruction (SSR) is a signal processing technique that exploits the fact that acquired data can have a sparse representation in some basis. One popular technique to reconstruct or approximate the…

Information Theory · Computer Science 2014-05-08 Esa Ollila , Hyon-Jung Kim , Visa Koivunen

Hard Thresholding Pursuit (HTP) is an iterative greedy selection procedure for finding sparse solutions of underdetermined linear systems. This method has been shown to have strong theoretical guarantee and impressive numerical performance.…

Machine Learning · Computer Science 2013-11-26 Xiao-Tong Yuan , Ping Li , Tong Zhang

Sparse recovery is one of the most fundamental and well-studied inverse problems. Standard statistical formulations of the problem are provably solved by general convex programming techniques and more practical, fast (nearly-linear time)…

Data Structures and Algorithms · Computer Science 2022-03-09 Jonathan A. Kelner , Jerry Li , Allen Liu , Aaron Sidford , Kevin Tian

We consider the problem of in-network compressed sensing from distributed measurements. Every agent has a set of measurements of a signal $x$, and the objective is for the agents to recover $x$ from their collective measurements using only…

Information Theory · Computer Science 2015-06-17 Stacy Patterson , Yonina C. Eldar , Idit Keidar

We propose and analyze a solution to the problem of recovering a block sparse signal with sparse blocks from linear measurements. Such problems naturally emerge inter alia in the context of mobile communication, in order to meet the…

Information Theory · Computer Science 2020-09-23 Ingo Roth , Martin Kliesch , Axel Flinth , Gerhard Wunder , Jens Eisert

This paper studies the problem of Simultaneous Sparse Approximation (SSA). This problem arises in many applications which work with multiple signals maintaining some degree of dependency such as radar and sensor networks. In this paper, we…

Information Theory · Computer Science 2023-04-04 Sahar Sadrizadeh , Shahrzad Kiani , Mahdi Boloursaz , Farokh Marvasti

An accelerated class of adaptive scheme of iterative thresholding algorithms is studied analytically and empirically. They are based on the feedback mechanism of the null space tuning techniques (NST+HT+FB). The main contribution of this…

Information Theory · Computer Science 2020-05-15 Ningning Han , Shidong Li , Zhanjie Song

In this note, we analyze an iterative soft / hard thresholding algorithm with homotopy continuation for recovering a sparse signal $x^\dag$ from noisy data of a noise level $\epsilon$. Under suitable regularity and sparsity conditions, we…

Numerical Analysis · Mathematics 2017-05-24 Yuling Jiao , Bangti Jin , Xiliang Lu

Nonconvex sparse learning plays an essential role in many areas, such as signal processing and deep network compression. Iterative hard thresholding (IHT) methods are the state-of-the-art for nonconvex sparse learning due to their…

Machine Learning · Computer Science 2021-01-05 Qianqian Tong , Guannan Liang , Tan Zhu , Jinbo Bi

Modern scientific instruments produce vast amounts of data, which can overwhelm the processing ability of computer systems. Lossy compression of data is an intriguing solution, but comes with its own drawbacks, such as potential signal…

In this paper, we consider the problem of compressed sensing where the goal is to recover almost all the sparse vectors using a small number of fixed linear measurements. For this problem, we propose a novel partial hard-thresholding…

Information Theory · Computer Science 2011-06-15 Prateek Jain , Ambuj Tewari , Inderjit S. Dhillon