English
Related papers

Related papers: Dynamic Sample Complexity for Exact Sparse Recover…

200 papers

We introduce an efficient implementation of sparse recovery methods for the problem of harmonic estimation with 2D sparse arrays using a single snapshot. By imposing a uniformity constraint on the harmonic grids of the subdictionaries used…

Signal Processing · Electrical Eng. & Systems 2025-09-18 Youval Klioui

A noisy underdetermined system of linear equations is considered in which a sparse vector (a vector with a few nonzero elements) is subject to measurement. The measurement matrix elements are drawn from a Gaussian distribution. We study the…

Information Theory · Computer Science 2014-06-26 Behrooz Kamary Aliabadi , Silèye Ba

Matrix completion problem has been previously studied under various adaptive and passive settings. Previously, researchers have proposed passive, two-phase and single-phase algorithms using coherence parameter, and multi phase algorithm…

Machine Learning · Computer Science 2022-03-17 Ilqar Ramazanli

Line spectral estimation theory aims to estimate the off-the-grid spectral components of a time signal with optimal precision. Recent results have shown that it is possible to recover signals having sparse line spectra from few temporal…

Information Theory · Computer Science 2017-01-31 Maxime Ferreira Da Costa , Wei Dai

Phase retrieval (PR) is a popular research topic in signal processing and machine learning. However, its performance degrades significantly when the measurements are corrupted by noise or outliers. To address this limitation, we propose a…

Optimization and Control · Mathematics 2025-05-30 Jun Fan , Ailing Yan , Xianchao Xiu , Wanquan Liu

In this paper we consider estimation of sparse covariance matrices and propose a thresholding procedure which is adaptive to the variability of individual entries. The estimators are fully data driven and enjoy excellent performance both…

Methodology · Statistics 2011-02-14 Tony Cai , Weidong Liu

We study --both in theory and practice-- the use of momentum motions in classic iterative hard thresholding (IHT) methods. By simply modifying plain IHT, we investigate its convergence behavior on convex optimization criteria with…

Optimization and Control · Mathematics 2019-09-17 Rajiv Khanna , Anastasios Kyrillidis

Multistage design has been used in a wide range of scientific fields. By allocating sensing resources adaptively, one can effectively eliminate null locations and localize signals with a smaller study budget. We formulate a…

Methodology · Statistics 2024-06-17 Weinan Wang , Bowen Gang , Wenguang Sun

In recent years, unfolding iterative algorithms as neural networks has become an empirical success in solving sparse recovery problems. However, its theoretical understanding is still immature, which prevents us from fully utilizing the…

Machine Learning · Computer Science 2018-11-06 Xiaohan Chen , Jialin Liu , Zhangyang Wang , Wotao Yin

We consider the problem of reconstructing an infinite set of sparse, finite-dimensional vectors, that share a common sparsity pattern, from incomplete measurements. This is in contrast to the work [17], where the single vector signal can be…

Optimization and Control · Mathematics 2021-11-29 Nick Dexter , Hoang Tran , Clayton Webster

Orthogonal matching pursuit (OMP) is a greedy algorithm widely used for the recovery of sparse signals from compressed measurements. In this paper, we analyze the number of iterations required for the OMP algorithm to perform exact recovery…

Information Theory · Computer Science 2016-02-23 Jian Wang , Byonghyo Shim

It is known that certain structures of the signal in addition to the standard notion of sparsity (called structured sparsity) can improve the sample complexity in several compressive sensing applications. Recently, Hegde et al. proposed a…

Information Theory · Computer Science 2017-01-23 Lingxiao Huang , Yifei Jin , Jian Li , Haitao Wang

Best subset selection (BSS) is widely known as the holy grail for high-dimensional variable selection. Nevertheless, the notorious NP-hardness of BSS substantially restricts its practical application and also discourages its theoretical…

Methodology · Statistics 2021-08-27 Yongyi Guo , Ziwei Zhu , Jianqing Fan

We analyze continuous-time mirror descent applied to sparse phase retrieval, which is the problem of recovering sparse signals from a set of magnitude-only measurements. We apply mirror descent to the unconstrained empirical risk…

Machine Learning · Statistics 2020-10-21 Fan Wu , Patrick Rebeschini

Numerous practical medical problems often involve data that possess a combination of both sparse and non-sparse structures. Traditional penalized regularizations techniques, primarily designed for promoting sparsity, are inadequate to…

Methodology · Statistics 2023-11-10 Shun Yu , Yuehan Yang

In this paper, we address the challenging problem of selecting tuning parameters for high-dimensional sparse regression. We propose a simple and computationally efficient method, called path thresholding (PaTh), that transforms any tuning…

Statistics Theory · Mathematics 2014-02-25 Divyanshu Vats , Richard G. Baraniuk

Stochastic processes are often used to model complex scientific problems in fields ranging from biology and finance to engineering and physical science. This paper investigates rate-optimal estimation of the volatility matrix of a…

Statistics Theory · Mathematics 2014-01-30 Minjing Tao , Yazhen Wang , Harrison H. Zhou

Sparse Inverse Covariance Estimation (SICE) is useful in many practical data analyses. Recovering the connectivity, non-connectivity graph of covariates is classified amongst the most important data mining and learning problems. In this…

Machine Learning · Computer Science 2019-04-05 Ashkan Esmaeili , Farokh Marvasti

We study the problem of exact support recovery for high-dimensional sparse linear regression under independent Gaussian design when the signals are weak, rare, and possibly heterogeneous. Under a suitable scaling of the sample size and…

Statistics Theory · Mathematics 2023-07-19 Saptarshi Roy , Ambuj Tewari , Ziwei Zhu

We address the problem of sparse recovery using greedy compressed sensing recovery algorithms, without explicit knowledge of the sparsity. Estimating the sparsity order is a crucial problem in many practical scenarios, e.g., wireless…

Information Theory · Computer Science 2022-10-26 Samrat Mukhopadhyay , Himanshu Bhusan Mishra