English
Related papers

Related papers: Dictionary LASSO: Guaranteed Sparse Recovery under…

200 papers

The recovery of signals that are sparse not in a basis, but rather sparse with respect to an over-complete dictionary is one of the most flexible settings in the field of compressed sensing with numerous applications. As in the standard…

Information Theory · Computer Science 2021-10-01 Pedro Abdalla , Christian Kümmerle

We consider the problem of estimating the support of a vector $\beta^* \in \mathbb{R}^{p}$ based on observations contaminated by noise. A significant body of work has studied behavior of $\ell_1$-relaxations when applied to measurement…

Machine Learning · Statistics 2008-05-21 Dapo Omidiran , Martin J. Wainwright

In high-dimensional statistical inference in which the number of parameters to be estimated is larger than that of the holding data, regularized linear estimation techniques are widely used. These techniques have, however, some drawbacks.…

Methodology · Statistics 2025-08-06 Takashi Takahashi , Yoshiyuki Kabashima

We describe a probabilistic, {\it sublinear} runtime, measurement-optimal system for model-based sparse recovery problems through dimensionality reducing, {\em dense} random matrices. Specifically, we obtain a linear sketch $u\in \R^M$ of a…

Information Theory · Computer Science 2012-06-22 Anastasios Kyrillidis , Volkan Cevher

The field of compressed sensing has become a major tool in high-dimensional analysis, with the realization that vectors can be recovered from relatively very few linear measurements as long as the vectors lie in a low-dimensional structure,…

Information Theory · Computer Science 2020-04-30 Pete Casazza , Xuemei Chen , Richard Lynch

This paper considers compressed sensing and affine rank minimization in both noiseless and noisy cases and establishes sharp restricted isometry conditions for sparse signal and low-rank matrix recovery. The analysis relies on a key…

Information Theory · Computer Science 2013-10-23 T. Tony Cai , Anru Zhang

A classical problem that arises in numerous signal processing applications asks for the reconstruction of an unknown, $k$-sparse signal $x_0\in R^n$ from underdetermined, noisy, linear measurements $y=Ax_0+z\in R^m$. One standard approach…

Statistics Theory · Mathematics 2015-02-18 Christos Thrampoulidis , Ashkan Panahi , Daniel Guo , Babak Hassibi

This note presents a unified analysis of the recovery of simple objects from random linear measurements. When the linear functionals are Gaussian, we show that an s-sparse vector in R^n can be efficiently recovered from 2s log n…

Information Theory · Computer Science 2012-03-01 Emmanuel Candes , Benjamin Recht

In this paper, we consider the "foreach" sparse recovery problem with failure probability $p$. The goal of which is to design a distribution over $m \times N$ matrices $\Phi$ and a decoding algorithm $\algo$ such that for every…

Data Structures and Algorithms · Computer Science 2013-04-24 Anna C. Gilbert , Hung Q. Ngo , Ely Porat , Atri Rudra , Martin J. Strauss

Most compressed sensing algorithms do not account for the effect of saturation in noisy compressed measurements, though saturation is an important consequence of the limited dynamic range of existing sensors. The few algorithms that handle…

Machine Learning · Computer Science 2021-02-09 Shuvayan Banerjee , Radhe Srivastava , Ajit Rajwade

We have developed an approximate signal recovery algorithm with low computational cost for compressed sensing on the basis of randomly constructed sparse measurement matrices. The law of large numbers and the central limit theorem suggest…

Information Theory · Computer Science 2011-02-21 Yoshiyuki Kabashima , Tadashi Wadayama

Sparse linear regression is one of the most basic questions in machine learning and statistics. Here, we are given as input a design matrix $X \in \mathbb{R}^{N \times d}$ and measurements or labels ${y} \in \mathbb{R}^N$ where ${y} = {X}…

Machine Learning · Computer Science 2025-11-11 Gautam Chandrasekaran , Raghu Meka , Konstantinos Stavropoulos

Noiseless compressive sensing is a protocol that enables undersampling and later recovery of a signal without loss of information. This compression is possible because the signal is usually sufficiently sparse in a given basis. Currently,…

Information Theory · Computer Science 2024-07-22 D. Barbier , C Lucibello , L. Saglietti , F. Krzakala , L. Zdeborova

We study the problem of exact support recovery based on noisy observations and present Refined Least Squares (RLS). Given a set of noisy measurement $$ \myvec{y} = \myvec{X}\myvec{\theta}^* + \myvec{\omega},$$ and $\myvec{X} \in…

Statistics Theory · Mathematics 2021-03-22 Ofir Lindenbaum , Stefan Steinerberger

We investigate the sparse recovery problem of reconstructing a high-dimensional non-negative sparse vector from lower dimensional linear measurements. While much work has focused on dense measurement matrices, sparse measurement schemes are…

Information Theory · Computer Science 2009-02-25 M. Amin Khajehnejad , Alexandros G. Dimakis , Weiyu Xu , Babak Hassibi

Dantzig selector (DS) and LASSO problems have attracted plenty of attention in statistical learning, sparse data recovery and mathematical optimization. In this paper, we provide a theoretical analysis of the sparse recovery stability of…

Statistics Theory · Mathematics 2017-11-13 Yun-Bin Zhao , Duan Li

This paper studies the problem of recovering a signal vector and the corrupted noise vector from a collection of corrupted linear measurements through the solution of a l1 minimization, where the sensing matrix is a partial Fourier matrix…

Information Theory · Computer Science 2016-01-25 Dongcai Su

In this paper, we tackle the compressive phase retrieval problem in the presence of noise. The noisy compressive phase retrieval problem is to recover a $K$-sparse complex signal $s \in \mathbb{C}^n$, from a set of $m$ noisy quadratic…

Information Theory · Computer Science 2016-06-03 Dong Yin , Kangwook Lee , Ramtin Pedarsani , Kannan Ramchandran

We consider a sparse high dimensional regression model where the goal is to recover a $k$-sparse unknown vector $\beta^*$ from $n$ noisy linear observations of the form $Y=X\beta^*+W \in \mathbb{R}^n$ where $X \in \mathbb{R}^{n \times p}$…

Statistics Theory · Mathematics 2019-09-24 David Gamarnik , Ilias Zadik

In this paper, we aim at recovering an unknown signal x0 from noisy L1measurements y=Phi*x0+w, where Phi is an ill-conditioned or singular linear operator and w accounts for some noise. To regularize such an ill-posed inverse problem, we…

Statistics Theory · Mathematics 2013-11-05 Samuel Vaiter , Charles Deledalle , Gabriel Peyré , Charles Dossal , Jalal Fadili