English
Related papers

Related papers: The Overlap Gap Property in Principal Submatrix Re…

200 papers

This work explores the fundamental problem of the recoverability of a sparse tensor being reconstructed from its compressed embodiment. We present a generalized model of block-sparse tensor recovery as a theoretical foundation, where…

Signal Processing · Electrical Eng. & Systems 2024-12-19 Liyang Lu , Zhaocheng Wang , Zhen Gao , Sheng Chen , H. Vincent Poor

Sparse recovery is one of the most fundamental and well-studied inverse problems. Standard statistical formulations of the problem are provably solved by general convex programming techniques and more practical, fast (nearly-linear time)…

Data Structures and Algorithms · Computer Science 2022-03-09 Jonathan A. Kelner , Jerry Li , Allen Liu , Aaron Sidford , Kevin Tian

This paper demonstrates theoretically that if the restricted isometry constant $\delta_K$ of the compressed sensing matrix satisfies $$ \delta_{K+1} < \frac{1}{\sqrt{K}+1}, $$ then a greedy algorithm called Orthogonal Matching Pursuit (OMP)…

Information Theory · Computer Science 2012-01-17 Qun Mo , Yi Shen

In multivariate regression, a $K$-dimensional response vector is regressed upon a common set of $p$ covariates, with a matrix $B^*\in\mathbb{R}^{p\times K}$ of regression coefficients. We study the behavior of the multivariate group Lasso,…

Machine Learning · Statistics 2011-03-08 Guillaume Obozinski , Martin J. Wainwright , Michael I. Jordan

We study quantum sparse recovery in non-orthogonal, overcomplete dictionaries: given coherent quantum access to a state and a dictionary of vectors, the goal is to reconstruct the state up to $\ell_2$ error using as few vectors as possible.…

Quantum Physics · Physics 2025-10-09 Armando Bellante , Stefano Vanerio , Stefano Zanero

Motivated by recent results in the statistical physics of spin glasses, we study the recovery of a sparse vector $\mathbf{x}_0\in \mathbb{S}^{n-1}$, $\|\mathbf{x}_0\|_{\ell_0} = k<n$, from $m$ quadratic measurements of the form $…

Information Theory · Computer Science 2023-11-01 Augustin Cosse

This paper demonstrates that if the restricted isometry constant $\delta_{K+1}$ of the measurement matrix $A$ satisfies $$ \delta_{K+1} < \frac{1}{\sqrt{K}+1}, $$ then a greedy algorithm called Orthogonal Matching Pursuit (OMP) can recover…

Information Theory · Computer Science 2012-01-16 Qun Mo , Yi Shen

We consider the problem of recovering sparse vectors from underdetermined linear measurements via $\ell_p$-constrained basis pursuit. Previous analyses of this problem based on generalized restricted isometry properties have suggested that…

Information Theory · Computer Science 2015-04-21 Sjoerd Dirksen , Guillaume Lecué , Holger Rauhut

The problem of consistently estimating the sparsity pattern of a vector $\betastar \in \real^\mdim$ based on observations contaminated by noise arises in various contexts, including subset selection in regression, structure estimation in…

Statistics Theory · Mathematics 2007-07-13 Martin J. Wainwright

In this paper, we consider the "foreach" sparse recovery problem with failure probability $p$. The goal of which is to design a distribution over $m \times N$ matrices $\Phi$ and a decoding algorithm $\algo$ such that for every…

Data Structures and Algorithms · Computer Science 2013-04-24 Anna C. Gilbert , Hung Q. Ngo , Ely Porat , Atri Rudra , Martin J. Strauss

We consider the algorithmic problem of finding a near-optimal solution for the number partitioning problem (NPP). The NPP appears in many applications, including the design of randomized controlled trials, multiprocessor scheduling, and…

Statistics Theory · Mathematics 2021-03-03 David Gamarnik , Eren C. Kızıldağ

Low-rank matrix recovery can be solved to statistical optimality by convex matrix optimization under the classical assumption of restricted isometry property (RIP). However, for large problems, the convex formulation is commonly replaced by…

Optimization and Control · Mathematics 2026-04-22 Andrew D. McRae , Richard Y. Zhang

In this paper, we study the orthogonal least squares (OLS) algorithm for sparse recovery. On the one hand, we show that if the sampling matrix $\mathbf{A}$ satisfies the restricted isometry property (RIP) of order $K + 1$ with isometry…

Information Theory · Computer Science 2017-10-11 Jinming Wen , Jian Wang , Qinyu Zhang

We give lower bounds for the problem of stable sparse recovery from /adaptive/ linear measurements. In this problem, one would like to estimate a vector $x \in \R^n$ from $m$ linear measurements $A_1x,..., A_mx$. One may choose each vector…

Data Structures and Algorithms · Computer Science 2012-10-23 Eric Price , David P. Woodruff

This paper considers the problem of recovering an unknown sparse p\times p matrix X from an m\times m matrix Y=AXB^T, where A and B are known m \times p matrices with m << p. The main result shows that there exist constructions of the…

Information Theory · Computer Science 2013-03-27 Gautam Dasarathy , Parikshit Shah , Badri Narayan Bhaskar , Robert Nowak

The paper explores the problem of \emph{spectral compressed sensing}, which aims to recover a spectrally sparse signal from a small random subset of its $n$ time domain samples. The signal of interest is assumed to be a superposition of $r$…

Information Theory · Computer Science 2015-01-05 Yuxin Chen , Yuejie Chi

In the general submatrix detection problem, the task is to detect the presence of a small $k \times k$ submatrix with entries sampled from a distribution $\mathcal{P}$ in an $n \times n$ matrix of samples from $\mathcal{Q}$. This…

Statistics Theory · Mathematics 2019-06-04 Matthew Brennan , Guy Bresler , Wasim Huleihel

Subspace recovery from corrupted and missing data is crucial for various applications in signal processing and information theory. To complete missing values and detect column corruptions, existing robust Matrix Completion (MC) methods…

Information Theory · Computer Science 2016-11-18 Hongyang Zhang , Zhouchen Lin , Chao Zhang

We study a matrix recovery problem with unknown correspondence: given the observation matrix $M_o=[A,\tilde P B]$, where $\tilde P$ is an unknown permutation matrix, we aim to recover the underlying matrix $M=[A,B]$. Such problem commonly…

Machine Learning · Computer Science 2021-10-19 Zhiwei Tang , Tsung-Hui Chang , Xiaojing Ye , Hongyuan Zha

Given a data set of size $n$ in $d'$-dimensional Euclidean space, the $k$-means problem asks for a set of $k$ points (called centers) so that the sum of the $\ell_2^2$-distances between points of a given data set of size $n$ and the set of…

Data Structures and Algorithms · Computer Science 2021-06-01 Anamay Chaturvedi , Matthew Jones , Huy L. Nguyen