English
Related papers

Related papers: Upper Bounds on the Error of Sparse Vector and Low…

200 papers

The effectiveness of using model sparsity as a priori information when solving linear inverse problems is studied. We investigate the reconstruction quality of such a method in the non-idealized case and compute some typical recovery errors…

Numerical Analysis · Mathematics 2010-07-19 Ignace Loris , Caroline Verhoeven

For the first time, some hypersingular nonlinear boundary-value problems with a small parameter~$\varepsilon$ at the highest derivative are described. These problems essentially (qualitatively and quantitatively) differ from the usual…

Analysis of PDEs · Mathematics 2018-02-14 Andrei D. Polyanin , Inna K. Shingareva

The problem of signal recovery from the autocorrelation, or equivalently, the magnitudes of the Fourier transform, is of paramount importance in various fields of engineering. In this work, for one-dimensional signals, we give conditions,…

Information Theory · Computer Science 2012-06-08 Kishore Jaganathan , Samet Oymak , Babak Hassibi

Recovering sparse vectors and low-rank matrices from noisy linear measurements has been the focus of much recent research. Various reconstruction algorithms have been studied, including $\ell_1$ and nuclear norm minimization as well as…

Optimization and Control · Mathematics 2011-11-10 Samet Oymak , Karthik Mohan , Maryam Fazel , Babak Hassibi

Matrix Completion is the problem of recovering an unknown real-valued low-rank matrix from a subsample of its entries. Important recent results show that the problem can be solved efficiently under the assumption that the unknown matrix is…

Computational Complexity · Computer Science 2014-04-11 Moritz Hardt , Raghu Meka , Prasad Raghavendra , Benjamin Weitz

This paper deals with the following question: Suppose that there exist an integer or a non-negative integer solution $x$ to a system $Ax = b$, where the number of non-zero components of $x$ is $n$. The target is, for a given natural number…

Optimization and Control · Mathematics 2026-02-12 Stefan Kuhlmann , Timm Oertel , Robert Weismantel

Recent work has generalized several results concerning the well-understood spiked Wigner matrix model of a low-rank signal matrix corrupted by additive i.i.d. Gaussian noise to the inhomogeneous case, where the noise has a variance profile.…

Statistics Theory · Mathematics 2025-10-10 Debsurya De , Dmitriy Kunisky

The well-known trace reconstruction problem is the problem of inferring an unknown source string $x \in \{0,1\}^n$ from independent "traces", i.e. copies of $x$ that have been corrupted by a $\delta$-deletion channel which independently…

Data Structures and Algorithms · Computer Science 2022-11-08 Xi Chen , Anindya De , Chin Ho Lee , Rocco A. Servedio , Sandip Sinha

Recovery of support of a sparse vector from simple measurements is a widely-studied problem, considered under the frameworks of compressed sensing, 1-bit compressed sensing, and more general single index models. We consider generalizations…

Machine Learning · Statistics 2021-11-05 Venkata Gandikota , Arya Mazumdar , Soumyabrata Pal

We give upper bounds for the determinant of an $n\times n$ zero-one matrix containing $kn$ ones for integral $k$. Our results improve upon a result of Ryser for $k=o(n^{1/3})$. For fixed $k\ge 3$ it was an open question whether Hadamard's…

Combinatorics · Mathematics 2019-03-04 Daniel Scheinerman

The problem of consistently estimating the sparsity pattern of a vector $\betastar \in \real^\mdim$ based on observations contaminated by noise arises in various contexts, including subset selection in regression, structure estimation in…

Statistics Theory · Mathematics 2007-07-13 Martin J. Wainwright

We study sparse principal components analysis in the high-dimensional setting, where $p$ (the number of variables) can be much larger than $n$ (the number of observations). We prove optimal, non-asymptotic lower and upper bounds on the…

Machine Learning · Statistics 2012-02-07 Vincent Q. Vu , Jing Lei

We define and solve classes of sparse matrix problems that arise in multilevel modeling and data analysis. The classes are indexed by the number of nested units, with two-level problems corresponding to the common situation in which data on…

Statistics Theory · Mathematics 2020-03-13 Tui H. Nolan , Matt P. Wand

We propose an algebraic combinatorial method for solving large sparse linear systems of equations locally - that is, a method which can compute single evaluations of the signal without computing the whole signal. The method scales only in…

Statistics Theory · Mathematics 2014-03-05 Franz J Király , Louis Theran

Given an observation $\mathbf Y \in \mathbb{R}^{d_1\times d_2}$ from the model $\mathbf Y = \mathbf X + \mathbf E$ where $\mathbf X$ is constant and $\mathbf E$ has i.i.d. $N(0,1)$ entries, we consider the problem of detecting a planted…

Statistics Theory · Mathematics 2026-05-20 Parker Knight , Julien Chhor

Is it possible to find the sparsest vector (direction) in a generic subspace $\mathcal{S} \subseteq \mathbb{R}^p$ with $\mathrm{dim}(\mathcal{S})= n < p$? This problem can be considered a homogeneous variant of the sparse recovery problem,…

Information Theory · Computer Science 2016-09-21 Qing Qu , Ju Sun , John Wright

Sparse coding or sparse dictionary learning has been widely used to recover underlying structure in many kinds of natural data. Here, we provide conditions guaranteeing when this recovery is universal; that is, when sparse codes and…

Neurons and Cognition · Quantitative Biology 2016-11-18 Christopher J. Hillar , Friedrich T. Sommer

The task of recovering a low-rank matrix from its noisy linear measurements plays a central role in computational science. Smooth formulations of the problem often exhibit an undesirable phenomenon: the condition number, classically…

Optimization and Control · Mathematics 2019-04-24 Vasileios Charisopoulos , Yudong Chen , Damek Davis , Mateo Díaz , Lijun Ding , Dmitriy Drusvyatskiy

The estimation of a sparse vector in the linear model is a fundamental problem in signal processing, statistics, and compressive sensing. This paper establishes a lower bound on the mean-squared error, which holds regardless of the…

Information Theory · Computer Science 2013-03-04 Emmanuel J. Candès , Mark A. Davenport

We prove an L2 recovery bound for a family of sparse estimators defined as minimizers of some empirical loss functions -- which include hinge loss and logistic loss. More precisely, we achieve an upper-bound for coefficients estimation…

Statistics Theory · Mathematics 2019-01-15 Antoine Dedieu