English
Related papers

Related papers: Information-Theoretic Lower Bounds for Compressive…

200 papers

The goal of compressed sensing is to learn a structured signal $x$ from a limited number of noisy linear measurements $y \approx Ax$. In traditional compressed sensing, "structure" is represented by sparsity in some known basis. Inspired by…

Data Structures and Algorithms · Computer Science 2019-12-09 Akshay Kamath , Sushrut Karmalkar , Eric Price

The goal of compressed sensing is to estimate a vector from an underdetermined system of noisy linear measurements, by making use of prior knowledge on the structure of vectors in the relevant domain. For almost all results in this…

Machine Learning · Statistics 2017-03-10 Ashish Bora , Ajil Jalal , Eric Price , Alexandros G. Dimakis

Compressive phase retrieval is a popular variant of the standard compressive sensing problem in which the measurements only contain magnitude information. In this paper, motivated by recent advances in deep generative models, we provide…

Machine Learning · Statistics 2021-10-19 Zhaoqiang Liu , Subhroshekhar Ghosh , Jonathan Scarlett

The goal of standard 1-bit compressive sensing is to accurately recover an unknown sparse vector from binary-valued measurements, each indicating the sign of a linear function of the vector. Motivated by recent advances in compressive…

Machine Learning · Statistics 2020-06-23 Zhaoqiang Liu , Selwyn Gomes , Avtansh Tiwari , Jonathan Scarlett

Deep generative modeling has led to new and state of the art approaches for enforcing structural priors in a variety of inverse problems. In contrast to priors given by sparsity, deep models can provide direct low-dimensional…

Optimization and Control · Mathematics 2018-12-12 Wen Huang , Paul Hand , Reinhard Heckel , Vladislav Voroninski

In compressed sensing, a small number of linear measurements can be used to reconstruct an unknown signal. Existing approaches leverage assumptions on the structure of these signals, such as sparsity or the availability of a generative…

Machine Learning · Statistics 2018-08-02 Manik Dhar , Aditya Grover , Stefano Ermon

We provide full theoretical guarantees for the convergence behaviour of diffusion-based generative models under the assumption of strongly log-concave data distributions while our approximating class of functions used for score estimation…

Machine Learning · Computer Science 2025-02-18 Stefano Bruno , Ying Zhang , Dong-Young Lim , Ömer Deniz Akyildiz , Sotirios Sabanis

Advances in compressive sensing provided reconstruction algorithms of sparse signals from linear measurements with optimal sample complexity, but natural extensions of this methodology to nonlinear inverse problems have been met with…

Information Theory · Computer Science 2020-08-25 Paul Hand , Oscar Leong , Vladislav Voroninski

This paper explores the problem of generative modeling, aiming to simulate diverse examples from an unknown distribution based on observed examples. While recent studies have focused on quantifying the statistical precision of popular…

Statistics Theory · Mathematics 2024-06-07 Elen Vardanyan , Sona Hunanyan , Tigran Galstyan , Arshak Minasyan , Arnak Dalalyan

In this paper, we study the problem of signal estimation from noisy non-linear measurements when the unknown $n$-dimensional signal is in the range of an $L$-Lipschitz continuous generative model with bounded $k$-dimensional inputs. We make…

Machine Learning · Statistics 2020-10-09 Zhaoqiang Liu , Jonathan Scarlett

In compressive sensing, a small collection of linear projections of a sparse signal contains enough information to permit signal recovery. Distributed compressive sensing (DCS) extends this framework by defining ensemble sparsity models,…

Information Theory · Computer Science 2013-03-29 Marco F. Duarte , Michael B. Wakin , Dror Baron , Shriram Sarvotham , Richard G. Baraniuk

We present a framework for the theoretical analysis of ensembles of low-complexity empirical risk minimisers trained on independent random compressions of high-dimensional data. First we introduce a general distribution-dependent…

Machine Learning · Computer Science 2021-06-03 Henry W. J. Reeve , Ata Kaban

We study the robust one-bit compressed sensing problem whose goal is to design an algorithm that faithfully recovers any sparse target vector $\theta_0\in\mathbb{R}^d$ \textit{uniformly} via $m$ quantized noisy measurements. Specifically,…

Statistics Theory · Mathematics 2020-08-25 Shuang Qiu , Xiaohan Wei , Zhuoran Yang

We characterize the measurement complexity of compressed sensing of signals drawn from a known prior distribution, even when the support of the prior is the entire space (rather than, say, sparse vectors). We show for Gaussian measurements…

Machine Learning · Computer Science 2021-06-23 Ajil Jalal , Sushrut Karmalkar , Alexandros G. Dimakis , Eric Price

This paper studies the approximation and generalization abilities of score-based neural network generative models (SGMs) in estimating an unknown distribution $P_0$ from $n$ i.i.d. observations in $d$ dimensions. Assuming merely that $P_0$…

Machine Learning · Computer Science 2025-10-28 Guoji Fu , Wee Sun Lee

Generative compressed sensing uses the range of a pretrained generator as a nonlinear model for recovering structured signals from limited measurements. We study a conditional version of this problem for image recovery from subsampled…

Machine Learning · Computer Science 2026-05-08 Alexander DeLise , Nick Dexter

In this paper, we consider recovering $n$ dimensional signals from $m$ binary measurements corrupted by noises and sign flips under the assumption that the target signals have low generative intrinsic dimension, i.e., the target signals can…

Machine Learning · Computer Science 2021-11-30 Yuling Jiao , Dingwei Li , Min Liu , Xiangliang Lu , Yuanyuan Yang

Compressed sensing allows perfect recovery of sparse signals (or signals sparse in some basis) using only a small number of random measurements. Existing results in compressed sensing literature have focused on characterizing the achievable…

Information Theory · Computer Science 2015-05-18 Dmitry Malioutov , Sujay Sanghavi , Alan Willsky

We study the recovery of sparse vectors from subsampled random convolutions via $\ell_1$-minimization. We consider the setup in which both the subsampling locations as well as the generating vector are chosen at random. For a subgaussian…

Information Theory · Computer Science 2018-03-28 Shahar Mendelson , Holger Rauhut , Rachel Ward

Deep generative models have become a standard for modeling priors for inverse problems, going beyond classical sparsity-based methods. However, existing theoretical guarantees are mostly confined to finite-dimensional vector spaces,…

Numerical Analysis · Mathematics 2026-03-04 Paolo Angella , Vito Paolo Pastore , Matteo Santacesaria
‹ Prev 1 2 3 10 Next ›