English
Related papers

Related papers: Successive Concave Sparsity Approximation for Comp…

200 papers

The recovery of sparse data is at the core of many applications in machine learning and signal processing. While such problems can be tackled using $\ell_1$-regularization as in the LASSO estimator and in the Basis Pursuit approach,…

Optimization and Control · Mathematics 2021-11-15 Christian Kümmerle , Claudio Mayrink Verdun , Dominik Stöger

The theory of Compressed Sensing (CS) asserts that an unknown signal $x\in\mathbb{R}^p$ can be accurately recovered from an underdetermined set of $n$ linear measurements with $n\ll p$, provided that $x$ is sufficiently sparse. However, in…

Information Theory · Computer Science 2017-09-01 Miles E. Lopes

In this paper, we consider a compressed sensing problem of reconstructing a sparse signal from an undersampled set of noisy linear measurements. The regularized least squares or least absolute shrinkage and selection operator (LASSO)…

Information Theory · Computer Science 2014-10-30 Chao-Kai Wen , Jun Zhang , Kai-Kit Wong , Jung-Chieh Chen , Chau Yuen

We study the sparse phase retrieval problem, which seeks to recover a sparse signal from a limited set of magnitude-only measurements. In contrast to prevalent sparse phase retrieval algorithms that primarily use first-order methods, we…

Information Theory · Computer Science 2024-03-20 Jian-Feng Cai , Yu Long , Ruixue Wen , Jiaxi Ying

We analyze a practical algorithm for sparse PCA on incomplete and noisy data under a general non-random sampling scheme. The algorithm is based on a semidefinite relaxation of the $\ell_1$-regularized PCA problem. We provide theoretical…

Machine Learning · Statistics 2023-02-06 Hanbyul Lee , Qifan Song , Jean Honorio

In this paper, we consider a squared $L_1/L_2$ regularized model for sparse signal recovery from noisy measurements. We first establish the existence of optimal solutions to the model under mild conditions. Next, we propose a proximal…

Optimization and Control · Mathematics 2025-11-10 Na Zhang , Hong Chen , Qia Li , Junpeng Zhou

To strike a balance between energy efficiency and data quality control, this paper proposes a sensor censoring scheme for distributed sparse signal recovery via compressive-sensing based wireless sensor networks. In the proposed approach,…

Information Theory · Computer Science 2018-01-16 Jwo-Yuh Wu , Ming-Hsun Yang , Tsang-Yi Wang

We present a computationally-efficient method for recovering sparse signals from a series of noisy observations, known as the problem of compressed sensing (CS). CS theory requires solving a convex constrained minimization problem. We…

Information Theory · Computer Science 2010-06-22 Avishy Carmi , Pini Gurfil

We prove an L2 recovery bound for a family of sparse estimators defined as minimizers of some empirical loss functions -- which include hinge loss and logistic loss. More precisely, we achieve an upper-bound for coefficients estimation…

Statistics Theory · Mathematics 2019-01-15 Antoine Dedieu

In order to determine the sparse approximation function which has a direct metric relationship with the $\ell_{0}$ quasi-norm, we introduce a wonderful triangle whose sides are composed of $\Vert \mathbf{x} \Vert_{0}$, $\Vert \mathbf{x}…

Information Theory · Computer Science 2024-12-13 Jun Wang

This paper studies sequential methods for recovery of sparse signals in high dimensions. When compared to fixed sample size procedures, in the sparse setting, sequential methods can result in a large reduction in the number of samples…

Information Theory · Computer Science 2014-10-07 Matthew L. Malloy , Robert Nowak

We consider sparsity-based techniques for the approximation of high-dimensional functions from random pointwise evaluations. To date, almost all the works published in this field contain some a priori assumptions about the error corrupting…

Numerical Analysis · Mathematics 2019-05-10 Ben Adcock , Anyi Bao , Simone Brugiapaglia

Motivated by applications such as sparse PCA, in this paper we present provably-accurate one-pass algorithms for the sparse approximation of the top eigenvectors of extremely massive matrices based on a single compact linear sketch. The…

Information Theory · Computer Science 2026-05-06 Edem Boahen , Simone Brugiapaglia , Hung-Hsu Chou , Mark Iwen , Felix Krahmer

In this paper, we study the missing sample recovery problem using methods based on sparse approximation. In this regard, we investigate the algorithms used for solving the inverse problem associated with the restoration of missed samples of…

Machine Learning · Statistics 2017-06-29 Amirhossein Javaheri , Hadi Zayyani , Farokh Marvasti

We investigate a compressive sensing framework in which the sensors introduce a distortion to the measurements in the form of unknown gains. We focus on blind calibration, using measures performed on multiple unknown (but sparse) signals…

Information Theory · Computer Science 2014-08-26 Cagdas Bilen , Gilles Puy , Rémi Gribonval , Laurent Daudet

This work considers recovery of signals that are sparse over two bases. For instance, a signal might be sparse in both time and frequency, or a matrix can be low rank and sparse simultaneously. To facilitate recovery, we consider minimizing…

Information Theory · Computer Science 2012-02-17 Samet Oymak , Babak Hassibi

This paper concerns the problem of 1-bit compressed sensing, where the goal is to estimate a sparse signal from a few of its binary measurements. We study a non-convex sparsity-constrained program and present a novel and concise analysis…

Machine Learning · Computer Science 2020-07-10 Jie Shen

We consider the decomposition of a signal over an overcomplete set of vectors. Minimization of the $\ell^1$-norm of the coefficient vector can often retrieve the sparsest solution (so-called "$\ell^1/\ell^0$-equivalence"), a generally…

Computer Vision and Pattern Recognition · Computer Science 2019-01-10 Chelsea Weaver , Naoki Saito

Compressed sensing (CS) shows that a signal having a sparse or compressible representation can be recovered from a small set of linear measurements. In classical CS theory, the sampling matrix and representation matrix are assumed to be…

Information Theory · Computer Science 2015-07-03 Yipeng Liu

Orthogonal Matching Pursuit and Basis Pursuit are popular reconstruction algorithms for recovery of sparse signals. The exact recovery property of both the methods has a relation with the coherence of the underlying redundant dictionary,…

Optimization and Control · Mathematics 2021-06-10 Pradip Sasmal , Prasad Theeda , Phanindra Jampana , C. S. Sastry