English
Related papers

Related papers: A Trivial Observation related to Sparse Recovery

200 papers

In this paper, we discuss application of iterative Stochastic Optimization routines to the problem of sparse signal recovery from noisy observation. Using Stochastic Mirror Descent algorithm as a building block, we develop a multistage…

Machine Learning · Statistics 2022-03-31 Anatoli Juditsky , Andrei Kulunchakov , Hlib Tsyntseus

This work explores the fundamental problem of the recoverability of a sparse tensor being reconstructed from its compressed embodiment. We present a generalized model of block-sparse tensor recovery as a theoretical foundation, where…

Signal Processing · Electrical Eng. & Systems 2024-12-19 Liyang Lu , Zhaocheng Wang , Zhen Gao , Sheng Chen , H. Vincent Poor

Hard thresholding pursuit (HTP) is a recently proposed iterative sparse recovery algorithm which is a result of combination of a support selection step from iterated hard thresholding (IHT) and an estimation step from the orthogonal…

Information Theory · Computer Science 2020-06-03 Samrat Mukhopadhyay , Mrityunjoy Chakraborty

The performance of Large Language Models (LLMs) is increasingly governed by data efficiency rather than raw scaling volume. However, existing selection methods often decouple global distribution balancing from local instance selection,…

Computation and Language · Computer Science 2026-03-03 Changhao Wang , Jiaolong Yang , Xinhao Yao , Yunfei Yu , Peng Jiao , Lu Yu , Junpeng Fang , Riccardo Cantoro , Qing Cui , Jun Zhou

Applying the theory of compressive sensing in practice always takes different kinds of perturbations into consideration. In this paper, the recovery performance of greedy pursuits with replacement for sparse recovery is analyzed when both…

Information Theory · Computer Science 2015-06-04 Laming Chen , Yuantao Gu

This paper proposes a verification-based decoding approach for reconstruction of a sparse signal with incremental sparse measurements. In its first step, the verification-based decoding algorithm is employed to reconstruct the signal with a…

Information Theory · Computer Science 2013-02-12 Xiaofu Wu , Zhen Yang , Lu Gan

Structured prediction requires searching over a combinatorial number of structures. To tackle it, we introduce SparseMAP: a new method for sparse structured inference, and its natural loss function. SparseMAP automatically selects only a…

Machine Learning · Statistics 2018-06-21 Vlad Niculae , André F. T. Martins , Mathieu Blondel , Claire Cardie

We consider the problem of constructing a linear map from a Hilbert space $\mathcal{H}$ (possibly infinite dimensional) to $\mathbb{R}^m$ that satisfies a restricted isometry property (RIP) on an arbitrary signal model $\mathcal{S} \subset…

Information Theory · Computer Science 2017-01-18 Gilles Puy , Mike Davies , Rémi Gribonval

This paper considers approximately sparse signal and low-rank matrix's recovery via truncated norm minimization $\min_{x}\|x_T\|_q$ and $\min_{X}\|X_T\|_{S_q}$ from noisy measurements. We first introduce truncated sparse approximation…

Information Theory · Computer Science 2021-05-28 Wengu Chen , Peng Li

Efficient algorithms for the sparse solution of under-determined linear systems $Ax = b$ are known for matrices $A$ satisfying suitable assumptions like the restricted isometry property (RIP). Without such assumptions little is known and…

Machine Learning · Computer Science 2021-01-22 G. Welper

We give a suitable RI-Property under which recent results for trace regression translate into strong risk bounds for multivariate regression. This pseudo-RIP is compatible with the setting $n < p$.

Statistics Theory · Mathematics 2011-06-30 Christophe Giraud

In the field of compressed sensing, a key problem remains open: to explicitly construct matrices with the restricted isometry property (RIP) whose performance rivals those generated using random matrix theory. In short, RIP involves…

Functional Analysis · Mathematics 2012-10-02 Matthew Fickus , John Jasper , Dustin G. Mixon , Jesse Peterson

We study the information-theoretic limits of exactly recovering the support of a sparse signal using noisy projections defined by various classes of measurement matrices. Our analysis is high-dimensional in nature, in which the number of…

Statistics Theory · Mathematics 2008-06-04 Wei Wang , Martin J. Wainwright , Kannan Ramchandran

Greedy algorithms for minimizing L0-norm of sparse decomposition have profound application impact on many signal processing problems. In the sparse coding setup, given the observations $\mathrm{y}$ and the redundant dictionary…

Numerical Analysis · Computer Science 2015-02-13 Yuanyi Xue , Yao Wang

Motivated by the well-known Papoulis-Gerchberg algorithm, an iterative thresholding algorithm for recovery of sparse signals from few observations is proposed. The sequence of iterates turns out to be similar to that of the thresholded…

Information Theory · Computer Science 2009-02-13 M. H. Kayvanrad , D. Zonoobi , A. A. Kassim

In this study, we introduce a novel model, termed the Weighted Basis Pursuit Dequantization ($\omega$-BPDQ$_p$), which incorporates prior support information by assigning weights on the $\ell_1$ norm in the $\ell_1$ minimization process and…

Signal Processing · Electrical Eng. & Systems 2024-10-25 Xiaotong Liu , Yiyu Liang

We consider the problem of recovering a partially sparse solution of an underdetermined system of linear equations by minimizing the $\ell_1$-norm of the part of the solution vector which is known to be sparse. Such a problem is closely…

Information Theory · Computer Science 2013-04-11 Afonso S. Bandeira , Katya Scheinberg , Luis Nunes Vicente

Sparse signals (i.e., vectors with a small number of non-zero entries) build the foundation of most kernel (or nullspace) results, uncertainty relations, and recovery guarantees in the sparse signal processing and compressive sensing…

Information Theory · Computer Science 2015-07-13 Christoph Studer

One of the key issues in the acquisition of sparse data by means of compressed sensing (CS) is the design of the measurement matrix. Gaussian matrices have been proven to be information-theoretically optimal in terms of minimizing the…

Information Theory · Computer Science 2018-11-26 Ahmed Elzanaty , Andrea Giorgetti , Marco Chiani

Persistent homology of the Rips filtration allows to track topological features of a point cloud over scales, and is a foundational tool of topological data analysis. Unfortunately, the Rips-filtration is exponentially sized, when…

Computational Geometry · Computer Science 2018-07-27 Bernhard Brehm , Hanne Hardering