English
Related papers

Related papers: Orthogonal Matching Pursuit: A Brownian Motion Ana…

200 papers

Sparse subspace clustering (SSC) using greedy-based neighbor selection, such as matching pursuit (MP) and orthogonal matching pursuit (OMP), has been known as a popular computationally-efficient alternative to the conventional…

Machine Learning · Statistics 2020-02-04 Jwo-Yuh Wu , Wen-Hsuan Li , Liang-Chi Huang , Yen-Ping Lin , Chun-Hung Liu , Rung-Hung Gau

Expander graphs have been recently proposed to construct efficient compressed sensing algorithms. In particular, it has been shown that any $n$-dimensional vector that is $k$-sparse (with $k\ll n$) can be fully recovered using…

Information Theory · Computer Science 2008-06-25 Sina Jafarpour , Weiyu Xu , Babak Hassibi , Robert Calderbank

We study sparse approximation by greedy algorithms. Our contribution is two-fold. First, we prove exact recovery with high probability of random $K$-sparse signals within $\lceil K(1+\e)\rceil$ iterations of the Orthogonal Matching Pursuit…

Numerical Analysis · Mathematics 2013-04-03 Eugene Livshitz , Vladimir Temlyakov

This paper proposes and analyzes a mmWave sparse channel estimation technique for OFDM systems that uses the Orthogonal Matching Pursuit (OMP) algorithm. This greedy algorithm retrieves one additional multipath component (MPC) per iteration…

Information Theory · Computer Science 2018-12-19 Felipe Gomez-Cuba , Andrea J. Goldsmith

We consider the problem of recovering signals from their power spectral density. This is a classical problem referred to in literature as the phase retrieval problem, and is of paramount importance in many fields of applied sciences. In…

Information Theory · Computer Science 2013-11-12 Kishore Jaganathan , Samet Oymak , Babak Hassibi

In this paper, we study the orthogonal least squares (OLS) algorithm for sparse recovery. On the one hand, we show that if the sampling matrix $\mathbf{A}$ satisfies the restricted isometry property (RIP) of order $K + 1$ with isometry…

Information Theory · Computer Science 2017-10-11 Jinming Wen , Jian Wang , Qinyu Zhang

Unions of subspaces provide a powerful generalization to linear subspace models for collections of high-dimensional data. To learn a union of subspaces from a collection of data, sets of signals in the collection that belong to the same…

Machine Learning · Computer Science 2016-10-28 Eva L. Dyer , Aswin C. Sankaranarayanan , Richard G. Baraniuk

A host of problems involve the recovery of structured signals from a dimensionality reduced representation such as a random projection; examples include sparse signals (compressive sensing) and low-rank matrices (matrix completion). Given…

Information Theory · Computer Science 2012-05-22 Shirin Jalali , Arian Maleki , Richard Baraniuk

We shall show that if the restricted isometry constant (RIC) $\delta_{s+1}(A)$ of the measurement matrix $A$ satisfies $$ \delta_{s+1}(A) < \frac{1}{\sqrt{s + 1}}, $$ then the greedy algorithm Orthogonal Matching Pursuit(OMP) will succeed.…

Information Theory · Computer Science 2015-01-09 Qun Mo

The two major approaches to sparse recovery are L1-minimization and greedy methods. Recently, Needell and Vershynin developed Regularized Orthogonal Matching Pursuit (ROMP) that has bridged the gap between these two approaches. ROMP is the…

Numerical Analysis · Mathematics 2008-12-12 D. Needell , J. A. Tropp , R. Vershynin

We consider the problem of exact recovery of a $k$-sparse binary vector from generalized linear measurements (such as logistic regression). We analyze the linear estimation algorithm (Plan, Vershynin, Yudovina, 2017), and also show…

Machine Learning · Statistics 2025-02-25 Arya Mazumdar , Neha Sangwan

In this paper, we consider the extensively studied problem of computing a $k$-sparse approximation to the $d$-dimensional Fourier transform of a length $n$ signal. Our algorithm uses $O(k \log k \log n)$ samples, is dimension-free, operates…

Data Structures and Algorithms · Computer Science 2019-09-26 Vasileios Nakos , Zhao Song , Zhengyu Wang

We propose a novel greedy algorithm for the support recovery of a sparse signal from a small number of noisy measurements. In the proposed method, a new support index is identified for each iteration based on bit-wise maximum a posteriori…

Information Theory · Computer Science 2019-10-29 J. Chae , S. -N. Hong

This paper is a direct followup of the recent author's paper. In this paper we continue to analyze approximation and recovery properties with respect to systems satisfying universal sampling discretization property and a special…

Numerical Analysis · Mathematics 2024-01-29 V. Temlyakov

Sampling rate is the bottleneck for spectrum sensing over multi-GHz bandwidth. Recent progress in compressed sensing (CS) initialized several sub-Nyquist rate approaches to overcome the problem. However, efforts to design CS reconstruction…

Information Theory · Computer Science 2011-02-15 Peng Zhang , Robert Qiu

Standard compressive sensing results state that to exactly recover an s sparse signal in R^p, one requires O(s. log(p)) measurements. While this bound is extremely useful in practice, often real world signals are not only sparse, but also…

Machine Learning · Statistics 2011-10-19 Nikhil Rao , Benjamin Recht , Robert Nowak

In the Multiple Measurements Vector (MMV) model, measurement vectors are connected to unknown, jointly sparse signal vectors through a linear regression model employing a single known measurement matrix (or dictionary). Typically, the…

Methodology · Statistics 2024-08-05 Esa Ollila

Cost-efficient compressive sensing is challenging when facing large-scale data, {\em i.e.}, data with large sizes. Conventional compressive sensing methods for large-scale data will suffer from low computational efficiency and massive…

Data Structures and Algorithms · Computer Science 2016-03-18 Sung-Hsien Hsieh , Chun-Shien Lu , Soo-Chang Pei

In the problem of adaptive compressed sensing, one wants to estimate an approximately $k$-sparse vector $x\in\mathbb{R}^n$ from $m$ linear measurements $A_1 x, A_2 x,\ldots, A_m x$, where $A_i$ can be chosen based on the outcomes $A_1…

Data Structures and Algorithms · Computer Science 2018-04-26 Vasileios Nakos , Xiaofei Shi , David P. Woodruff , Hongyang Zhang

The most frequently used condition for sampling matrices employed in compressive sampling is the restricted isometry (RIP) property of the matrix when restricted to sparse signals. At the same time, imposing this condition makes it…

Information Theory · Computer Science 2013-03-11 Alexander Barg , Arya Mazumdar , Rongrong Wang