English
Related papers

Related papers: Coherence-based Partial Exact Recovery Condition f…

200 papers

We give an efficient algorithm for finding sparse approximate solutions to linear systems of equations with nonnegative coefficients. Unlike most known results for sparse recovery, we do not require {\em any} assumption on the matrix other…

Data Structures and Algorithms · Computer Science 2015-01-09 Aditya Bhaskara , Ananda Theertha Suresh , Morteza Zadimoghaddam

In this paper, the problem of one-bit compressed sensing (OBCS) is formulated as a problem in probably approximately correct (PAC) learning. It is shown that the Vapnik-Chervonenkis (VC-) dimension of the set of half-spaces in…

Machine Learning · Statistics 2017-10-24 Mehmet Eren Ahsen , Mathukumalli Vidyasagar

The exact recovery property of Basis pursuit (BP) and Orthogonal Matching Pursuit (OMP) has a relation with the coherence of the underlying frame. A frame with low coherence provides better guarantees for exact recovery. In particular,…

Numerical Analysis · Mathematics 2017-07-04 Pradip Sasmal , Phanindra Jampana , C. S. Sastry

This paper proposes low-complexity algorithms for finding approximate second-order stationary points (SOSPs) of problems with smooth non-convex objective and linear constraints. While finding (approximate) SOSPs is computationally…

Optimization and Control · Mathematics 2019-07-11 Songtao Lu , Meisam Razaviyayn , Bo Yang , Kejun Huang , Mingyi Hong

Given a text $T$ and a pattern $P$ over alphabet $\Sigma$, the classic exact matching problem searches for all occurrences of pattern $P$ in text $T$. Unlike exact matching problem, order-preserving pattern matching (OPPM) considers the…

Data Structures and Algorithms · Computer Science 2017-05-29 Davaajav Jargalsaikhan , Diptarama , Ryo Yoshinaka , Ayumi Shinohara

In this paper we consider a system of quadratic equations |<z_j, x>|^2 = b_j, j = 1, ..., m, where x in R^n is unknown while normal random vectors z_j in R_n and quadratic measurements b_j in R are known. The system is assumed to be…

Information Theory · Computer Science 2012-09-24 Xiaodong Li , Vladislav Voroninski

Exact recovery of a sparse solution for an underdetermined system of linear equations implies full search among all possible subsets of the dictionary, which is computationally intractable, while l1 minimization will do the job when a…

Information Theory · Computer Science 2014-12-22 Mohsen Joneidi , Mahdi Barzegar Khalilsarai , Alireza Zaeemzadeh , Nazanin Rahnavard

In this paper we show that a large class of Latent variable models, such as Mixed Membership Stochastic Block(MMSB) Models, Topic Models, and Adversarial Clustering, can be unified through a geometric perspective, replacing model specific…

Machine Learning · Computer Science 2020-01-07 Chiranjib Bhattacharyya , Ravindran Kannan

We address the problem of joint sparsity pattern recovery based on low dimensional multiple measurement vectors (MMVs) in resource constrained distributed networks. We assume that distributed nodes observe sparse signals which share the…

Information Theory · Computer Science 2015-06-16 Thankshila Wimalajeewa , Pramod K. Varshney

This paper studies an optimization problem on the sum of traces of matrix quadratic forms in $m$ semi-orthogonal matrices, which can be considered as a generalization of the synchronization of rotations. While the problem is nonconvex, the…

Optimization and Control · Mathematics 2021-10-13 Joong-Ho Won , Teng Zhang , Hua Zhou

An approximate sparse recovery system in $\ell_1$ norm consists of parameters $k$, $\epsilon$, $N$, an $m$-by-$N$ measurement $\Phi$, and a recovery algorithm, $\mathcal{R}$. Given a vector, $\mathbf{x}$, the system approximates $x$ by…

Data Structures and Algorithms · Computer Science 2017-03-08 Anna C. Gilbert , Yi Li , Ely Porat , Martin J. Strauss

The simultaneous orthogonal matching pursuit (SOMP) algorithm aims to find the joint support of a set of sparse signals acquired under a multiple measurement vector model. Critically, the analysis of SOMP depends on the maximal inner…

Information Theory · Computer Science 2016-10-14 Jean-François Determe , Jérôme Louveaux , Laurent Jacques , François Horlin

Consider the $n$-dimensional vector $y=X\be+\e$, where $\be \in \R^p$ has only $k$ nonzero entries and $\e \in \R^n$ is a Gaussian noise. This can be viewed as a linear system with sparsity constraints, corrupted by noise. We find a…

Information Theory · Computer Science 2009-10-13 Kamiar Rahnama Rad

Sparse Subspace Clustering (SSC) is a state-of-the-art method for clustering high-dimensional data points lying in a union of low-dimensional subspaces. However, while $\ell_1$ optimization-based SSC algorithms suffer from high…

Machine Learning · Computer Science 2018-02-14 Yanxi Chen , Gen Li , Yuantao Gu

Sparse phase retrieval with redundant dictionary is to reconstruct the signals of interest that are (nearly) sparse in a redundant dictionary or frame from the phaseless measurements via the optimization models. Gao [7] presented conditions…

Information Theory · Computer Science 2025-06-06 Haiye Huo , Li Xiao

Periodic signals composed of periodic mixtures admit sparse representations in nested periodic dictionaries (NPDs). Therefore, their underlying hidden periods can be estimated by recovering the exact support of said representations. In this…

Information Theory · Computer Science 2024-06-05 Pouria Saidi , George K. Atia

In this paper, based on a successively accuracy-increasing approximation of the $\ell_0$ norm, we propose a new algorithm for recovery of sparse vectors from underdetermined measurements. The approximations are realized with a certain class…

Information Theory · Computer Science 2016-11-03 Mohammadreza Malek-Mohammadi , Ali Koochakzadeh , Massoud Babaie-Zadeh , Magnus Jansson , Cristian R. Rojas

In the context of sparse recovery, it is known that most of existing regularizers such as $\ell_1$ suffer from some bias incurred by some leading entries (in magnitude) of the associated vector. To neutralize this bias, we propose a class…

Optimization and Control · Mathematics 2015-11-24 Zhaosong Lu , Xiaorui Li

Sparse phase retrieval aims to recover a $k$-sparse signal from $m$ phaseless measurements. While the theoretically optimal sample complexity for successful recovery is $\Omega(k \log n)$, existing algorithms can only achieve this bound for…

Information Theory · Computer Science 2026-03-30 Mengchu Xu , Yuxuan Zhang , Jian Wang

Orthogonal Matching Pursuit (OMP) plays an important role in data science and its applications such as sparse subspace clustering and image processing. However, the existing OMP-based approaches lack of data adaptiveness so that the data…

Machine Learning · Computer Science 2019-09-02 Jiaqiyu Zhan , Zhiqiang Bai , Yuesheng Zhu