English
Related papers

Related papers: Recovering Structured Probability Matrices

200 papers

This paper is about a curious phenomenon. Suppose we have a data matrix, which is the superposition of a low-rank component and a sparse component. Can we recover each component individually? We prove that under some suitable assumptions,…

Information Theory · Computer Science 2009-12-21 Emmanuel J. Candes , Xiaodong Li , Yi Ma , John Wright

In this letter, we propose an algorithm for recovery of sparse and low rank components of matrices using an iterative method with adaptive thresholding. In each iteration, the low rank and sparse components are obtained using a thresholding…

Numerical Analysis · Computer Science 2017-04-13 Nematollah Zarmehi , Farokh Marvasti

We propose a theory for matrix completion that goes beyond the low-rank structure commonly considered in the literature and applies to general matrices of low description complexity. Specifically, complexity of the sets of matrices…

Information Theory · Computer Science 2024-10-03 Erwin Riegler , Günther Koliander , David Stotz , Helmut Bölcskei

The task of compressed sensing is to recover a sparse vector from a small number of linear and non-adaptive measurements, and the problem of finding a suitable measurement matrix is very important in this field. While most recent works…

Information Theory · Computer Science 2012-12-18 Yi-Zheng Fan , Tao Huang , Ming Zhu

This paper proposes a CS scheme that exploits the representational power of restricted Boltzmann machines and deep learning architectures to model the prior distribution of the sparsity pattern of signals belonging to the same class. The…

Machine Learning · Computer Science 2017-08-02 Luisa F. Polania , Kenneth E. Barner

In this paper, we consider the problem of recovering an unknown sparse matrix X from the matrix sketch Y = AX B^T. The dimension of Y is less than that of X, and A and B are known matrices. This problem can be solved using standard…

Numerical Analysis · Computer Science 2013-11-12 Thakshila Wimalajeewa , Yonina C. Eldar , Pramod K. Varshney

It is now well understood that (1) it is possible to reconstruct sparse signals exactly from what appear to be highly incomplete sets of linear measurements and (2) that this can be done by constrained L1 minimization. In this paper, we…

Methodology · Statistics 2007-11-13 Emmanuel J. Candes , Michael B. Wakin , Stephen P. Boyd

Compressed sensing is a technique for recovering an unknown sparse signal from a small number of linear measurements. When the measurement matrix is random, the number of measurements required for perfect recovery exhibits a phase…

Optimization and Control · Mathematics 2016-12-30 Mateo Díaz , Mauricio Junca , Felipe Rincón , Mauricio Velasco

A novel algorithm for the recovery of low-rank matrices acquired via compressive linear measurements is proposed and analyzed. The algorithm, a variation on the iterative hard thresholding algorithm for low-rank recovery, is designed to…

Numerical Analysis · Mathematics 2018-10-30 Simon Foucart , Srinivas Subramanian

We consider machine learning techniques to develop low-latency approximate solutions to a class of inverse problems. More precisely, we use a probabilistic approach for the problem of recovering sparse stochastic signals that are members of…

Information Theory · Computer Science 2016-09-06 Steffen Limmer , Sławomir Stańczak

Expressing a matrix as the sum of a low-rank matrix plus a sparse matrix is a flexible model capturing global and local features in data popularized as Robust PCA (Candes et al., 2011; Chandrasekaran et al., 2009). Compressed sensing,…

Numerical Analysis · Mathematics 2022-04-28 Jared Tanner , Simon Vary

In this work, we study a variant of nonnegative matrix factorization where we wish to find a symmetric factorization of a given input matrix into a sparse, Boolean matrix. Formally speaking, given $\mathbf{M}\in\mathbb{Z}^{m\times m}$, we…

Machine Learning · Computer Science 2022-01-14 Sitan Chen , Zhao Song , Runzhou Tao , Ruizhe Zhang

We propose a novel probabilistic dimensionality reduction framework that can naturally integrate the generative model and the locality information of data. Based on this framework, we present a new model, which is able to learn a smooth…

Machine Learning · Statistics 2016-10-18 Li Wang

We study the two inference problems of detecting and recovering an isolated community of \emph{general} structure planted in a random graph. The detection problem is formalized as a hypothesis testing problem, where under the null…

Data Structures and Algorithms · Computer Science 2022-01-25 Wasim Huleihel

As the emergence and the thriving development of social networks, a huge number of short texts are accumulated and need to be processed. Inferring latent topics of collected short texts is useful for understanding its hidden structure and…

Machine Learning · Statistics 2018-04-04 Zhenghang Cui , Issei Sato , Masashi Sugiyama

The problem of 1-bit compressive sampling is addressed in this paper. We introduce an optimization model for reconstruction of sparse signals from 1-bit measurements. The model targets a solution that has the least l0-norm among all signals…

Information Theory · Computer Science 2013-02-07 Lixin Shen , Bruce W. Suter

Consider the approximate sparse recovery problem: given Ax, where A is a known m-by-n dimensional matrix and x is an unknown (approximately) sparse n-dimensional vector, recover an approximation to x. The goal is to design the matrix A such…

Data Structures and Algorithms · Computer Science 2014-11-11 Arnab Bhattacharyya , Vineet Nair

Weinberg (2012) described a constructive algorithm for computing the marginal likelihood, Z, from a Markov chain simulation of the posterior distribution. Its key point is: the choice of an integration subdomain that eliminates subvolumes…

Instrumentation and Methods for Astrophysics · Physics 2013-01-16 Martin D. Weinberg , Ilsang Yoon , Neal Katz

In this paper, we consider the "foreach" sparse recovery problem with failure probability $p$. The goal of which is to design a distribution over $m \times N$ matrices $\Phi$ and a decoding algorithm $\algo$ such that for every…

Data Structures and Algorithms · Computer Science 2013-04-24 Anna C. Gilbert , Hung Q. Ngo , Ely Porat , Atri Rudra , Martin J. Strauss

Stochastic Block Models (SBMs) are a fundamental tool for community detection in network analysis. But little theoretical work exists on the statistical performance of Bayesian SBMs, especially when the community count is unknown. This…

Statistics Theory · Mathematics 2021-01-19 Sheng Jiang , Surya Tokdar