English
Related papers

Related papers: Dictionary Identification - Sparse Matrix-Factoris…

200 papers

We consider the problem of recovering a complete (i.e., square and invertible) matrix $\mathbf A_0$, from $\mathbf Y \in \mathbb{R}^{n \times p}$ with $\mathbf Y = \mathbf A_0 \mathbf X_0$, provided $\mathbf X_0$ is sufficiently sparse.…

Information Theory · Computer Science 2017-01-20 Ju Sun , Qing Qu , John Wright

Sparse Representation (SR) of signals or data has a well founded theory with rigorous mathematical error bounds and proofs. SR of a signal is given by superposition of very few columns of a matrix called Dictionary, implicitly reducing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 G. Madhuri , Atul Negi

In this paper we revisit under-determined linear systems of equations with sparse solutions. As is well known, these systems are among core mathematical problems of a very popular compressed sensing field. The popularity of the field as…

Information Theory · Computer Science 2013-06-18 Mihailo Stojnic

We give a new approach to the dictionary learning (also known as "sparse coding") problem of recovering an unknown $n\times m$ matrix $A$ (for $m \geq n$) from examples of the form \[ y = Ax + e, \] where $x$ is a random vector in $\mathbb…

Data Structures and Algorithms · Computer Science 2014-11-11 Boaz Barak , Jonathan A. Kelner , David Steurer

In "dictionary learning" we observe $Y = AX + E$ for some $Y\in\mathbb{R}^{n\times p}$, $A \in\mathbb{R}^{m\times n}$, and $X\in\mathbb{R}^{m\times p}$. The matrix $Y$ is observed, and $A, X, E$ are unknown. Here $E$ is "noise" of small…

Machine Learning · Computer Science 2016-02-19 Jarosław Błasiok , Jelani Nelson

The observations in many applications consist of counts of discrete events, such as photons hitting a detector, which cannot be effectively modeled using an additive bounded or Gaussian noise model, and instead require a Poisson noise…

Optimization and Control · Mathematics 2011-10-13 Zachary T. Harmany , Roummel F. Marcia , Rebecca M. Willett

Motivated by applications in unsourced random access, this paper develops a novel scheme for the problem of compressed sensing of binary signals. In this problem, the goal is to design a sensing matrix $A$ and a recovery algorithm, such…

Information Theory · Computer Science 2021-09-21 Elad Romanov , Or Ordentlich

Methods exploiting sparsity have been popular in imaging and signal processing applications including compression, denoising, and imaging inverse problems. Data-driven approaches such as dictionary learning and transform learning enable one…

Machine Learning · Computer Science 2018-02-05 Saiprasad Ravishankar , Anna Ma , Deanna Needell

Sparse representation learning has recently gained a great success in signal and image processing, thanks to recent advances in dictionary learning. To this end, the $\ell_0$-norm is often used to control the sparsity level. Nevertheless,…

Computer Vision and Pattern Recognition · Computer Science 2017-09-19 Yuan Liu , Stéphane Canu , Paul Honeine , Su Ruan

Is it possible to find the sparsest vector (direction) in a generic subspace $\mathcal{S} \subseteq \mathbb{R}^p$ with $\mathrm{dim}(\mathcal{S})= n < p$? This problem can be considered a homogeneous variant of the sparse recovery problem,…

Information Theory · Computer Science 2016-09-21 Qing Qu , Ju Sun , John Wright

Matrix factorization is a key tool in data analysis; its applications include recommender systems, correlation analysis, signal processing, among others. Binary matrices are a particular case which has received significant attention for…

Machine Learning · Statistics 2019-01-30 Ignacio Ramirez

Sparsity priors are commonly used in denoising and image reconstruction. For analysis-type priors, a dictionary defines a representation of signals that is likely to be sparse. In most situations, this dictionary is not known, and is to be…

Optimization and Control · Mathematics 2021-12-16 Hashem Ghanem , Joseph Salmon , Nicolas Keriven , Samuel Vaiter

Sparse coding, which is the decomposition of a vector using only a few basis elements, is widely used in machine learning and image processing. The basis set, also called dictionary, is learned to adapt to specific data. This approach has…

Machine Learning · Computer Science 2011-12-13 Louise Benoît , Julien Mairal , Francis Bach , Jean Ponce

Signal recovery from a given set of linear measurements using a sparsity prior has been a major subject of research in recent years. In this model, the signal is assumed to have a sparse representation under a given dictionary. Most of the…

Information Theory · Computer Science 2013-03-25 Raja Giryes , Michael Elad

Compressed Sensing aims to capture attributes of a sparse signal using very few measurements. Cand\`{e}s and Tao showed that sparse reconstruction is possible if the sensing matrix acts as a near isometry on all $\boldsymbol{k}$-sparse…

Information Theory · Computer Science 2009-10-18 Robert Calderbank , Stephen Howard , Sina Jafarpour

A nonnegative matrix factorization (NMF) can be computed efficiently under the separability assumption, which asserts that all the columns of the given input data matrix belong to the cone generated by a (small) subset of them. The provably…

Optimization and Control · Mathematics 2017-11-22 Nicolas Gillis , Robert Luce

We study the recovery of sparse signals from underdetermined linear measurements when a potentially erroneous support estimate is available. Our results are twofold. First, we derive necessary and sufficient conditions for signal recovery…

Information Theory · Computer Science 2014-12-05 Hassan Mansour , Rayan Saab

In this paper we study the compressed sensing problem of recovering a sparse signal from a system of underdetermined linear equations when we have prior information about the probability of each entry of the unknown signal being nonzero. In…

Information Theory · Computer Science 2009-01-20 M. Amin Khajehnejad , Weiyu Xu , Salman Avestimehr , Babak Hassibi

In this work, we study a variant of nonnegative matrix factorization where we wish to find a symmetric factorization of a given input matrix into a sparse, Boolean matrix. Formally speaking, given $\mathbf{M}\in\mathbb{Z}^{m\times m}$, we…

Machine Learning · Computer Science 2022-01-14 Sitan Chen , Zhao Song , Runzhou Tao , Ruizhe Zhang

In this short paper we bridge two seemingly unrelated sparse approximation topics: continuous sparse coding and low-rank approximations. We show that for a specific choice of continuous dictionary, linear systems with nuclear-norm…

Information Theory · Computer Science 2020-09-15 Clement Elvira , Jeremy E. Cohen , Cedric Herzet , Remi Gribonval