English
Related papers

Related papers: Improved Sparsity Thresholds Through Dictionary Sp…

200 papers

This paper derives sufficient conditions for local recovery of coordinate dictionaries comprising a Kronecker-structured dictionary that is used for representing $K$th-order tensor data. Tensor observations are assumed to be generated from…

Machine Learning · Statistics 2018-10-03 Zahra Shakeri , Anand D. Sarwate , Waheed U. Bajwa

We consider the problem of aggregating the elements of a possibly infinite dictionary for building a decision procedure that aims at minimizing a given criterion. Along with the dictionary, an independent identically distributed training…

Statistics Theory · Mathematics 2013-03-25 Arnak S. Dalalyan , Alexandre B. Tsybakov

This paper addresses the problem of simultaneous signal recovery and dictionary learning based on compressive measurements. Multiple signals are analyzed jointly, with multiple sensing matrices, under the assumption that the unknown signals…

Information Theory · Computer Science 2015-03-19 Jorge Silva , Minhua Chen , Yonina C. Eldar , Guillermo Sapiro , Lawrence Carin

In dictionary learning, also known as sparse coding, the algorithm is given samples of the form $y = Ax$ where $x\in \mathbb{R}^m$ is an unknown random sparse vector and $A$ is an unknown dictionary matrix in $\mathbb{R}^{n\times m}$…

Data Structures and Algorithms · Computer Science 2014-01-06 Sanjeev Arora , Aditya Bhaskara , Rong Ge , Tengyu Ma

We provide another framework of iterative algorithms based on thresholding, feedback and null space tuning for sparse signal recovery arising in sparse representations and compressed sensing. Several thresholding algorithms with various…

Information Theory · Computer Science 2012-11-13 Shidong Li , Yulong Liu , Tiebin Mi

We give a new, very general, formulation of the compressed sensing problem in terms of coordinate projections of an analytic variety, and derive sufficient sampling rates for signal reconstruction. Our bounds are linear in the coherence of…

Machine Learning · Computer Science 2013-11-05 Franz J. Király , Louis Theran

Many of the applications of compressed sensing have been based on variable density sampling, where certain sections of the sampling coefficients are sampled more densely. Furthermore, it has been observed that these sampling schemes are…

Information Theory · Computer Science 2015-09-24 Clarice Poon

We describe an implementation of a hybrid statistical/symbolic approach to repairing parser failures in a speech-to-speech translation system. We describe a module which takes as input a fragmented parse and returns a repaired meaning…

cmp-lg · Computer Science 2008-02-03 Carolyn Penstein Rose' , Alex Waibel

In many practical applications such as direction-of-arrival (DOA) estimation and line spectral estimation, the sparsifying dictionary is usually characterized by a set of unknown parameters in a continuous domain. To apply the conventional…

Information Theory · Computer Science 2015-06-18 Jun Fang , Jing Li , Yanning Shen , Hongbin Li , Shaoqian Li

In the first part of the series papers, we set out to answer the following question: given specific restrictions on a set of samplers, what kind of signal can be uniquely represented by the corresponding samples attained, as the foundation…

Information Theory · Computer Science 2021-08-25 Hanshen Xiao , Yaowen Zhang , Guoqiang Xiao

Compressed sensing is a technique for recovering an unknown sparse signal from a small number of linear measurements. When the measurement matrix is random, the number of measurements required for perfect recovery exhibits a phase…

Optimization and Control · Mathematics 2016-12-30 Mateo Díaz , Mauricio Junca , Felipe Rincón , Mauricio Velasco

Sparse recovery is widely applied in many fields, since many signals or vectors can be sparsely represented under some frames or dictionaries. Most of fast algorithms at present are based on solving $l^0$ or $l^1$ minimization problems and…

Numerical Analysis · Mathematics 2019-03-06 Chong-Jun Li , Yi-Jun Zhong

Convolutional sparse representations are a form of sparse representation with a dictionary that has a structure that is equivalent to convolution with a set of linear filters. While effective algorithms have recently been developed for the…

Machine Learning · Computer Science 2018-09-06 Cristina Garcia-Cardona , Brendt Wohlberg

This paper proposes a subspace decomposition method based on an over-complete dictionary in sparse representation, called "Sparse Signal Subspace Decomposition" (or 3SD) method. This method makes use of a novel criterion based on the…

Machine Learning · Statistics 2016-10-28 Hong Sun , Chengwei Sang , Didier Le Ruyet

Matching pursuits are a class of greedy algorithms commonly used in signal processing, for solving the sparse approximation problem. They rely on an atom selection step that requires the calculation of numerous projections, which can be…

Data Structures and Algorithms · Computer Science 2012-04-06 Manuel Moussallam , Laurent Daudet , Gaël Richard

We consider the problem of dictionary learning under the assumption that the observed signals can be represented as sparse linear combinations of the columns of a single large dictionary matrix. In particular, we analyze the minimax risk of…

Machine Learning · Statistics 2014-06-30 Alexander Jung , Yonina C. Eldar , Norbert Görtz

This paper considers the problem of simultaneously learning the Sensing Matrix and Sparsifying Dictionary (SMSD) on a large training dataset. To address the formulated joint learning problem, we propose an online algorithm that consists of…

Machine Learning · Computer Science 2018-06-05 Tao Hong , Zhihui Zhu

Super-symmetric tensors - a higher-order extension of scatter matrices - are becoming increasingly popular in machine learning and computer vision for modelling data statistics, co-occurrences, or even as visual descriptors. However, the…

Computer Vision and Pattern Recognition · Computer Science 2015-09-11 Piotr Koniusz , Anoop Cherian

When uncertainty meets costly information gathering, a fundamental question emerges: which data points should we probe to unlock near-optimal solutions? Sparsification of stochastic packing problems addresses this trade-off. The existing…

Data Structures and Algorithms · Computer Science 2025-12-02 Shaddin Dughmi , Yusuf Hakan Kalayci , Xinyu Liu

Sparse approximations using highly over-complete dictionaries is a state-of-the-art tool for many imaging applications including denoising, super-resolution, compressive sensing, light-field analysis, and object recognition. Unfortunately,…

Computer Vision and Pattern Recognition · Computer Science 2014-12-03 Ali Ayremlou , Thomas Goldstein , Ashok Veeraraghavan , Richard Baraniuk