English
Related papers

Related papers: Exact Sparse Orthogonal Dictionary Learning

200 papers

Sparse signal representations based on linear combinations of learned atoms have been used to obtain state-of-the-art results in several practical signal processing applications. Approximation methods are needed to process high-dimensional…

Machine Learning · Computer Science 2020-02-17 Fredrik Sandin , Sergio Martin-del-Campo

Convolutional Sparse Coding (CSC) is an increasingly popular model in the signal and image processing communities, tackling some of the limitations of traditional patch-based sparse representations. Although several works have addressed the…

Computer Vision and Pattern Recognition · Computer Science 2017-05-10 Vardan Papyan , Yaniv Romano , Jeremias Sulam , Michael Elad

In recent years, a large amount of multi-disciplinary research has been conducted on sparse models and their applications. In statistics and machine learning, the sparsity principle is used to perform model selection---that is,…

Computer Vision and Pattern Recognition · Computer Science 2014-12-09 Julien Mairal , Francis Bach , Jean Ponce

We propose a convolutional recurrent sparse auto-encoder model. The model consists of a sparse encoder, which is a convolutional extension of the learned ISTA (LISTA) method, and a linear convolutional decoder. Our strategy offers a simple…

Signal Processing · Electrical Eng. & Systems 2020-01-22 Hillel Sreter , Raja Giryes

Sparse coding or sparse dictionary learning has been widely used to recover underlying structure in many kinds of natural data. Here, we provide conditions guaranteeing when this recovery is universal; that is, when sparse codes and…

Neurons and Cognition · Quantitative Biology 2016-11-18 Christopher J. Hillar , Friedrich T. Sommer

Sparsity-based models and techniques have been exploited in many signal processing and imaging applications. Data-driven methods based on dictionary and sparsifying transform learning enable learning rich image features from data, and can…

Machine Learning · Computer Science 2019-09-25 Saiprasad Ravishankar , Anna Ma , Deanna Needell

We study in this paper the improvement of one-class support vector machines (OC-SVM) through sparse representation techniques for unsupervised anomaly detection. As Dictionary Learning (DL) became recently a common analysis technique that…

Machine Learning · Computer Science 2024-04-08 Paul Irofti , Iulian-Andrei Hîji , Andrei Pătraşcu , Nicolae Cleju

In sparse recovery, the unique sparsest solution to an under-determined system of linear equations is of main interest. This scheme is commonly proposed to be applied to signal acquisition. In most cases, the signals are not sparse…

Information Theory · Computer Science 2013-07-16 Henning Zörlein , Faisal Akram , Martin Bossert

Deep dictionary learning seeks multiple dictionaries at different image scales to capture complementary coherent characteristics. We propose a method for learning a hierarchy of synthesis dictionaries with an image classification goal. The…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Shahin Mahdizadehaghdam , Ashkan Panahi , Hamid Krim , Liyi Dai

Modeling data with linear combinations of a few elements from a learned dictionary has been the focus of much recent research in machine learning, neuroscience and signal processing. For signals such as natural images that admit such sparse…

Machine Learning · Statistics 2013-09-10 Julien Mairal , Francis Bach , Jean Ponce

Dictionary learning, the problem of recovering a sparsely used matrix $\mathbf{D} \in \mathbb{R}^{M \times K}$ and $N$ $s$-sparse vectors $\mathbf{x}_i \in \mathbb{R}^{K}$ from samples of the form $\mathbf{y}_i = \mathbf{D}\mathbf{x}_i$, is…

Machine Learning · Computer Science 2023-03-29 Alexei Novikov , Stephen White

Sparse dictionary learning (SDL) is a fundamental technique that is useful for many image processing tasks. As an example we consider here image recovery, where SDL can be cast as a nonsmooth optimization problem. For this kind of problems,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Mohammadsadegh Khoshghiaferezaee , Moritz Krauth , Shima Shabani , Michael Breuß

In this paper, we propose a new sampling strategy for hyperspectral signals that is based on dictionary learning and singular value decomposition (SVD). Specifically, we first learn a sparsifying dictionary from training spectral data using…

Computer Vision and Pattern Recognition · Computer Science 2015-12-04 Mingrui Yang , Frank de Hoog , Yuqi Fan , Wen Hu

Many natural signals exhibit a sparse representation, whenever a suitable describing model is given. Here, a linear generative model is considered, where many sparsity-based signal processing techniques rely on such a simplified model. As…

Machine Learning · Computer Science 2013-06-11 Mehrdad Yaghoobi , Laurent Daudet , Michael E. Davies

Sparse representation models a signal as a linear combination of a small number of dictionary atoms. As a generative model, it requires the dictionary to be highly redundant in order to ensure both a stable high sparsity level and a low…

Computer Vision and Pattern Recognition · Computer Science 2015-06-23 Xiaoxia Sun , Nasser M. Nasrabadi , Trac D. Tran

We study the Dictionary Learning (aka Sparse Coding) problem of obtaining a sparse representation of data points, by learning \emph{dictionary vectors} upon which the data points can be written as sparse linear combinations. We view this…

Machine Learning · Computer Science 2015-03-09 Meera Sitharam , Mohamad Tarifi , Menghan Wang

We present theoretical guarantees for an alternating minimization algorithm for the dictionary learning/sparse coding problem. The dictionary learning problem is to factorize vector samples $y^{1},y^{2},\ldots, y^{n}$ into an appropriate…

Machine Learning · Statistics 2019-08-01 Niladri S. Chatterji , Peter L. Bartlett

In this paper a new dictionary learning algorithm for multidimensional data is proposed. Unlike most conventional dictionary learning methods which are derived for dealing with vectors or matrices, our algorithm, named KTSVD, learns a…

Machine Learning · Computer Science 2016-01-01 Zemin Zhang , Shuchin Aeron

Mixed dictionaries generated by cosine and B-spline functions are considered. It is shown that, by highly nonlinear approaches such as Orthogonal Matching Pursuit, the discrete version of the proposed dictionaries yields a significant gain…

Numerical Analysis · Mathematics 2009-09-08 James Bowley , Laura Rebollo-Neira

Data encoded as symmetric positive definite (SPD) matrices frequently arise in many areas of computer vision and machine learning. While these matrices form an open subset of the Euclidean space of symmetric matrices, viewing them through…

Computer Vision and Pattern Recognition · Computer Science 2015-12-18 Anoop Cherian , Suvrit Sra