English
Related papers

Related papers: Dictionary Learning and Sparse Coding on Statistic…

200 papers

In this paper we consider the dictionary learning problem for sparse representation. We first show that this problem is NP-hard by polynomial time reduction of the densest cut problem. Then, using successive convex approximation strategies,…

Machine Learning · Computer Science 2015-11-06 Meisam Razaviyayn , Hung-Wei Tseng , Zhi-Quan Luo

We propose a novel structured discriminative block-diagonal dictionary learning method, referred to as scalable Locality-Constrained Projective Dictionary Learning (LC-PDL), for efficient representation and classification. To improve the…

Computer Vision and Pattern Recognition · Computer Science 2019-05-28 Zhao Zhang , Weiming Jiang , Zheng Zhang , Sheng Li , Guangcan Liu , Jie Qin

The idea that many important classes of signals can be well-represented by linear combinations of a small set of atoms selected from a given dictionary has had dramatic impact on the theory and practice of signal processing. For practical…

Information Theory · Computer Science 2015-03-18 Quan Geng , Huan Wang , John Wright

Data encoded as symmetric positive definite (SPD) matrices frequently arise in many areas of computer vision and machine learning. While these matrices form an open subset of the Euclidean space of symmetric matrices, viewing them through…

Computer Vision and Pattern Recognition · Computer Science 2015-12-18 Anoop Cherian , Suvrit Sra

We propose semantic smoothing, a smoothing method for language models that uses embeddings to share statistical observations across semantically similar contexts. The starting point is a decomposition of log-perplexity that motivates…

Information Theory · Computer Science 2026-05-11 Haricharan Balasundaram , Swathi Shree Narashiman , Pranay Mathur , Andrew Thangaraj

In this paper, we propose a semi-supervised dictionary learning method that uses both the information in labelled and unlabelled data and jointly trains a linear classifier embedded on the sparse codes. The manifold structure of the data in…

Machine Learning · Computer Science 2018-12-12 Khanh-Hung Tran , Fred-Maurice Ngole-Mboula , Jean-Luc Starck

It is now well established that sparse signal models are well suited to restoration tasks and can effectively be learned from audio, image, and video data. Recent research has been aimed at learning discriminative sparse models instead of…

Computer Vision and Pattern Recognition · Computer Science 2009-09-29 Julien Mairal , Francis Bach , Jean Ponce , Guillermo Sapiro , Andrew Zisserman

A popular approach within the signal processing and machine learning communities consists in modelling signals as sparse linear combinations of atoms selected from a learned dictionary. While this paradigm has led to numerous empirical…

Machine Learning · Statistics 2012-10-03 Rodolphe Jenatton , Rémi Gribonval , Francis Bach

Convolutional Sparse Coding (CSC) is an increasingly popular model in the signal and image processing communities, tackling some of the limitations of traditional patch-based sparse representations. Although several works have addressed the…

Computer Vision and Pattern Recognition · Computer Science 2017-05-10 Vardan Papyan , Yaniv Romano , Jeremias Sulam , Michael Elad

Sparse coding approximates the data sample as a sparse linear combination of some basic codewords and uses the sparse codes as new presentations. In this paper, we investigate learning discriminative sparse codes by sparse coding in a…

Machine Learning · Statistics 2015-01-19 Jim Jing-Yan Wang , Xin Gao

Super-symmetric tensors - a higher-order extension of scatter matrices - are becoming increasingly popular in machine learning and computer vision for modelling data statistics, co-occurrences, or even as visual descriptors. However, the…

Computer Vision and Pattern Recognition · Computer Science 2015-09-11 Piotr Koniusz , Anoop Cherian

Sparse coding consists in representing signals as sparse linear combinations of atoms selected from a dictionary. We consider an extension of this framework where the atoms are further assumed to be embedded in a tree. This is achieved…

Machine Learning · Statistics 2011-08-18 Rodolphe Jenatton , Julien Mairal , Guillaume Obozinski , Francis Bach

In this paper we present a new approach of incorporating kernels into dictionary learning. The kernel K-SVD algorithm (KKSVD), which has been introduced recently, shows an improvement in classification performance, with relation to its…

Computer Vision and Pattern Recognition · Computer Science 2016-05-25 Alona Golts , Michael Elad

Over the past decade, learning a dictionary from input images for sparse modeling has been one of the topics which receive most research attention in image processing and compressed sensing. Most existing dictionary learning methods…

Image and Video Processing · Electrical Eng. & Systems 2021-04-27 Kai Liu , Yongjian Zhao , Hua Wang

Classifiers based on sparse representations have recently been shown to provide excellent results in many visual recognition and classification tasks. However, the high cost of computing sparse representations at test time is a major…

Computer Vision and Pattern Recognition · Computer Science 2014-10-03 Alhussein Fawzi , Mike Davies , Pascal Frossard

Sparse representations has shown to be a very powerful model for real world signals, and has enabled the development of applications with notable performance. Combined with the ability to learn a dictionary from signal examples,…

Computer Vision and Pattern Recognition · Computer Science 2016-05-13 Jeremias Sulam , Boaz Ophir , Michael Zibulevsky , Michael Elad

In complex visual recognition tasks it is typical to adopt multiple descriptors, that describe different aspects of the images, for obtaining an improved recognition performance. Descriptors that have diverse forms can be fused into a…

Computer Vision and Pattern Recognition · Computer Science 2015-06-15 Jayaraman J. Thiagarajan , Karthikeyan Natesan Ramamurthy , Andreas Spanias

This paper seeks to combine dictionary learning and hierarchical image representation in a principled way. To make dictionary atoms capturing additional information from extended receptive fields and attain improved descriptive capacity, we…

Computer Vision and Pattern Recognition · Computer Science 2019-11-11 Tong Zhang , Fatih Porikli

Constrained tensor and matrix factorization models allow to extract interpretable patterns from multiway data. Therefore identifiability properties and efficient algorithms for constrained low-rank approximations are nowadays important…

Machine Learning · Computer Science 2022-01-24 Jeremy E. Cohen

Dictionary learning, the problem of recovering a sparsely used matrix $\mathbf{D} \in \mathbb{R}^{M \times K}$ and $N$ $s$-sparse vectors $\mathbf{x}_i \in \mathbb{R}^{K}$ from samples of the form $\mathbf{y}_i = \mathbf{D}\mathbf{x}_i$, is…

Machine Learning · Computer Science 2023-03-29 Alexei Novikov , Stephen White