English
Related papers

Related papers: Efficient Dictionary Learning with Sparseness-Enfo…

200 papers

Sparse representations using learned dictionaries are being increasingly used with success in several data processing and machine learning applications. The availability of abundant training data necessitates the development of efficient,…

Computer Vision and Pattern Recognition · Computer Science 2013-09-26 Jayaraman J. Thiagarajan , Karthikeyan Natesan Ramamurthy , Andreas Spanias

In big data image/video analytics, we encounter the problem of learning an overcomplete dictionary for sparse representation from a large training dataset, which can not be processed at once because of storage and computational constraints.…

Machine Learning · Computer Science 2014-03-20 Subhadip Mukherjee , Chandra Sekhar Seelamantula

A new method is proposed in this paper to learn overcomplete dictionary from training data samples. Differing from the current methods that enforce similar sparsity constraint on each of the input samples, the proposed method attempts to…

Data Structures and Algorithms · Computer Science 2013-05-14 Deyu Meng , Yee Leung , Qian Zhao , Zongben Xu

Dictionary learning is a cutting-edge area in imaging processing, that has recently led to state-of-the-art results in many signal processing tasks. The idea is to conduct a linear decomposition of a signal using a few atoms of a learned…

Machine Learning · Statistics 2016-05-26 Simeng Qu , Xiao Wang

The power of sparse signal coding with learned dictionaries has been demonstrated in a variety of applications and fields, from signal processing to statistical inference and machine learning. However, the statistical properties of these…

Information Theory · Computer Science 2010-10-25 Ignacio Ramírez , Guillermo Sapiro

Sparse approximations using highly over-complete dictionaries is a state-of-the-art tool for many imaging applications including denoising, super-resolution, compressive sensing, light-field analysis, and object recognition. Unfortunately,…

Computer Vision and Pattern Recognition · Computer Science 2014-12-03 Ali Ayremlou , Thomas Goldstein , Ashok Veeraraghavan , Richard Baraniuk

Dictionary learning is the task of determining a data-dependent transform that yields a sparse representation of some observed data. The dictionary learning problem is non-convex, and usually solved via computationally complex iterative…

Machine Learning · Computer Science 2016-11-30 Cristian Rusu , Nuria Gonzalez-Prelcic , Robert Heath

Sparse representation using over-complete dictionaries have shown to produce good quality results in various image processing tasks. Dictionary learning algorithms have made it possible to engineer data adaptive dictionaries which have…

Image and Video Processing · Electrical Eng. & Systems 2019-11-11 Nishant Deepak Keni , Amol Mangirish Singbal , Rizwan Ahmed

A dictionary is a database of standard vectors, so that other vectors / signals are expressed as linear combinations of dictionary vectors, and the task of learning a dictionary for a given data is to find a good dictionary so that the…

Machine Learning · Computer Science 2020-07-09 Mohammed Rayyan Sheriff , Debasish Chatterjee

In this paper, it is proved that dictionary learning and sparse representation is invariant to a linear transformation. It subsumes the special case of transforming/projecting the data into a discriminative space. This is important because…

Computer Vision and Pattern Recognition · Computer Science 2015-06-12 Mehrdad J. Gangeh , Ali Ghodsi

The sparsity of natural signals and images in a transform domain or dictionary has been extensively exploited in several applications such as compression, denoising and inverse problems. More recently, data-driven adaptation of synthesis…

Machine Learning · Computer Science 2017-04-24 Saiprasad Ravishankar , Raj Rao Nadakuditi , Jeffrey A. Fessler

Sparsity driven signal processing has gained tremendous popularity in the last decade. At its core, the assumption is that the signal of interest is sparse with respect to either a fixed transformation or a signal dependent dictionary. To…

Computer Vision and Pattern Recognition · Computer Science 2014-06-10 Yuanming Suo , Minh Dao , Umamahesh Srinivas , Vishal Monga , Trac D. Tran

We consider the dictionary learning problem, where the aim is to model the given data as a linear combination of a few columns of a matrix known as a dictionary, where the sparse weights forming the linear combination are known as…

Machine Learning · Computer Science 2019-08-29 Sirisha Rambhatla , Xingguo Li , Jarvis Haupt

In this paper, we propose several dictionary learning algorithms for sparse representations that also impose specific structures on the learned dictionaries such that they are numerically efficient to use: reduced number of…

Machine Learning · Computer Science 2020-12-08 Cristian Rusu

Interpretability benefits the theoretical understanding of representations. Existing word embeddings are generally dense representations. Hence, the meaning of latent dimensions is difficult to interpret. This makes word embeddings like a…

Computation and Language · Computer Science 2023-06-27 Minxue Xia , Hao Zhu

Sparse dictionary coding represents signals as linear combinations of a few dictionary atoms. It has been applied to images, time series, graph signals and multi-way spatio-temporal data by jointly employing temporal and spatial…

Machine Learning · Computer Science 2025-09-15 Boya Ma , Abram Magner , Maxwell McNeil , Petko Bogdanov

We study the Dictionary Learning (aka Sparse Coding) problem of obtaining a sparse representation of data points, by learning \emph{dictionary vectors} upon which the data points can be written as sparse linear combinations. We view this…

Machine Learning · Computer Science 2015-03-09 Meera Sitharam , Mohamad Tarifi , Menghan Wang

Dictionary learning is a challenge topic in many image processing areas. The basic goal is to learn a sparse representation from an overcomplete basis set. Due to combining the advantages of generic multiscale representations with learning…

Computer Vision and Pattern Recognition · Computer Science 2017-04-17 Rui Chen , Huizhu Jia , Xiaodong Xie , Wen Gao

Many applications like audio and image processing show that sparse representations are a powerful and efficient signal modeling technique. Finding an optimal dictionary that generates at the same time the sparsest representations of data…

Machine Learning · Computer Science 2022-01-12 Paul Irofti , Cristian Rusu , Andrei Pătraşcu

Recent work has demonstrated that using a carefully designed dictionary instead of a predefined one, can improve the sparsity in jointly representing a class of signals. This has motivated the derivation of learning methods for designing a…

Information Theory · Computer Science 2010-05-04 Kevin Rosenblum , Lihi Zelnik-Manor , Yonina C. Eldar