English
Related papers

Related papers: Overcomplete Dictionary Learning with Jacobi Atom …

200 papers

Sparse representations with learned dictionaries have been successful in several image analysis applications. In this paper, we propose and analyze the framework of ensemble sparse models, and demonstrate their utility in image restoration…

Computer Vision and Pattern Recognition · Computer Science 2013-02-28 Karthikeyan Natesan Ramamurthy , Jayaraman J. Thiagarajan , Prasanna Sattigeri , Andreas Spanias

Dictionary learning aims to find a dictionary under which the training data can be sparsely represented, and it is usually achieved by iteratively applying two stages: sparse coding and dictionary update. Typical methods for dictionary…

Signal Processing · Electrical Eng. & Systems 2021-10-26 Cheng Cheng , Wei Dai

Recently, great attention was intended toward overcomplete dictionaries and the sparse representations they can provide. In a wide variety of signal processing problems, sparsity serves a crucial property leading to high performance.…

Multimedia · Computer Science 2008-12-15 SeyyedMajid Valiollahzadeh , Mohammad Nazari , Massoud Babaie-Zadeh , Christian Jutten

Many natural signals exhibit a sparse representation, whenever a suitable describing model is given. Here, a linear generative model is considered, where many sparsity-based signal processing techniques rely on such a simplified model. As…

Machine Learning · Computer Science 2013-06-11 Mehrdad Yaghoobi , Laurent Daudet , Michael E. Davies

Sparse representation, which uses dictionary atoms to reconstruct input vectors, has been studied intensively in recent years. A proper dictionary is a key for the success of sparse representation. In this paper, an active dictionary…

Computer Vision and Pattern Recognition · Computer Science 2014-09-30 Jin Xu , Haibo He , Hong Man

Audio events are quite often overlapping in nature, and more prone to noise than visual signals. There has been increasing evidence for the superior performance of representations learned using sparse dictionaries for applications like…

Machine Learning · Computer Science 2017-12-05 Vaisakh Shaj , Puranjoy Bhattacharya

In this paper, we describe a new algorithm that approximates the extreme eigenvalue/eigenvector pairs of a symmetric matrix. The proposed algorithm can be viewed as an extension of the Jacobi eigenvalue method for symmetric matrices…

Numerical Analysis · Mathematics 2025-09-16 Cristian Rusu

We consider the problem of learning overcomplete dictionaries in the context of sparse coding, where each sample selects a sparse subset of dictionary elements. Our main result is a strategy to approximately recover the unknown dictionary…

Machine Learning · Statistics 2014-07-08 Alekh Agarwal , Animashree Anandkumar , Praneeth Netrapalli

Recently, considerable research efforts have been devoted to the design of methods to learn from data overcomplete dictionaries for sparse coding. However, learned dictionaries require the solution of an optimization problem for coding new…

Machine Learning · Computer Science 2010-11-17 Curzio Basso , Matteo Santoro , Alessandro Verri , Silvia Villa

Parallel decoding methods such as Jacobi decoding show promise for more efficient LLM inference as it breaks the sequential nature of the LLM decoding process and transforms it into parallelizable computation. However, in practice, it…

Computation and Language · Computer Science 2024-06-14 Siqi Kou , Lanxiang Hu , Zhezhi He , Zhijie Deng , Hao Zhang

It is now well established that sparse signal models are well suited to restoration tasks and can effectively be learned from audio, image, and video data. Recent research has been aimed at learning discriminative sparse models instead of…

Computer Vision and Pattern Recognition · Computer Science 2009-09-29 Julien Mairal , Francis Bach , Jean Ponce , Guillermo Sapiro , Andrew Zisserman

We propose an efficient online dictionary learning algorithm for kernel-based sparse representations. In this framework, input signals are nonlinearly mapped to a high-dimensional feature space and represented sparsely using a virtual…

Machine Learning · Computer Science 2025-07-03 Ghasem Alipoor , Karl Skretting

Sparsity-based models and techniques have been exploited in many signal processing and imaging applications. Data-driven methods based on dictionary and sparsifying transform learning enable learning rich image features from data, and can…

Machine Learning · Computer Science 2019-09-25 Saiprasad Ravishankar , Anna Ma , Deanna Needell

We propose a new method for learning word representations using hierarchical regularization in sparse coding inspired by the linguistic study of word meanings. We show an efficient learning algorithm based on stochastic proximal methods…

Computation and Language · Computer Science 2014-11-07 Dani Yogatama , Manaal Faruqui , Chris Dyer , Noah A. Smith

We propose a Bayesian approach to learn discriminative dictionaries for sparse representation of data. The proposed approach infers probability distributions over the atoms of a discriminative dictionary using a Beta Process. It also…

Computer Vision and Pattern Recognition · Computer Science 2015-03-30 Naveed Akhtar , Faisal Shafait , Ajmal Mian

This paper presents a method for learning overcomplete dictionaries composed of two modalities that describe a 3D scene: image intensity and scene depth. We propose a novel Joint Basis Pursuit (JBP) algorithm that finds related sparse…

Computer Vision and Pattern Recognition · Computer Science 2013-09-20 Ivana Tosic , Sarah Drewes

Sparse representation using over-complete dictionaries have shown to produce good quality results in various image processing tasks. Dictionary learning algorithms have made it possible to engineer data adaptive dictionaries which have…

Image and Video Processing · Electrical Eng. & Systems 2019-11-11 Nishant Deepak Keni , Amol Mangirish Singbal , Rizwan Ahmed

In sparse signal representation, the choice of a dictionary often involves a tradeoff between two desirable properties -- the ability to adapt to specific signal data and a fast implementation of the dictionary. To sparsely represent…

Machine Learning · Computer Science 2015-06-18 Dorina Thanou , David I Shuman , Pascal Frossard

Many applications in signal processing benefit from the sparsity of signals in a certain transform domain or dictionary. Synthesis sparsifying dictionaries that are directly adapted to data have been popular in applications such as image…

Machine Learning · Statistics 2015-06-23 Saiprasad Ravishankar , Yoram Bresler

In this paper we study the sparse coding problem in the context of sparse dictionary learning for image recovery. To this end, we consider and compare several state-of-the-art sparse optimization methods constructed using the shrinkage…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Shima Shabani , Mohammadsadegh Khoshghiaferezaee , Michael Breuß