English
Related papers

Related papers: An Incidence Geometry approach to Dictionary Learn…

200 papers

Recent work has demonstrated that using a carefully designed dictionary instead of a predefined one, can improve the sparsity in jointly representing a class of signals. This has motivated the derivation of learning methods for designing a…

Information Theory · Computer Science 2010-05-04 Kevin Rosenblum , Lihi Zelnik-Manor , Yonina C. Eldar

Sparsity-based models and techniques have been exploited in many signal processing and imaging applications. Data-driven methods based on dictionary and sparsifying transform learning enable learning rich image features from data, and can…

Machine Learning · Computer Science 2019-09-25 Saiprasad Ravishankar , Anna Ma , Deanna Needell

In the synthesis model signals are represented as a sparse combinations of atoms from a dictionary. Dictionary learning describes the acquisition process of the underlying dictionary for a given set of training samples. While ideally this…

Machine Learning · Statistics 2015-03-11 Matthias Seibert , Martin Kleinsteuber , Rémi Gribonval , Rodolphe Jenatton , Francis Bach

Recently, considerable research efforts have been devoted to the design of methods to learn from data overcomplete dictionaries for sparse coding. However, learned dictionaries require the solution of an optimization problem for coding new…

Machine Learning · Computer Science 2010-11-17 Curzio Basso , Matteo Santoro , Alessandro Verri , Silvia Villa

Interpretability benefits the theoretical understanding of representations. Existing word embeddings are generally dense representations. Hence, the meaning of latent dimensions is difficult to interpret. This makes word embeddings like a…

Computation and Language · Computer Science 2023-06-27 Minxue Xia , Hao Zhu

Sparse signal representations based on linear combinations of learned atoms have been used to obtain state-of-the-art results in several practical signal processing applications. Approximation methods are needed to process high-dimensional…

Machine Learning · Computer Science 2020-02-17 Fredrik Sandin , Sergio Martin-del-Campo

In recent years, a large amount of multi-disciplinary research has been conducted on sparse models and their applications. In statistics and machine learning, the sparsity principle is used to perform model selection---that is,…

Computer Vision and Pattern Recognition · Computer Science 2014-12-09 Julien Mairal , Francis Bach , Jean Ponce

In the dictionary learning (or sparse coding) problem, we are given a collection of signals (vectors in $\mathbb{R}^d$), and the goal is to find a "basis" in which the signals have a sparse (approximate) representation. The problem has…

Machine Learning · Computer Science 2019-05-30 Aditya Bhaskara , Wai Ming Tai

Performing signal processing tasks on compressive measurements of data has received great attention in recent years. In this paper, we extend previous work on compressive dictionary learning by showing that more general random projections…

Machine Learning · Statistics 2015-04-07 Farhad Pourkamali-Anaraki , Stephen Becker , Shannon M. Hughes

We propose a new outline for adaptive dictionary learning methods for sparse encoding based on a hierarchical clustering of the training data. Through recursive application of a clustering method, the data is organized into a binary…

Machine Learning · Computer Science 2020-06-11 Renato Budinich , Gerlind Plonka

The dictionary learning problem can be viewed as a data-driven process to learn a suitable transformation so that data is sparsely represented directly from example data. In this paper, we examine the problem of learning a dictionary that…

Optimization and Control · Mathematics 2026-02-05 Subhroshekhar Ghosh , Aaron Y. R. Low , Yong Sheng Soh , Zhuohang Feng , Brendan K. Y. Tan

This paper presents a structured dictionary-based model for hyperspectral data that incorporates both spectral and contextual characteristics of a spectral sample, with the goal of hyperspectral image classification. The idea is to…

Computer Vision and Pattern Recognition · Computer Science 2013-08-07 Ali Soltani-Farani , Hamid R. Rabiee , Seyyed Abbas Hosseini

In conventional sparse representations based dictionary learning algorithms, initial dictionaries are generally assumed to be proper representatives of the system at hand. However, this may not be the case, especially in some systems…

Computer Vision and Pattern Recognition · Computer Science 2017-01-17 Yigit Oktar , Mehmet Turkan

We review connections between coding-theoretic objects and sparse learning problems. In particular, we show how seemingly different combinatorial objects such as error-correcting codes, combinatorial designs, spherical codes, compressed…

Information Theory · Computer Science 2012-02-13 Mahdi Cheraghchi

Dictionary learning aims at seeking a dictionary under which the training data can be sparsely represented. Methods in the literature typically formulate the dictionary learning problem as an optimization w.r.t. two variables, i.e.,…

Signal Processing · Electrical Eng. & Systems 2021-10-27 Cheng Cheng , Wei Dai

Learning an encoding of feature vectors in terms of an over-complete dictionary or a information geometric (Fisher vectors) construct is wide-spread in statistical signal processing and computer vision. In content based information…

Information Retrieval · Computer Science 2017-11-15 B Sengupta , E Vasquez , Y Qian

We are often interested in decomposing complex, structured data into simple components that explain the data. The linear version of this problem is well-studied as dictionary learning and factor analysis. In this work, we propose a…

Machine Learning · Computer Science 2024-07-29 Avrim Blum , Kavya Ravichandran

Dictionary learning is a key tool for representation learning, that explains the data as linear combination of few basic elements. Yet, this analysis is not amenable in the context of graph learning, as graphs usually belong to different…

Machine Learning · Computer Science 2021-09-21 Cédric Vincent-Cuaz , Titouan Vayer , Rémi Flamary , Marco Corneli , Nicolas Courty

In this paper, we propose a new joint dictionary learning method for example-based image super-resolution (SR), using sparse representation. The low-resolution (LR) dictionary is trained from a set of LR sample image patches. Using the…

Computer Vision and Pattern Recognition · Computer Science 2017-01-13 Mojtaba Sahraee-Ardakan , Mohsen Joneidi

We propose a novel sparse dictionary learning method for planar shapes in the sense of Kendall, namely configurations of landmarks in the plane considered up to similitudes. Our shape dictionary method provides a good trade-off between…

Image and Video Processing · Electrical Eng. & Systems 2020-01-14 Anna Song , Virginie Uhlmann , Julien Fageot , Michael Unser