English
Related papers

Related papers: Learning Mixtures of Separable Dictionaries for Te…

200 papers

We consider the problem of dictionary learning under the assumption that the observed signals can be represented as sparse linear combinations of the columns of a single large dictionary matrix. In particular, we analyze the minimax risk of…

Machine Learning · Statistics 2014-06-30 Alexander Jung , Yonina C. Eldar , Norbert Görtz

In the last decade, traditional dictionary learning methods have been successfully applied to various pattern classification tasks. Although these methods produce sparse representations of signals which are robust against distortions and…

Machine Learning · Computer Science 2018-12-05 R. E. Rolón , L. E. Di Persia , R. D. Spies , H. L. Rufiner

Recently Chen and Poor initiated the study of learning mixtures of linear dynamical systems. While linear dynamical systems already have wide-ranging applications in modeling time-series data, using mixture models can lead to a better fit…

Machine Learning · Computer Science 2023-07-25 Ainesh Bakshi , Allen Liu , Ankur Moitra , Morris Yau

In Compressed Sensing, a real-valued sparse vector has to be estimated from an underdetermined system of linear equations. In many applications, however, the elements of the sparse vector are drawn from a finite set. For the estimation of…

Information Theory · Computer Science 2016-08-24 Susanne Sparrer , Robert F. H. Fischer

In the mixture models problem it is assumed that there are $K$ distributions $\theta_{1},\ldots,\theta_{K}$ and one gets to observe a sample from a mixture of these distributions with unknown coefficients. The goal is to associate instances…

Machine Learning · Statistics 2013-12-02 Jason D Lee , Ran Gilad-Bachrach , Rich Caruana

Learned data models based on sparsity are widely used in signal processing and imaging applications. A variety of methods for learning synthesis dictionaries, sparsifying transforms, etc., have been proposed in recent years, often imposing…

Machine Learning · Computer Science 2018-10-22 Saiprasad Ravishankar , Brendt Wohlberg

In this letter, we propose a novel computationally efficient coupled dictionary learning method that enforces pairwise correlation between the atoms of dictionaries learned to represent the underlying feature spaces of two different…

Machine Learning · Computer Science 2021-09-29 F. G. Veshki , S. A. Vorobyov

Methods exploiting sparsity have been popular in imaging and signal processing applications including compression, denoising, and imaging inverse problems. Data-driven approaches such as dictionary learning and transform learning enable one…

Machine Learning · Computer Science 2018-02-05 Saiprasad Ravishankar , Anna Ma , Deanna Needell

Unsupervised methods have proven effective for discriminative tasks in a single-modality scenario. In this paper, we present a multimodal framework for learning sparse representations that can capture semantic correlation between…

Machine Learning · Computer Science 2016-03-03 Miriam Cha , Youngjune Gwon , H. T. Kung

Distributed representations of meaning are a natural way to encode covariance relationships between words and phrases in NLP. By overcoming data sparsity problems, as well as providing information about semantic relatedness which is not…

Computation and Language · Computer Science 2014-03-21 Karl Moritz Hermann , Phil Blunsom

In data processing and machine learning, an important challenge is to recover and exploit models that can represent accurately the data. We consider the problem of recovering Gaussian mixture models from datasets. We investigate symmetric…

Algebraic Geometry · Mathematics 2022-06-22 Rima Khouja , Pierre-Alexandre Mattei , Bernard Mourrain

Many applications like audio and image processing show that sparse representations are a powerful and efficient signal modeling technique. Finding an optimal dictionary that generates at the same time the sparsest representations of data…

Machine Learning · Computer Science 2022-01-12 Paul Irofti , Cristian Rusu , Andrei Pătraşcu

The problem of partitioning a large and sparse tensor is considered, where the tensor consists of a sequence of adjacency matrices. Theory is developed that is a generalization of spectral graph partitioning. A best rank-$(2,2,\lambda)$…

Numerical Analysis · Mathematics 2020-12-17 Lars Eldén , Maryam Dehghan

In the co-sparse analysis model a set of filters is applied to a signal out of the signal class of interest yielding sparse filter responses. As such, it may serve as a prior in inverse problems, or for structural analysis of signals that…

Machine Learning · Computer Science 2015-10-07 Matthias Seibert , Julian Wörmann , Rémi Gribonval , Martin Kleinsteuber

Word embeddings -- distributed representations of words -- in deep learning are beneficial for many tasks in natural language processing (NLP). However, different embedding sets vary greatly in quality and characteristics of the captured…

Computation and Language · Computer Science 2015-12-31 Wenpeng Yin , Hinrich Schütze

Supervised Dictionary Learning has gained much interest in the recent decade and has shown significant performance improvements in image classification. However, in general, supervised learning needs a large number of labelled samples per…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Khanh-Hung Tran , Fred-Maurice Ngole-Mboula , Jean-Luc Starck , Vincent Prost

Words can have multiple senses. Compositional distributional models of meaning have been argued to deal well with finer shades of meaning variation known as polysemy, but are not so well equipped to handle word senses that are…

Computation and Language · Computer Science 2020-10-13 Francois Meyer , Martha Lewis

This work examines a semi-blind single-channel source separation problem. Our specific aim is to separate one source whose local structure is approximately known, from another a priori unspecified background source, given only a single…

Sound · Computer Science 2015-01-27 Sirisha Rambhatla , Jarvis D. Haupt

Convolutional sparse coding (CSC) has been popularly used for the learning of shift-invariant dictionaries in image and signal processing. However, existing methods have limited scalability. In this paper, instead of convolving with a…

Computer Vision and Pattern Recognition · Computer Science 2018-06-08 Yaqing Wang , Quanming Yao , James T. Kwok , Lionel M. Ni

In this paper, we propose a supervised dictionary learning algorithm that aims to preserve the local geometry in both dimensions of the data. A graph-based regularization explicitly takes into account the local manifold structure of the…

Machine Learning · Computer Science 2018-06-15 Yael Yankelevsky , Michael Elad