English
Related papers

Related papers: Dictionary Learning with Almost Sure Error Constra…

200 papers

In this paper, we address the problem of discriminative dictionary learning (DDL), where sparse linear representation and classification are combined in a probabilistic framework. As such, a single discriminative dictionary and linear…

Computer Vision and Pattern Recognition · Computer Science 2011-09-13 Bernard Ghanem , Narendra Ahuja

Machine learning models are widely used for real-world applications, such as document analysis and vision. Constrained machine learning problems are problems where learned models have to both be accurate and respect constraints. For…

Machine Learning · Computer Science 2021-12-03 Guillaume Perez , Sebastian Ament , Carla Gomes , Arnaud Lallouet

Nonparametric estimation of the conditional distribution of a response given high-dimensional features is a challenging problem. It is important to allow not only the mean but also the variance and shape of the response density to change…

Machine Learning · Statistics 2013-12-05 Francesca Petralia , Joshua Vogelstein , David B. Dunson

Despite recent advances, Automatic Speech Recognition (ASR) systems are still far from perfect. Typical errors include acronyms, named entities, and domain-specific special words for which little or no labeled data is available. To address…

Computation and Language · Computer Science 2025-01-30 Christian Huber , Alexander Waibel

Sparse dictionary learning (SDL) has become a popular method for adaptively identifying parsimonious representations of a dataset, a fundamental problem in machine learning and signal processing. While most work on SDL assumes a training…

Statistics Theory · Mathematics 2018-02-27 Shashank Singh , Barnabás Póczos , Jian Ma

Obtaining meaningful solutions for inverse problems has been a major challenge with many applications in science and engineering. Recent machine learning techniques based on proximal and diffusion-based methods have shown promising results.…

Machine Learning · Computer Science 2024-02-08 Moshe Eliasof , Eldad Haber , Eran Treister

We study the problem of globally recovering a dictionary from a set of signals via $\ell_1$-minimization. We assume that the signals are generated as i.i.d. random linear combinations of the $K$ atoms from a complete reference dictionary…

Machine Learning · Statistics 2019-02-25 Yu Wang , Siqi Wu , Bin Yu

In conventional sparse representations based dictionary learning algorithms, initial dictionaries are generally assumed to be proper representatives of the system at hand. However, this may not be the case, especially in some systems…

Computer Vision and Pattern Recognition · Computer Science 2017-01-17 Yigit Oktar , Mehmet Turkan

This paper extends the recently proposed and theoretically justified iterative thresholding and $K$ residual means algorithm ITKrM to learning dicionaries from incomplete/masked training data (ITKrMM). It further adapts the algorithm to the…

Machine Learning · Computer Science 2018-04-04 Valeriya Naumova , Karin Schnass

Sparse representation using over-complete dictionaries have shown to produce good quality results in various image processing tasks. Dictionary learning algorithms have made it possible to engineer data adaptive dictionaries which have…

Image and Video Processing · Electrical Eng. & Systems 2019-11-11 Nishant Deepak Keni , Amol Mangirish Singbal , Rizwan Ahmed

We formulate problems of statistical recognition and learning in a common framework of complex hypothesis testing. Based on arguments from multi-criteria optimization, we identify strategies that are improper for solving these problems and…

Machine Learning · Computer Science 2015-09-30 Michail Schlesinger , Evgeniy Vodolazskiy

Mid-level features based on visual dictionaries are today a cornerstone of systems for classification and retrieval of images. Those state-of-the-art representations depend crucially on the choice of a codebook (visual dictionary), which is…

Computer Vision and Pattern Recognition · Computer Science 2015-03-20 Otavio A. B. Penatti , Eduardo Valle , Ricardo da S. Torres

Capturing the compositional process which maps the meaning of words to that of documents is a central challenge for researchers in Natural Language Processing and Information Retrieval. We introduce a model that is able to represent the…

Computation and Language · Computer Science 2014-06-17 Misha Denil , Alban Demiraj , Nal Kalchbrenner , Phil Blunsom , Nando de Freitas

There is growing body of learning problems for which it is natural to organize the parameters into matrix, so as to appropriately regularize the parameters under some matrix norm (in order to impose some more sophisticated prior knowledge).…

Machine Learning · Computer Science 2010-10-19 Sham M. Kakade , Shai Shalev-Shwartz , Ambuj Tewari

Statistical inverse learning aims at recovering an unknown function $f$ from randomly scattered and possibly noisy point evaluations of another function $g$, connected to $f$ via an ill-posed mathematical model. In this paper we blend…

Statistics Theory · Mathematics 2024-01-22 Tapio Helin

We propose a computationally efficient and high-performance classification algorithm by incorporating class structural information in analysis dictionary learning. To achieve more consistent classification, we associate a class…

Computer Vision and Pattern Recognition · Computer Science 2018-05-03 Wen Tang , Ashkan Panahi , Hamid Krim , Liyi Dai

Domain generalization is the problem of machine learning when the training data and the test data come from different data domains. We present a simple theoretical model of learning to generalize across domains in which there is a…

Machine Learning · Computer Science 2020-02-14 Vikas K. Garg , Adam Kalai , Katrina Ligett , Zhiwei Steven Wu

This paper provides a theoretical analysis of a new learning problem for recommender systems where users provide feedback by comparing pairs of items instead of rating them individually. We assume that comparisons stem from latent user and…

Machine Learning · Computer Science 2025-08-20 Suryanarayana Sankagiri , Jalal Etesami , Matthias Grossglauser

We discuss the feasibility of the following learning problem: given unmatched samples from two domains and nothing else, learn a mapping between the two, which preserves semantics. Due to the lack of paired samples and without any…

Machine Learning · Computer Science 2020-01-16 Tomer Galanti , Lior Wolf , Sagie Benaim

We introduce a novel way to incorporate prior information into (semi-) supervised non-negative matrix factorization, which we call differentiable dictionary search. It enables general, highly flexible and principled modelling of mixtures…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-29 Lukáš Samuel Marták , Rainer Kelz , Gerhard Widmer