English
Related papers

Related papers: Minimax Lower Bounds for Kronecker-Structured Dict…

200 papers

This paper provides fundamental limits on the sample complexity of estimating dictionaries for tensor data. The specific focus of this work is on $K$th-order tensor data and the case where the underlying dictionary can be expressed in terms…

Information Theory · Computer Science 2018-04-24 Zahra Shakeri , Waheed U. Bajwa , Anand D. Sarwate

We consider the problem of dictionary learning under the assumption that the observed signals can be represented as sparse linear combinations of the columns of a single large dictionary matrix. In particular, we analyze the minimax risk of…

Machine Learning · Statistics 2014-06-30 Alexander Jung , Yonina C. Eldar , Norbert Görtz

This paper derives sufficient conditions for local recovery of coordinate dictionaries comprising a Kronecker-structured dictionary that is used for representing $K$th-order tensor data. Tensor observations are assumed to be generated from…

Machine Learning · Statistics 2018-10-03 Zahra Shakeri , Anand D. Sarwate , Waheed U. Bajwa

We consider the problem of learning a dictionary matrix from a number of observed signals, which are assumed to be generated via a linear model with a common underlying dictionary. In particular, we derive lower bounds on the minimum…

Machine Learning · Statistics 2015-07-21 Alexander Jung , Yonina C. Eldar , Norbert Görtz

In the synthesis model signals are represented as a sparse combinations of atoms from a dictionary. Dictionary learning describes the acquisition process of the underlying dictionary for a given set of training samples. While ideally this…

Machine Learning · Statistics 2015-03-11 Matthias Seibert , Martin Kleinsteuber , Rémi Gribonval , Rodolphe Jenatton , Francis Bach

The idea that many important classes of signals can be well-represented by linear combinations of a small set of atoms selected from a given dictionary has had dramatic impact on the theory and practice of signal processing. For practical…

Information Theory · Computer Science 2015-03-18 Quan Geng , Huan Wang , John Wright

A popular approach within the signal processing and machine learning communities consists in modelling signals as sparse linear combinations of atoms selected from a learned dictionary. While this paradigm has led to numerous empirical…

Machine Learning · Statistics 2012-10-03 Rodolphe Jenatton , Rémi Gribonval , Francis Bach

A dictionary is a database of standard vectors, so that other vectors / signals are expressed as linear combinations of dictionary vectors, and the task of learning a dictionary for a given data is to find a good dictionary so that the…

Machine Learning · Computer Science 2020-07-09 Mohammed Rayyan Sheriff , Debasish Chatterjee

This work addresses the problem of learning sparse representations of tensor data using structured dictionary learning. It proposes learning a mixture of separable dictionaries to better capture the structure of tensor data by generalizing…

Machine Learning · Computer Science 2020-06-16 Mohsen Ghassemi , Zahra Shakeri , Anand D. Sarwate , Waheed U. Bajwa

A large set of signals can sometimes be described sparsely using a dictionary, that is, every element can be represented as a linear combination of few elements from the dictionary. Algorithms for various signal processing applications,…

Machine Learning · Statistics 2013-02-06 Daniel Vainsencher , Shie Mannor , Alfred M. Bruckstein

We develop a minimax theory for operator learning, where the goal is to estimate an unknown operator between separable Hilbert spaces from finitely many noisy input-output samples. For uniformly bounded Lipschitz operators, we prove…

Statistics Theory · Mathematics 2026-03-06 Ben Adcock , Gregor Maier , Rahul Parhi

In this paper, we propose a novel tensor learning and coding model for third-order data completion. Our model is to learn a data-adaptive dictionary from the given observations, and determine the coding coefficients of third-order tensor…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 Tai-Xiang Jiang , Xi-Le Zhao , Hao Zhang , Michael K. Ng

We consider tomographic reconstruction using priors in the form of a dictionary learned from training images. The reconstruction has two stages: first we construct a tensor dictionary prior from our training data, and then we pose the…

Computer Vision and Pattern Recognition · Computer Science 2015-06-17 Sara Soltani , Misha E. Kilmer , Per Christian Hansen

A popular approach within the signal processing and machine learning communities consists in modelling signals as sparse linear combinations of atoms selected from a learned dictionary. While this paradigm has led to numerous empirical…

Machine Learning · Computer Science 2015-08-25 Rémi Gribonval , Rodolphe Jenatton , Francis Bach

We consider the problem of noiseless and noisy low-rank tensor completion from a set of random linear measurements. In our derivations, we assume that the entries of the tensor belong to a finite field of arbitrary size and that…

Information Theory · Computer Science 2011-04-05 Amin Emad , Olgica Milenkovic

This paper studies a tensor-structured linear regression model with a scalar response variable and tensor-structured predictors, such that the regression parameters form a tensor of order $d$ (i.e., a $d$-fold multiway array) in…

Machine Learning · Computer Science 2020-11-26 Talal Ahmed , Haroon Raja , Waheed U. Bajwa

Dictionary learning is a widely used technique in signal processing and machine learning that aims to represent data as a linear combination of a few elements from an overcomplete dictionary. In this work, we propose a generalization of the…

Numerical Analysis · Mathematics 2025-03-13 Ferdaous Ait Addi , Abdeslem Hafid Bentbib , Khalide Jbilou

In recent years, a class of dictionaries have been proposed for multidimensional (tensor) data representation that exploit the structure of tensor data by imposing a Kronecker structure on the dictionary underlying the data. In this work, a…

Machine Learning · Statistics 2017-11-15 Mohsen Ghassemi , Zahra Shakeri , Anand D. Sarwate , Waheed U. Bajwa

A method for online tensor dictionary learning is proposed. With the assumption of separable dictionaries, tensor contraction is used to diminish a $N$-way model of $\mathcal{O}\left(L^N\right)$ into a simple matrix equation of…

Machine Learning · Computer Science 2020-03-11 Thiernithi Variddhisai , Danilo Mandic

Topic models have become popular tools for dimension reduction and exploratory analysis of text data which consists in observed frequencies of a vocabulary of $p$ words in $n$ documents, stored in a $p\times n$ matrix. The main premise is…

Machine Learning · Statistics 2020-01-23 Xin Bing , Florentina Bunea , Marten Wegkamp
‹ Prev 1 2 3 10 Next ›