English
Related papers

Related papers: Learning Word Representations with Hierarchical Sp…

200 papers

We investigate the use of sparse coding and dictionary learning in the context of multitask and transfer learning. The central assumption of our learning method is that the tasks parameters are well approximated by sparse linear…

Machine Learning · Computer Science 2014-06-17 Andreas Maurer , Massimiliano Pontil , Bernardino Romera-Paredes

The aim of this paper is to introduce a novel dictionary learning algorithm for sparse representation of signals defined over combinatorial topological spaces, specifically, regular cell complexes. Leveraging Hodge theory, we embed topology…

Signal Processing · Electrical Eng. & Systems 2025-03-17 Enrico Grimaldi , Claudio Battiloro , Paolo Di Lorenzo

Interpretability benefits the theoretical understanding of representations. Existing word embeddings are generally dense representations. Hence, the meaning of latent dimensions is difficult to interpret. This makes word embeddings like a…

Computation and Language · Computer Science 2023-06-27 Minxue Xia , Hao Zhu

Convolutional Sparse Coding (CSC) is an increasingly popular model in the signal and image processing communities, tackling some of the limitations of traditional patch-based sparse representations. Although several works have addressed the…

Computer Vision and Pattern Recognition · Computer Science 2017-05-10 Vardan Papyan , Yaniv Romano , Jeremias Sulam , Michael Elad

In recent studies in hyperspectral imaging, biometrics and energy analytics, the framework of deep dictionary learning has shown promise. Deep dictionary learning outperforms other traditional deep learning tools when training data is…

Image and Video Processing · Electrical Eng. & Systems 2019-12-24 Vanika Singhal , Angshul Majumdar

Learning representations of stochastic processes is an emerging problem in machine learning with applications from meta-learning to physical object models to time series. Typical methods rely on exact reconstruction of observations, but…

Machine Learning · Statistics 2021-11-01 Emile Mathieu , Adam Foster , Yee Whye Teh

Deep dictionary learning seeks multiple dictionaries at different image scales to capture complementary coherent characteristics. We propose a method for learning a hierarchy of synthesis dictionaries with an image classification goal. The…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Shahin Mahdizadehaghdam , Ashkan Panahi , Hamid Krim , Liyi Dai

Recent works on word representations mostly rely on predictive models. Distributed word representations (aka word embeddings) are trained to optimally predict the contexts in which the corresponding words tend to appear. Such models have…

Computation and Language · Computer Science 2015-04-10 Rémi Lebret , Ronan Collobert

Attributes of words and relations between two words are central to numerous tasks in Artificial Intelligence such as knowledge representation, similarity measurement, and analogy detection. Often when two words share one or more attributes…

Computation and Language · Computer Science 2014-12-09 Danushka Bollegala , Takanori Maehara , Yuichi Yoshida , Ken-ichi Kawarabayashi

In this letter, we propose a novel computationally efficient coupled dictionary learning method that enforces pairwise correlation between the atoms of dictionaries learned to represent the underlying feature spaces of two different…

Machine Learning · Computer Science 2021-09-29 F. G. Veshki , S. A. Vorobyov

Distributed word representations are widely used for modeling words in NLP tasks. Most of the existing models generate one representation per word and do not consider different meanings of a word. We present two approaches to learn multiple…

Computation and Language · Computer Science 2018-02-14 Marzieh Fadaee , Arianna Bisazza , Christof Monz

In this paper, we propose an effective scene text recognition method using sparse coding based features, called Histograms of Sparse Codes (HSC) features. For character detection, we use the HSC features instead of using the Histograms of…

Computer Vision and Pattern Recognition · Computer Science 2015-12-31 Da-Han Wang , Hanzi Wang , Dong Zhang , Jonathan Li , David Zhang

Combining the representations of the words that make up a sentence into a cohesive whole is difficult, since it needs to account for the order of words, and to establish how the words present relate to each other. The solution we propose…

Computation and Language · Computer Science 2021-03-04 Diego Maupomé , Marie-Jean Meurs

We present sparse topical coding (STC), a non-probabilistic formulation of topic models for discovering latent representations of large collections of data. Unlike probabilistic topic models, STC relaxes the normalization constraint of…

Machine Learning · Computer Science 2012-02-20 Jun Zhu , Eric P. Xing

Classifiers based on sparse representations have recently been shown to provide excellent results in many visual recognition and classification tasks. However, the high cost of computing sparse representations at test time is a major…

Computer Vision and Pattern Recognition · Computer Science 2014-10-03 Alhussein Fawzi , Mike Davies , Pascal Frossard

Hierarchical semantic structures naturally exist in an image dataset, in which several semantically relevant image clusters can be further integrated into a larger cluster with coarser-grained semantics. Capturing such structures with image…

Computer Vision and Pattern Recognition · Computer Science 2022-05-24 Yuanfan Guo , Minghao Xu , Jiawen Li , Bingbing Ni , Xuanyu Zhu , Zhenbang Sun , Yi Xu

Hypernymy, textual entailment, and image captioning can be seen as special cases of a single visual-semantic hierarchy over words, sentences, and images. In this paper we advocate for explicitly modeling the partial order structure of this…

Machine Learning · Computer Science 2016-03-02 Ivan Vendrov , Ryan Kiros , Sanja Fidler , Raquel Urtasun

In this paper we propose and carefully evaluate a sequence labeling framework which solely utilizes sparse indicator features derived from dense distributed word representations. The proposed model obtains (near) state-of-the art…

Computation and Language · Computer Science 2016-12-22 Gábor Berend

Automatic annotation of images with descriptive words is a challenging problem with vast applications in the areas of image search and retrieval. This problem can be viewed as a label-assignment problem by a classifier dealing with a very…

Computer Vision and Pattern Recognition · Computer Science 2017-05-09 Amara Tariq , Hassan Foroosh

We propose an algorithm for rotational sparse coding along with an efficient implementation using steerability. Sparse coding (also called dictionary learning) is an important technique in image processing, useful in inverse problems,…

Image and Video Processing · Electrical Eng. & Systems 2020-01-31 Michael T. McCann , Vincent Andrearczyk , Michael Unser , Adrien Depeursinge