English
Related papers

Related papers: Distributional Inclusion Vector Embedding for Unsu…

200 papers

This paper presents a new semi-supervised framework with convolutional neural networks (CNNs) for text categorization. Unlike the previous approaches that rely on word embeddings, our method learns embeddings of small text regions from…

Machine Learning · Statistics 2015-11-03 Rie Johnson , Tong Zhang

Neural embeddings are a popular set of methods for representing words, phrases or text as a low dimensional vector (typically 50-500 dimensions). However, it is difficult to interpret these dimensions in a meaningful manner, and creating…

Computation and Language · Computer Science 2018-01-10 Neil R. Smalheiser , Gary Bonifield

Text Classification is one of the fundamental tasks in natural language processing, which requires an agent to determine the most appropriate category for input sentences. Recently, deep neural networks have achieved impressive performance…

Computation and Language · Computer Science 2023-06-16 Kun Zhang , Le Wu , Guangyi Lv , Enhong Chen , Shulan Ruan , Jing Liu , Zhiqiang Zhang , Jun Zhou , Meng Wang

Distributional semantics creates vector-space representations that capture many forms of semantic similarity, but their relation to semantic entailment has been less clear. We propose a vector-space model which provides a formal foundation…

Computation and Language · Computer Science 2016-07-14 James Henderson , Diana Nicoleta Popa

We present LEAR (Lexical Entailment Attract-Repel), a novel post-processing method that transforms any input word vector space to emphasise the asymmetric relation of lexical entailment (LE), also known as the IS-A or hyponymy-hypernymy…

Computation and Language · Computer Science 2018-04-20 Ivan Vulić , Nikola Mrkšić

In this paper, we propose a deep invertible hybrid model which integrates discriminative and generative learning at a latent space level for semi-supervised few-shot classification. Various tasks for classifying new species from image data…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Yusuke Ohtsubo , Tetsu Matsukawa , Einoshin Suzuki

Distributed word embeddings have yielded state-of-the-art performance in many NLP tasks, mainly due to their success in capturing useful semantic information. These representations assign only a single vector to each word whereas a large…

Machine Learning · Computer Science 2020-02-04 Shobhit Jain , Sravan Babu Bodapati , Ramesh Nallapati , Anima Anandkumar

Deep convolutional neural networks (CNNs) have demonstrated remarkable success in computer vision by supervisedly learning strong visual feature representations. However, training CNNs relies heavily on the availability of exhaustive…

Computer Vision and Pattern Recognition · Computer Science 2019-05-31 Jiabo Huang , Qi Dong , Shaogang Gong , Xiatian Zhu

Distributed word embeddings have shown superior performances in numerous Natural Language Processing (NLP) tasks. However, their performances vary significantly across different tasks, implying that the word embeddings learnt by those…

Computation and Language · Computer Science 2017-09-21 Danushka Bollegala , Kohei Hayashi , Ken-ichi Kawarabayashi

This paper investigates the problem of image classification with limited or no annotations, but abundant unlabeled data. The setting exists in many tasks such as semi-supervised image classification, image clustering, and image retrieval.…

Computer Vision and Pattern Recognition · Computer Science 2016-02-05 Dengxin Dai , Luc Van Gool

Pre-trained word embeddings learned from unlabeled text have become a standard component of neural network architectures for NLP tasks. However, in most cases, the recurrent network that operates on word-level representations to produce…

Computation and Language · Computer Science 2017-05-02 Matthew E. Peters , Waleed Ammar , Chandra Bhagavatula , Russell Power

We present a new approach to extraction of hypernyms based on projection learning and word embeddings. In contrast to classification-based approaches, projection-based methods require no candidate hyponym-hypernym pairs. While it is natural…

Computation and Language · Computer Science 2018-05-21 Dmitry Ustalov , Nikolay Arefyev , Chris Biemann , Alexander Panchenko

Deep clustering against self-supervised learning is a very important and promising direction for unsupervised visual representation learning since it requires little domain knowledge to design pretext tasks. However, the key component,…

Computer Vision and Pattern Recognition · Computer Science 2020-08-21 Weijie Chen , Shiliang Pu , Di Xie , Shicai Yang , Yilu Guo , Luojun Lin

Word embedding is a Natural Language Processing (NLP) technique that automatically maps words from a vocabulary to vectors of real numbers in an embedding space. It has been widely used in recent years to boost the performance of a vari-ety…

Computation and Language · Computer Science 2017-09-25 Arpita Roy , Youngja Park , SHimei Pan

This thesis presents new methods for unsupervised learning of distributed representations of words and entities from text and knowledge bases. The first algorithm presented in the thesis is a multi-view algorithm for learning…

Computation and Language · Computer Science 2019-06-14 Pushpendre Rastogi

Unsupervised word embeddings have been shown to be valuable as features in supervised learning problems; however, their role in unsupervised problems has been less thoroughly explored. In this paper, we show that embeddings can likewise add…

Computation and Language · Computer Science 2015-03-24 Chu-Cheng Lin , Waleed Ammar , Chris Dyer , Lori Levin

We study in this paper the improvement of one-class support vector machines (OC-SVM) through sparse representation techniques for unsupervised anomaly detection. As Dictionary Learning (DL) became recently a common analysis technique that…

Machine Learning · Computer Science 2024-04-08 Paul Irofti , Iulian-Andrei Hîji , Andrei Pătraşcu , Nicolae Cleju

Unsupervised approaches to learning in neural networks are of substantial interest for furthering artificial intelligence, both because they would enable the training of networks without the need for large numbers of expensive annotations,…

Computer Vision and Pattern Recognition · Computer Science 2019-04-11 Chengxu Zhuang , Alex Lin Zhai , Daniel Yamins

Due to abundance of data from multiple modalities, cross-modal retrieval tasks with image-text, audio-image, etc. are gaining increasing importance. Of the different approaches proposed, supervised methods usually give significant…

Computer Vision and Pattern Recognition · Computer Science 2020-01-03 Devraj Mandal , Pramod Rao , Soma Biswas

The label-embedded dictionary learning (DL) algorithms generate influential dictionaries by introducing discriminative information. However, there exists a limitation: All the label-embedded DL methods rely on the labels due that this way…

Machine Learning · Computer Science 2021-12-06 Shuai Shao , Lei Xing , Wei Yu , Rui Xu , Yanjiang Wang , Baodi Liu