English
Related papers

Related papers: Rethinking Skip-thought: A Neighborhood based Appr…

200 papers

Graph embedding techniques have led to significant progress in recent years. However, present techniques are not effective enough to capture the patterns of networks. This paper propose neighbor2vec, a neighbor-based sampling strategy used…

Social and Information Networks · Computer Science 2022-01-11 Zhiming Lin

Semantic textual similarity is one of the open research challenges in the field of Natural Language Processing. Extensive research has been carried out in this field and near-perfect results are achieved by recent transformer-based models…

Computation and Language · Computer Science 2021-07-13 Dhivya Chandrasekaran , Vijay Mago

In relation extraction with distant supervision, noisy labels make it difficult to train quality models. Previous neural models addressed this problem using an attention mechanism that attends to sentences that are likely to express the…

Computation and Language · Computer Science 2019-04-09 Iz Beltagy , Kyle Lo , Waleed Ammar

Pre-trained language models have brought significant improvements in performance in a variety of natural language processing tasks. Most existing models performing state-of-the-art results have shown their approaches in the separate…

Computation and Language · Computer Science 2022-04-05 Changwook Jun , Hansol Jang , Myoseop Sim , Hyun Kim , Jooyoung Choi , Kyungkoo Min , Kyunghoon Bae

Few-shot text classification systems have impressive capabilities but are infeasible to deploy and use reliably due to their dependence on prompting and billion-parameter language models. SetFit (Tunstall et al., 2022) is a recent,…

Computation and Language · Computer Science 2024-01-30 Luke Bates , Iryna Gurevych

Nearest neighbor search aims to obtain the samples in the database with the smallest distances from them to the queries, which is a basic task in a range of fields, including computer vision and data mining. Hashing is one of the most…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Xiao Luo , Haixin Wang , Daqing Wu , Chong Chen , Minghua Deng , Jianqiang Huang , Xian-Sheng Hua

In this paper, we investigate the usage of autoencoders in modeling textual data. Traditional autoencoders suffer from at least two aspects: scalability with the high dimensionality of vocabulary size and dealing with task-irrelevant words.…

Machine Learning · Computer Science 2015-12-15 Shuangfei Zhai , Zhongfei Zhang

This paper draws a parallel between similarity-based categorisation models developed in cognitive psychology and the nearest neighbour classifier (1-NN) in machine learning. Conceived as a result of the historical rivalry between prototype…

Artificial Intelligence · Computer Science 2018-06-05 Julian Zubek , Ludmila Kuncheva

In this paper we propose to augment a modern neural-network architecture with an attention model inspired by human perception. Specifically, we adversarially train and analyze a neural model incorporating a human inspired, visual attention…

Computer Vision and Pattern Recognition · Computer Science 2019-12-06 Daniel Zoran , Mike Chrzanowski , Po-Sen Huang , Sven Gowal , Alex Mott , Pushmeet Kohl

Recurrent Neural Networks are showing much promise in many sub-areas of natural language processing, ranging from document classification to machine translation to automatic question answering. Despite their promise, many recurrent models…

Computation and Language · Computer Science 2017-05-02 Adams Wei Yu , Hongrae Lee , Quoc V. Le

We present a system for bottom-up cumulative learning of myriad concepts corresponding to meaningful character strings, and their part-related and prediction edges. The learning is self-supervised in that the concepts discovered are used as…

Machine Learning · Computer Science 2021-12-20 Omid Madani

We propose an autoregressive entity linking model, that is trained with two auxiliary tasks, and learns to re-rank generated samples at inference time. Our proposed novelties address two weaknesses in the literature. First, a recent method…

Computation and Language · Computer Science 2022-04-13 Khalil Mrini , Shaoliang Nie , Jiatao Gu , Sinong Wang , Maziar Sanjabi , Hamed Firooz

Estimating the parameters of a model describing a set of observations using a neural network is in general solved in a supervised way. In cases when we do not have access to the model's true parameters this approach can not be applied.…

Astrophysics of Galaxies · Physics 2020-09-30 Miguel A. Aragon-Calvo

Sequence-to-Sequence (seq2seq) modeling has rapidly become an important general-purpose NLP tool that has proven effective for many text-generation and sequence-labeling tasks. Seq2seq builds on deep neural language modeling and inherits…

Computation and Language · Computer Science 2016-11-11 Sam Wiseman , Alexander M. Rush

Question Answering (QA) is fundamental to natural language processing in that most nlp problems can be phrased as QA (Kumar et al., 2015). Current weakly supervised memory network models that have been proposed so far struggle at answering…

Neural and Evolutionary Computing · Computer Science 2015-12-24 Ethan Caballero

Local learning methods are a popular class of machine learning algorithms. The basic idea for the entire cadre is to choose some non-local model family, to train many of them on small sections of neighboring data, and then to `stitch' the…

Machine Learning · Computer Science 2020-04-15 CScott Brown

The training of deep-learning-based text classification models relies heavily on a huge amount of annotation data, which is difficult to obtain. When the labeled data is scarce, models tend to struggle to achieve satisfactory performance.…

Computation and Language · Computer Science 2020-04-07 Dianbo Sui , Yubo Chen , Binjie Mao , Delai Qiu , Kang Liu , Jun Zhao

There is a large variation in the activities that humans perform in their everyday lives. We consider modeling these composite human activities which comprises multiple basic level actions in a completely unsupervised setting. Our model…

Computer Vision and Pattern Recognition · Computer Science 2016-03-14 Chenxia Wu , Jiemi Zhang , Ozan Sener , Bart Selman , Silvio Savarese , Ashutosh Saxena

Establishing dense correspondences across semantically similar images remains a challenging task due to the significant intra-class variations and background clutters. Traditionally, a supervised learning was used for training the models,…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Jiwon Kim , Kwangrok Ryoo , Junyoung Seo , Gyuseong Lee , Daehwan Kim , Hansang Cho , Seungryong Kim

The rapid growth of Internet services and mobile devices provides an excellent opportunity to satisfy the strong demand for the personalized item or product recommendation. However, with the tremendous increase of users and items,…

Information Retrieval · Computer Science 2018-12-10 Chen Ma , Peng Kang , Bin Wu , Qinglong Wang , Xue Liu