English
Related papers

Related papers: Cross Encoding as Augmentation: Towards Effective …

200 papers

The great majority of languages in the world are considered under-resourced for the successful application of deep learning methods. In this work, we propose a meta-learning approach to document classification in limited-resource setting…

Computation and Language · Computer Science 2021-04-27 Niels van der Heijden , Helen Yannakoudakis , Pushkar Mishra , Ekaterina Shutova

Text data augmentation is a complex problem due to the discrete nature of sentences. Although rule-based augmentation methods are widely adopted in real-world applications because of their simplicity, they suffer from potential semantic…

Computation and Language · Computer Science 2024-02-09 Juhwan Choi , Kyohoon Jin , Junho Lee , Sangmin Song , Youngbin Kim

Text classification is a fundamental problem in information retrieval with many real-world applications, such as predicting the topics of online articles and the categories of e-commerce product descriptions. However, low-resource text…

Information Retrieval · Computer Science 2023-05-08 Zhihao Wen , Yuan Fang

Text classification must sometimes be applied in a low-resource language with no labeled training data. However, training data may be available in a related language. We investigate whether character-level knowledge transfer from a related…

Computation and Language · Computer Science 2020-04-29 Mozhi Zhang , Yoshinari Fujinuma , Jordan Boyd-Graber

We present a supervised learning algorithm for text categorization which has brought the team of authors the 2nd place in the text categorization division of the 2012 Cybersecurity Data Mining Competition (CDMC'2012) and a 3rd prize…

Information Retrieval · Computer Science 2013-07-11 Hubert Haoyang Duan , Vladimir Pestov , Varun Singla

Automatic Text Categorization (TC) is a complex and useful task for many natural language applications, and is usually performed through the use of a set of manually classified documents, a training collection. We suggest the utilization of…

cmp-lg · Computer Science 2008-02-03 Manuel de Buenaga Rodriguez , Jose Maria Gomez Hidalgo , Belen Diaz Agudo

In this paper we discuss several issues related to automated text classification of web sites. We analyze the nature of web content and metadata in relation to requirements for text features. We find that HTML metatags are a good source of…

Information Retrieval · Computer Science 2007-05-23 John M. Pierre

Unsupervised pre-training has led to much recent progress in natural language understanding. In this paper, we study self-training as another way to leverage unlabeled data through semi-supervised learning. To obtain additional data for a…

Computation and Language · Computer Science 2020-10-06 Jingfei Du , Edouard Grave , Beliz Gunel , Vishrav Chaudhary , Onur Celebi , Michael Auli , Ves Stoyanov , Alexis Conneau

Cross-modal text-molecule retrieval task bridges molecule structures and natural language descriptions. Existing methods predominantly focus on aligning text modality and molecule modality, yet they overlook adaptively adjusting the…

Computation and Language · Computer Science 2025-02-18 Hongyan Wu , Peijian Zeng , Weixiong Zheng , Lianxi Wang , Nankai Lin , Shengyi Jiang , Aimin Yang

Word embeddings are effective intermediate representations for capturing semantic regularities between words, when learning the representations of text sequences. We propose to view text classification as a label-word joint embedding…

Computation and Language · Computer Science 2018-05-14 Guoyin Wang , Chunyuan Li , Wenlin Wang , Yizhe Zhang , Dinghan Shen , Xinyuan Zhang , Ricardo Henao , Lawrence Carin

Like many other domains in Artificial Intelligence (AI), there are specific tasks in the field of AI in Education (AIEd) for which labels are scarce and expensive, such as predicting exam score or review correctness. A common way of…

Effective representation learning is critical for short text clustering due to the sparse, high-dimensional and noise attributes of short text corpus. Existing pre-trained models (e.g., Word2vec and BERT) have greatly improved the…

Computation and Language · Computer Science 2021-09-22 Hui Yin , Xiangyu Song , Shuiqiao Yang , Guangyan Huang , Jianxin Li

Image classification is a primary task in data analysis where explainable models are crucially demanded in various applications. Although amounts of methods have been proposed to obtain explainable knowledge from the black-box classifiers,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Ruitao Xie , Jingbang Chen , Limai Jiang , Rui Xiao , Yi Pan , Yunpeng Cai

Task specific fine-tuning of a pre-trained neural language model using a custom softmax output layer is the de facto approach of late when dealing with document classification problems. This technique is not adequate when labeled examples…

Computation and Language · Computer Science 2020-10-27 Natraj Raman , Armineh Nourbakhsh , Sameena Shah , Manuela Veloso

Categorizing documents into a given label hierarchy is intuitively appealing due to the ubiquity of hierarchical topic structures in massive text corpora. Although related studies have achieved satisfying performance in fully supervised…

Computation and Language · Computer Science 2023-10-24 Yu Zhang , Xiusi Chen , Yu Meng , Jiawei Han

Continual learning is a process that involves training learning agents to sequentially master a stream of tasks or classes without revisiting past data. The challenge lies in leveraging previously acquired knowledge to learn new tasks…

Machine Learning · Computer Science 2024-02-21 Marcus de Carvalho , Mahardhika Pratama , Jie Zhang , Chua Haoyan , Edward Yapp

Automatic short answer scoring is one of the text classification problems to assess students' answers during exams automatically. Several challenges can arise in making an automatic short answer scoring system, one of which is the quantity…

Computation and Language · Computer Science 2021-03-24 Rian Adam Rajagede , Rochana Prih Hastuti

This paper tackles one of the greatest limitations in Machine Learning: Data Scarcity. Specifically, we explore whether high accuracy classifiers can be built from small datasets, utilizing a combination of data augmentation techniques and…

Computation and Language · Computer Science 2020-07-03 Chetanya Rastogi , Nikka Mofid , Fang-I Hsiao

Employing clustering strategy to assign unlabeled target images with pseudo labels has become a trend for person re-identification (re-ID) algorithms in domain adaptation. A potential limitation of these clustering-based methods is that…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Suncheng Xiang , Yuzhuo Fu , Mengyuan Guan , Ting Liu

Many applications require categorization of text documents using predefined categories. The main approach to performing text categorization is learning from labeled examples. For many tasks, it may be difficult to find examples in one…

Computation and Language · Computer Science 2018-02-13 Sarai Duek , Shaul Markovitch