English
Related papers

Related papers: Multi-Label Text Classification using Attention-ba…

200 papers

Learning algorithms normally assume that there is at most one annotation or label per data point. However, in some scenarios, such as medical diagnosis and on-line collaboration,multiple annotations may be available. In either case,…

Machine Learning · Computer Science 2012-03-19 Yan Yan , Romer Rosales , Glenn Fung , Jennifer Dy

Machine learning approaches to multi-label document classification have to date largely relied on discriminative modeling techniques such as support vector machines. A drawback of these approaches is that performance rapidly drops off as…

Machine Learning · Statistics 2011-11-11 Timothy N. Rubin , America Chambers , Padhraic Smyth , Mark Steyvers

In multi-label classification, each training instance is associated with multiple class labels simultaneously. Unfortunately, collecting the fully precise class labels for each training instance is time- and labor-consuming for real-world…

Machine Learning · Computer Science 2024-03-26 Meng Wei , Zhongnian Li , Peng Ying , Yong Zhou , Xinzheng Xu

Learning an effective representation in multi-label text classification (MLTC) is a significant challenge in NLP. This challenge arises from the inherent complexity of the task, which is shaped by two key factors: the intricate connections…

Machine Learning · Computer Science 2024-04-16 Alexandre Audibert , Aurélien Gauffre , Massih-Reza Amini

Neural network-based approaches have become the driven forces for Natural Language Processing (NLP) tasks. Conventionally, there are two mainstream neural architectures for NLP tasks: the recurrent neural network (RNN) and the convolution…

Computation and Language · Computer Science 2020-08-13 Zhenyu Liu , Chaohong Lu , Haiwei Huang , Shengfei Lyu , Zhenchao Tao

In multi-label classification tasks, each problem instance is associated with multiple classes simultaneously. In such settings, the correlation between labels contains valuable information that can be used to obtain more accurate…

Machine Learning · Computer Science 2020-07-24 Shabnam Nazmi , Xuyang Yan , Abdollah Homaifar , Emily Doucette

Graph Neural Networks (GNNs) have recently been used for node and graph classification tasks with great success, but GNNs model dependencies among the attributes of nearby neighboring nodes rather than dependencies among observed node…

Machine Learning · Computer Science 2020-09-30 Mengyue Hang , Jennifer Neville , Bruno Ribeiro

Named entity recognition is one of the core tasks in NLP. Although many improvements have been made on this task during the last years, the state-of-the-art systems do not explicitly take into account the recursive nature of language.…

Computation and Language · Computer Science 2019-09-12 Gustavo Aguilar , Thamar Solorio

Graph neural networks (GNNs) achieve remarkable success in graph-based semi-supervised node classification, leveraging the information from neighboring nodes to improve the representation learning of target node. The success of GNNs at node…

Machine Learning · Computer Science 2020-07-28 Bingbing Xu , Junjie Huang , Liang Hou , Huawei Shen , Jinhua Gao , Xueqi Cheng

Computational social science (CSS) practitioners often rely on human-labeled data to fine-tune supervised text classifiers. We assess the potential for researchers to augment or replace human-generated training data with surrogate training…

Computation and Language · Computer Science 2024-06-26 Nicholas Pangakis , Samuel Wolken

Multitask learning (MTL) has recently gained a lot of popularity as a learning paradigm that can lead to improved per-task performance while also using fewer per-task model parameters compared to single task learning. One of the biggest…

Computer Vision and Pattern Recognition · Computer Science 2022-01-27 Dimitrios Sinodinos , Narges Armanfard

Distance-based unsupervised text classification is a method within text classification that leverages the semantic similarity between a label and a text to determine label relevance. This method provides numerous benefits, including fast…

Computation and Language · Computer Science 2025-10-14 Jens Van Nooten , Andriy Kosar , Guy De Pauw , Walter Daelemans

Recent studies often exploit Graph Convolutional Network (GCN) to model label dependencies to improve recognition accuracy for multi-label image recognition. However, constructing a graph by counting the label co-occurrence possibilities of…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Jin Ye , Junjun He , Xiaojiang Peng , Wenhao Wu , Yu Qiao

Modeling label correlations has always played a pivotal role in multi-label image classification (MLC), attracting significant attention from researchers. However, recent studies have overemphasized co-occurrence relationships among labels,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 LeiLei Ma , Shuo Xu , MingKun Xie , Lei Wang , Dengdi Sun , Haifeng Zhao

Multi-headed attention heads are a mainstay in transformer-based models. Different methods have been proposed to classify the role of each attention head based on the relations between tokens which have high pair-wise attention. These roles…

Computation and Language · Computer Science 2021-01-25 Madhura Pande , Aakriti Budhraja , Preksha Nema , Pratyush Kumar , Mitesh M. Khapra

Extractive summarization and imbalanced multi-label classification often require vast amounts of training data to avoid overfitting. In situations where training data is expensive to generate, leveraging information between tasks is an…

Computation and Language · Computer Science 2019-03-19 John Brandt

This paper presents a contextualized graph attention network that combines edge features and multiple sub-graphs for improving relation extraction. A novel method is proposed to use multiple sub-graphs to learn rich node representations in…

Computation and Language · Computer Science 2020-04-23 Angrosh Mandya , Danushka Bollegala , Frans Coenen

Similarity-based method gives rise to a new class of methods for multi-label learning and also achieves promising performance. In this paper, we generalize this method, resulting in a new framework for classification task. Specifically, we…

Machine Learning · Computer Science 2022-03-08 Zhongchen Ma , Songcan Chen

The primary challenge of multi-label active learning, differing it from multi-class active learning, lies in assessing the informativeness of an indefinite number of labels while also accounting for the inherited label correlation. Existing…

Machine Learning · Computer Science 2025-09-05 Yuanyuan Qi , Jueqing Lu , Xiaohao Yang , Joanne Enticott , Lan Du

Multi-label Text Classification (MLTC) is the task of categorizing documents into one or more topics. Considering the large volumes of data and varying domains of such tasks, fully supervised learning requires manually fully annotated…

Computation and Language · Computer Science 2022-10-28 Ziwen Liu , Josep Grau-Bove , Scott Allan Orr