English
Related papers

Related papers: Exploiting Local and Global Features in Transforme…

200 papers

Meta learning generalizes the empirical experience with different learning tasks and holds promise for providing important empirical insight into the behaviour of machine learning algorithms. In this paper, we present a comprehensive…

Machine Learning · Computer Science 2021-06-30 Jasmin Bogatinovski , Ljupčo Todorovski , Sašo Džeroski , Dragi Kocev

Semantic answer type prediction (SMART) is known to be a useful step towards effective question answering (QA) systems. The SMART task involves predicting the top-$k$ knowledge graph (KG) types for a given natural language question. This is…

Computation and Language · Computer Science 2023-04-28 Vinay Setty

Formality is one of the important characteristics of text documents. The automatic detection of the formality level of a text is potentially beneficial for various natural language processing tasks. Before, two large-scale datasets were…

Computation and Language · Computer Science 2023-09-11 Daryna Dementieva , Nikolay Babakov , Alexander Panchenko

Multi-label text classification (MLC) is a challenging task in settings of large label sets, where label support follows a Zipfian distribution. In this paper, we address this problem through retrieval augmentation, aiming to improve the…

Computation and Language · Computer Science 2023-05-23 Ilias Chalkidis , Yova Kementchedjhieva

Multi-Label Text Classification (MLTC) aims to assign the most relevant labels to each given text. Existing methods demonstrate that label dependency can help to improve the model's performance. However, the introduction of label dependency…

Computation and Language · Computer Science 2023-10-12 Caoyun Fan , Wenqing Chen , Jidong Tian , Yitian Li , Hao He , Yaohui Jin

Hierarchical text classification (HTC) is a natural language processing task which has the objective of categorising text documents into a set of classes from a predefined structured class hierarchy. Recent HTC approaches use various…

Computation and Language · Computer Science 2025-07-23 Jaco du Toit , Marcel Dunaiski

Extreme multi-label learning (XML) or classification has been a practical and important problem since the boom of big data. The main challenge lies in the exponential label space which involves $2^L$ possible label sets especially when the…

Machine Learning · Computer Science 2018-06-11 Wenjie Zhang , Junchi Yan , Xiangfeng Wang , Hongyuan Zha

Transformer has demonstrated its great power to learn contextual word representations for multiple languages in a single model. To process multilingual sentences in the model, a learnable vector is usually assigned to each language, which…

Computation and Language · Computer Science 2021-02-17 Shengjie Luo , Kaiyuan Gao , Shuxin Zheng , Guolin Ke , Di He , Liwei Wang , Tie-Yan Liu

Machine learning has played an important role in information retrieval (IR) in recent times. In search engines, for example, query keywords are accepted and documents are returned in order of relevance to the given query; this can be cast…

Machine Learning · Statistics 2018-02-13 Tatsuhiro Aoshima , Kei Kobayashi , Mihoko Minami

Assigning a set of labels to a given text is a classification problem with many real-world applications, such as recommender systems. Two separate research streams address this issue. Hierarchical Text Classification (HTC) focuses on…

Computation and Language · Computer Science 2026-01-27 Nerijus Bertalis , Paul Granse , Ferhat Gül , Florian Hauss , Leon Menkel , David Schüler , Tom Speier , Lukas Galke , Ansgar Scherp

The extreme multi-label classification (XMC) task aims at tagging content with a subset of labels from an extremely large label set. The label vocabulary is typically defined in advance by domain experts and assumed to capture all necessary…

Computation and Language · Computer Science 2022-05-13 Daniel Simig , Fabio Petroni , Pouya Yanki , Kashyap Popat , Christina Du , Sebastian Riedel , Majid Yazdani

Extreme Multi-label Text Classification (XMC) entails selecting the most relevant labels for an instance from a vast label set. Extreme Zero-shot XMC (EZ-XMC) extends this challenge by operating without annotated data, relying only on raw…

Machine Learning · Computer Science 2025-02-25 Jinbin Zhang , Nasib Ullah , Rohit Babbar

Representing a true label as a one-hot vector is a common practice in training text classification models. However, the one-hot representation may not adequately reflect the relation between the instances and labels, as labels are often not…

Computation and Language · Computer Science 2020-12-10 Biyang Guo , Songqiao Han , Xiao Han , Hailiang Huang , Ting Lu

The objective in extreme multi-label learning is to train a classifier that can automatically tag a novel data point with the most relevant subset of labels from an extremely large label set. Embedding based approaches make training and…

Machine Learning · Computer Science 2015-07-13 Kush Bhatia , Himanshu Jain , Purushottam Kar , Prateek Jain , Manik Varma

Large-scale Multi-label Text Classification (LMTC) has a wide range of Natural Language Processing (NLP) applications and presents interesting challenges. First, not all labels are well represented in the training set, due to the very large…

Computation and Language · Computer Science 2020-10-06 Ilias Chalkidis , Manos Fergadiotis , Sotiris Kotitsas , Prodromos Malakasiotis , Nikolaos Aletras , Ion Androutsopoulos

Multi-label text classification (MLTC) is the task of assigning multiple labels to a given text, and has a wide range of application domains. Most existing approaches require an enormous amount of annotated data to learn a classifier and/or…

Computation and Language · Computer Science 2023-09-26 Muberra Ozmen , Joseph Cotnareanu , Mark Coates

The massive scale and growth of textual biomedical data have made its indexing and classification increasingly important. However, existing research on this topic mainly utilized convolutional and recurrent neural networks, which generally…

Computation and Language · Computer Science 2022-03-08 Bruce Nguyen , Shaoxiong Ji

Machine learning-based multi-label medical text classifications can be used to enhance the understanding of the human body and aid the need for patient care. We present a broad study on clinical natural language processing techniques to…

Information Retrieval · Computer Science 2020-04-02 Vithya Yogarajan , Jacob Montiel , Tony Smith , Bernhard Pfahringer

Extreme multi-label classification (XMLC) is a learning task of tagging instances with a small subset of relevant labels chosen from an extremely large pool of possible labels. Problems of this scale can be efficiently handled by organizing…

Machine Learning · Computer Science 2020-09-24 Kalina Jasinska-Kobus , Marek Wydmuch , Krzysztof Dembczynski , Mikhail Kuznetsov , Robert Busa-Fekete

Multimodal multilabel classification (MMC) is a challenging task that aims to design a learning algorithm to handle two data sources, the image and text, and learn a comprehensive semantic feature presentation across the modalities. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Yanming Guo