English
Related papers

Related papers: Pretrained Generalized Autoregressive Model with A…

200 papers

Multi-label text classification (MLTC) is an attractive and challenging task in natural language processing (NLP). Compared with single-label text classification, MLTC has a wider range of applications in practice. In this paper, we propose…

Computation and Language · Computer Science 2022-05-24 Irene Li , Aosong Feng , Hao Wu , Tianxiao Li , Toyotaro Suzumura , Ruihai Dong

We consider the task of Extreme Multi-Label Text Classification (XMTC) in the legal domain. We release a new dataset of 57k legislative documents from EURLEX, the European Union's public document database, annotated with concepts from…

Computation and Language · Computer Science 2019-05-28 Ilias Chalkidis , Manos Fergadiotis , Prodromos Malakasiotis , Nikolaos Aletras , Ion Androutsopoulos

In the context of Extreme Multi-label Text Classification (XMTC), where labels are assigned to text instances from a large label space, the long-tail distribution of labels presents a significant challenge. Labels can be broadly categorized…

Information Retrieval · Computer Science 2025-07-08 Celso França , Gestefane Rabbi , Thiago Salles , Washington Cunha , Leonardo Rocha , Marcos André Gonçalves

Fine-tuning Large Language Models (LLMs) is now a common approach for text classification in a wide range of applications. When labeled documents are scarce, active learning helps save annotation efforts but requires retraining of massive…

Machine Learning · Computer Science 2024-02-27 Artem Vysogorets , Achintya Gopal

Extreme multi-label classification (XMC) aims to learn a model that can tag data points with a subset of relevant labels from an extremely large label set. Real world e-commerce applications like personalized recommendations and product…

Machine Learning · Computer Science 2021-09-23 Tavor Z. Baharav , Daniel L. Jiang , Kedarnath Kolluri , Sujay Sanghavi , Inderjit S. Dhillon

Extreme multi-label classification (XMLC) is a problem of tagging an instance with a small subset of relevant labels chosen from an extremely large pool of possible labels. Large label spaces can be efficiently handled by organizing labels…

Machine Learning · Computer Science 2018-10-30 Marek Wydmuch , Kalina Jasinska , Mikhail Kuznetsov , Róbert Busa-Fekete , Krzysztof Dembczyński

People use search engines for various topics and items, from daily essentials to more aspirational and specialized objects. Therefore, search engines have taken over as peoples preferred resource. The How To prefix has become familiar and…

Computation and Language · Computer Science 2025-12-23 Tanjim Taharat Aurpa , Md Shoaib Ahmed , Md Mahbubur Rahman , Md. Golam Moazzam

The propensity model introduced by Jain et al. 2016 has become a standard approach for dealing with missing and long-tail labels in extreme multi-label classification (XMLC). In this paper, we critically revise this approach showing that…

Machine Learning · Computer Science 2022-07-28 Erik Schultheis , Marek Wydmuch , Rohit Babbar , Krzysztof Dembczyński

Extreme Multi-label classification (XML) is an important yet challenging machine learning task, that assigns to each instance its most relevant candidate labels from an extremely large label collection, where the numbers of labels, features…

Machine Learning · Computer Science 2019-04-15 Bingyu Wang , Li Chen , Wei Sun , Kechen Qin , Kefeng Li , Hui Zhou

Scalability and accuracy are well recognized challenges in deep extreme multi-label learning where the objective is to train architectures for automatically annotating a data point with the most relevant subset of labels from an extremely…

Machine Learning · Computer Science 2021-11-15 Kunal Dahiya , Deepak Saini , Anshul Mittal , Ankush Shaw , Kushal Dave , Akshay Soni , Himanshu Jain , Sumeet Agarwal , Manik Varma

We present a novel and scalable label embedding framework for large-scale multi-label learning a.k.a ExMLDS (Extreme Multi-Label Learning using Distributional Semantics). Our approach draws inspiration from ideas rooted in distributional…

Machine Learning · Computer Science 2017-11-13 Rahul Wadbude , Vivek Gupta , Piyush Rai , Nagarajan Natarajan , Harish Karnick , Prateek Jain

With the capability of modeling bidirectional contexts, denoising autoencoding based pretraining like BERT achieves better performance than pretraining approaches based on autoregressive language modeling. However, relying on corrupting the…

Computation and Language · Computer Science 2020-01-03 Zhilin Yang , Zihang Dai , Yiming Yang , Jaime Carbonell , Ruslan Salakhutdinov , Quoc V. Le

Extreme multi-label text classification (XMC) seeks to find relevant labels from an extreme large label collection for a given text input. Many real-world applications can be formulated as XMC problems, such as recommendation systems,…

Machine Learning · Computer Science 2021-11-01 Jiong Zhang , Wei-cheng Chang , Hsiang-fu Yu , Inderjit S. Dhillon

CNNs, RNNs, GCNs, and CapsNets have shown significant insights in representation learning and are widely used in various text mining tasks such as large-scale multi-label text classification. However, most existing deep models for…

Information Retrieval · Computer Science 2019-06-13 Hao Peng , Jianxin Li , Qiran Gong , Senzhang Wang , Lifang He , Bo Li , Lihong Wang , Philip S. Yu

Existing class-incremental lifelong learning studies only the data is with single-label, which limits its adaptation to multi-label data. This paper studies Lifelong Multi-Label (LML) classification, which builds an online class-incremental…

Machine Learning · Computer Science 2022-07-19 Kaile Du , Linyan Li , Fan Lyu , Fuyuan Hu , Zhenping Xia , Fenglei Xu

Text classification is crucial for applications such as sentiment analysis and toxic text filtering, but it still faces challenges due to the complexity and ambiguity of natural language. Recent advancements in deep learning, particularly…

Computation and Language · Computer Science 2024-08-29 Lingyu Gao

Large-scale Multi-label Text Classification (LMTC) has a wide range of Natural Language Processing (NLP) applications and presents interesting challenges. First, not all labels are well represented in the training set, due to the very large…

Computation and Language · Computer Science 2020-10-06 Ilias Chalkidis , Manos Fergadiotis , Sotiris Kotitsas , Prodromos Malakasiotis , Nikolaos Aletras , Ion Androutsopoulos

Prompt Tuning is emerging as a scalable and cost-effective method to fine-tune Pretrained Language Models (PLMs), which are often referred to as Large Language Models (LLMs). This study benchmarks the performance and computational…

Computation and Language · Computer Science 2024-04-15 Valentin Leonhard Buchner , Lele Cao , Jan-Christoph Kalo , Vilhelm von Ehrenheim

This paper proposes a Clustering, Labeling, then Augmenting framework that significantly enhances performance in Semi-Supervised Text Classification (SSTC) tasks, effectively addressing the challenge of vast datasets with limited labeled…

Computation and Language · Computer Science 2024-12-30 Shan Zhong , Jiahao Zeng , Yongxin Yu , Bohong Lin

Neural networks have recently been proposed for multi-label classification because they are able to capture and model label dependencies in the output layer. In this work, we investigate limitations of BP-MLL, a neural network (NN)…

Machine Learning · Computer Science 2020-12-09 Jinseok Nam , Jungi Kim , Eneldo Loza Mencía , Iryna Gurevych , Johannes Fürnkranz