English
Related papers

Related papers: Multi-Head Encoding for Extreme Label Classificati…

200 papers

Foundation models have revolutionized artificial intelligence across numerous domains, yet their transformative potential remains largely untapped in Extreme Multi-label Classification (XMC). Queries in XMC are associated with relevant…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Diego Ortego , Marlon Rodríguez , Mario Almagro , Kunal Dahiya , David Jiménez , Juan C. SanMiguel

Representing a true label as a one-hot vector is a common practice in training text classification models. However, the one-hot representation may not adequately reflect the relation between the instances and labels, as labels are often not…

Computation and Language · Computer Science 2020-12-10 Biyang Guo , Songqiao Han , Xiao Han , Hailiang Huang , Ting Lu

Extreme multi-label classification (XMC) seeks to find relevant labels from an extremely large label collection for a given text input. To tackle such a vast label space, current state-of-the-art methods fall into two categories. The…

Computation and Language · Computer Science 2025-02-18 Yau-Shian Wang , Wei-Cheng Chang , Jyun-Yu Jiang , Jiong Zhang , Hsiang-Fu Yu , S. V. N. Vishwanathan

Multi-label learning draws great interests in many real world applications. It is a highly costly task to assign many labels by the oracle for one instance. Meanwhile, it is also hard to build a good model without diagnosing discriminative…

Machine Learning · Computer Science 2019-04-16 Bo Du , Zengmao Wang , Lefei Zhang , Liangpei Zhang , Dacheng Tao

Multi-level Hierarchical Classification (MLHC) tackles the challenge of categorizing items within a complex, multi-layered class structure. However, traditional MLHC classifiers often rely on a backbone model with independent output layers,…

Artificial Intelligence · Computer Science 2025-01-14 Shijing Chen , Mohamed Reda Bouadjenek , Shoaib Jameel , Usman Naseem , Basem Suleiman , Flora D. Salim , Hakim Hacid , Imran Razzak

This paper develops the MUFIN technique for extreme classification (XC) tasks with millions of labels where datapoints and labels are endowed with visual and textual descriptors. Applications of MUFIN to product-to-product recommendation…

Uncertainty quantification is one of the most crucial tasks to obtain trustworthy and reliable machine learning models for decision making. However, most research in this domain has only focused on problems with small label spaces and…

Machine Learning · Computer Science 2022-10-20 Jyun-Yu Jiang , Wei-Cheng Chang , Jiong Zhong , Cho-Jui Hsieh , Hsiang-Fu Yu

Extreme classification tasks are multi-label tasks with an extremely large number of labels (tags). These tasks are hard because the label space is usually (i) very large, e.g. thousands or millions of labels, (ii) very sparse, i.e. very…

Machine Learning · Computer Science 2020-12-04 Elham J. Barezi , Iacer Calixto , Kyunghyun Cho , Pascale Fung

Multi-label classification (MLC) is an important class of machine learning problems that come with a wide spectrum of applications, each demanding a possibly different evaluation criterion. When solving the MLC problems, we generally expect…

Machine Learning · Computer Science 2019-10-08 Yao-Yuan Yang , Yi-An Lin , Hong-Min Chu , Hsuan-Tien Lin

In this paper, we introduce ML-Decoder, a new attention-based classification head. ML-Decoder predicts the existence of class labels via queries, and enables better utilization of spatial data compared to global average pooling. By…

Computer Vision and Pattern Recognition · Computer Science 2022-01-03 Tal Ridnik , Gilad Sharir , Avi Ben-Cohen , Emanuel Ben-Baruch , Asaf Noy

Deep extreme classification (XC) aims to train an encoder architecture and an accompanying classifier architecture to tag a data point with the most relevant subset of labels from a very large universe of labels. XC applications in ranking,…

Continual learning (CL) enables models to adapt to new tasks and environments without forgetting previously learned knowledge. While current CL setups have ignored the relationship between labels in the past task and the new task with or…

Machine Learning · Computer Science 2023-08-29 Byung Hyun Lee , Okchul Jung , Jonghyun Choi , Se Young Chun

Convolution Neural Networks (CNN) have performed well in many applications such as object detection, pattern recognition, video surveillance and so on. CNN carryout feature extraction on labelled data to perform classification. Multi-label…

Machine Learning · Computer Science 2021-01-28 Tolulope A. Odetola , Ogheneuriri Oderhohwo , Syed Rafay Hasan

Hierarchical multi-label text classification (HMTC) aims at utilizing a label hierarchy in multi-label classification. Recent approaches to HMTC deal with the problem of imposing an over-constrained premise on the output space by using…

Computation and Language · Computer Science 2024-06-21 Simon Yu , Jie He , Víctor Gutiérrez-Basulto , Jeff Z. Pan

Large output spaces, also referred to as Extreme multilabel classification (XMC), is a setting that arises, e.g., in large-scale tagging and product-to-product recommendation, and is characterized by the number of labels ranging from…

Machine Learning · Computer Science 2025-10-14 Jinbin Zhang , Nasib Ullah , Erik Schultheis , Rohit Babbar

Hierarchical multi-label classification (HMC) is a challenging classification task extending standard multi-label classification problems by imposing a hierarchy constraint on the classes. In this paper, we propose C-HMCNN(h), a novel…

Machine Learning · Computer Science 2021-11-29 Eleonora Giunchiglia , Thomas Lukasiewicz

Extreme multi-label text classification (XMTC) is the task of tagging each document with the relevant labels from a very large space of predefined categories. Recently, large pre-trained Transformer models have made significant performance…

Computation and Language · Computer Science 2022-04-05 Ruohong Zhang , Yau-Shian Wang , Yiming Yang , Tom Vu , Likun Lei

Clinical coding is the task of assigning a set of alphanumeric codes, referred to as ICD (International Classification of Diseases), to a medical event based on the context captured in a clinical narrative. The latest version of ICD,…

Computation and Language · Computer Science 2022-03-11 Cansu Sen , Bingyang Ye , Javed Aslam , Amir Tahmasebi

Variational mutual information (MI) estimators are widely used in unsupervised representation learning methods such as contrastive predictive coding (CPC). A lower bound on MI can be obtained from a multi-class classification problem, where…

Machine Learning · Computer Science 2020-12-04 Jiaming Song , Stefano Ermon

CXRs are a crucial and extraordinarily common diagnostic tool, leading to heavy research for CAD solutions. However, both high classification accuracy and meaningful model predictions that respect and incorporate clinical taxonomies are…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Haomin Chen , Shun Miao , Daguang Xu , Gregory D. Hager , Adam P. Harrison