English
Related papers

Related papers: Trustworthy Long-Tailed Classification

200 papers

Integrating supervised contrastive loss to cross entropy-based communication has recently been proposed as a solution to address the long-tail learning problem. However, when the class imbalance ratio is high, it requires adjusting the…

Machine Learning · Computer Science 2024-07-10 Charika De Alvis , Dishanika Denipitiyage , Suranga Seneviratne

Real-world data usually couples the label ambiguity and heavy imbalance, challenging the algorithmic robustness of partial label learning (PLL) and long-tailed learning (LT). The straightforward combination of LT and PLL, i.e., LT-PLL,…

Machine Learning · Computer Science 2023-02-13 Feng Hong , Jiangchao Yao , Zhihan Zhou , Ya Zhang , Yanfeng Wang

Conventional knowledge distillation, designed for model compression, fails on long-tailed distributions because the teacher model tends to be biased toward head classes and provides limited supervision for tail classes. We propose…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Seonghak Kim

Recognition problems in long-tailed data, in which the sample size per class is heavily skewed, have gained importance because the distribution of the sample size per class in a dataset is generally exponential unless the sample size is…

Machine Learning · Computer Science 2024-04-30 Naoya Hasegawa , Issei Sato

There is an inescapable long-tailed class-imbalance issue in many real-world classification problems. Current methods for addressing this problem only consider scenarios where all examples come from the same distribution. However, in many…

Machine Learning · Computer Science 2023-10-09 Xinyu Yang , Huaxiu Yao , Allan Zhou , Chelsea Finn

The networks trained on the long-tailed dataset vary remarkably, despite the same training settings, which shows the great uncertainty in long-tailed learning. To alleviate the uncertainty, we propose a Nested Collaborative Learning (NCL),…

Computer Vision and Pattern Recognition · Computer Science 2022-04-20 Jun Li , Zichang Tan , Jun Wan , Zhen Lei , Guodong Guo

Long-tailed instance segmentation is a challenging task due to the extreme imbalance of training samples among classes. It causes severe biases of the head classes (with majority samples) against the tailed ones. This renders "how to…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Yin-Yin He , Peizhen Zhang , Xiu-Shen Wei , Xiangyu Zhang , Jian Sun

Despite impressive accuracy, deep neural networks are often miscalibrated and tend to overly confident predictions. Recent techniques like temperature scaling (TS) and label smoothing (LS) show effectiveness in obtaining a well-calibrated…

Computer Vision and Pattern Recognition · Computer Science 2021-09-14 Mobarakol Islam , Lalithkumar Seenivasan , Hongliang Ren , Ben Glocker

Long-tailed recognition with imbalanced class distribution naturally emerges in practical machine learning applications. Existing methods such as data reweighing, resampling, and supervised contrastive learning enforce the class balance…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Chengkai Hou , Jieyu Zhang , Haonan Wang , Tianyi Zhou

Real-world visual data often exhibits a long-tailed distribution, where some ''head'' classes have a large number of samples, yet only a few samples are available for ''tail'' classes. Such imbalanced distribution causes a great challenge…

Computer Vision and Pattern Recognition · Computer Science 2020-03-11 Junjie Zhang , Lingqiao Liu , Peng Wang , Chunhua Shen

Real-world datasets usually are class-imbalanced and corrupted by label noise. To solve the joint issue of long-tailed distribution and label noise, most previous works usually aim to design a noise detector to distinguish the noisy and…

Machine Learning · Computer Science 2024-04-11 Zhuo Li , He Zhao , Zhen Li , Tongliang Liu , Dandan Guo , Xiang Wan

Large language models (LLMs) have demonstrated remarkable capabilities across diverse tasks. However, the truthfulness of their outputs is not guaranteed, and their tendency toward overconfidence further limits reliability. Uncertainty…

Computation and Language · Computer Science 2026-03-23 Qi Cao , Andrew Gambardella , Takeshi Kojima , Yutaka Matsuo , Yusuke Iwasawa

Multi-label classification has received considerable interest in recent years. Multi-label classifiers have to address many problems including: handling large-scale datasets with many instances and a large set of labels, compensating…

Machine Learning · Computer Science 2016-06-21 Amirhossein Akbarnejad , Mahdieh Soleymani Baghshah

Extreme multi-label classification (XMLC) is the task of selecting a small subset of relevant labels from a very large set of possible labels. As such, it is characterized by long-tail labels, i.e., most labels have very few positive…

Machine Learning · Computer Science 2024-01-19 Erik Schultheis , Marek Wydmuch , Wojciech Kotłowski , Rohit Babbar , Krzysztof Dembczyński

In this paper, we propose an Aligned Contrastive Learning (ACL) algorithm to address the long-tailed recognition problem. Our findings indicate that while multi-view training boosts the performance, contrastive learning does not…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Jiali Ma , Jiequan Cui , Maeno Kazuki , Lakshmi Subramanian , Karlekar Jayashree , Sugiri Pranata , Hanwang Zhang

The imbalance (or long-tail) is the nature of many real-world data distributions, which often induces the undesirable bias of deep classification models toward frequent classes, resulting in poor performance for tail classes. In this paper,…

Machine Learning · Computer Science 2025-10-13 Fudong Lin , Xu Yuan

In this work, we tackle the challenging problem of long-tailed image recognition. Previous long-tailed recognition approaches mainly focus on data augmentation or re-balancing strategies for the tail classes to give them more attention…

Computer Vision and Pattern Recognition · Computer Science 2023-09-15 Weide Liu , Zhonghua Wu , Yiming Wang , Henghui Ding , Fayao Liu , Jie Lin , Guosheng Lin

Out-of-distribution (OOD) detection is crucial for deploying robust machine learning models. However, when training data follows a long-tailed distribution, the model's ability to accurately detect OOD samples is significantly compromised,…

Machine Learning · Computer Science 2025-09-26 Shuai Feng , Yuxin Ge , Yuntao Du , Mingcai Chen , Chongjun Wang , Lei Feng

Large language models (LLMs) can learn vast amounts of knowledge from diverse domains during pre-training. However, long-tail knowledge from specialized domains is often scarce and underrepresented, rarely appearing in the models'…

Computation and Language · Computer Science 2025-02-11 Shuyang Yu , Runxue Bao , Parminder Bhatia , Taha Kass-Hout , Jiayu Zhou , Cao Xiao

Many real-world recognition problems are characterized by long-tailed label distributions. These distributions make representation learning highly challenging due to limited generalization over the tail classes. If the test distribution…

Computer Vision and Pattern Recognition · Computer Science 2023-06-08 Emanuel Sanchez Aimar , Arvi Jonnarth , Michael Felsberg , Marco Kuhlmann