English
Related papers

Related papers: Generalized Category Discovery under the Long-Tail…

200 papers

Real-world data often exhibits long tail distributions with heavy class imbalance, where the majority classes can dominate the training process and alter the decision boundaries of the minority classes. Recently, researchers have…

Computer Vision and Pattern Recognition · Computer Science 2022-05-03 Tianhong Li , Peng Cao , Yuan Yuan , Lijie Fan , Yuzhe Yang , Rogerio Feris , Piotr Indyk , Dina Katabi

Long-tail imbalance is endemic to multi-label learning: a few head labels dominate the gradient signal, while the many rare labels that matter in practice are silently ignored. We tackle this problem by casting the task as a cooperative…

Machine Learning · Computer Science 2025-10-21 Canran Xiao , Chuangxin Zhao , Zong Ke , Fei Shen

Long-tailed object detection faces great challenges because of its extremely imbalanced class distribution. Recent methods mainly focus on the classification bias and its loss function design, while ignoring the subtle influence of the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Ke Zhu , Minghao Fu , Jie Shao , Tianyu Liu , Jianxin Wu

Long-tailed classification is challenging due to its heavy imbalance in class probabilities. While existing methods often focus on overall accuracy or accuracy for tail classes, they overlook a critical aspect: certain types of errors can…

Machine Learning · Computer Science 2025-01-27 Bolian Li , Ruqi Zhang

Generalized Category Discovery (GCD) aims to identify both known and unknown categories, with only partial labels given for the known categories, posing a challenging open-set recognition problem. State-of-the-art approaches for GCD task…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Wei He , Xianghan Meng , Zhiyuan Huang , Xianbiao Qi , Rong Xiao , Chun-Guang Li

Detecting out-of-distribution (OOD) data is essential for safe deployment of deep neural networks (DNNs). This problem becomes particularly challenging in the presence of long-tailed in-distribution (ID) datasets, often leading to high…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Nimeshika Udayangani , Hadi M. Dolatabadi , Sarah Erfani , Christopher Leckie

Real-world datasets often exhibit long-tailed distributions, where a few dominant "Head" classes have abundant samples while most "Tail" classes are severely underrepresented, leading to biased learning and poor generalization for the Tail.…

Machine Learning · Computer Science 2026-02-02 Mahdiyar Molahasani , Michael Greenspan , Ali Etemad

We suggest a simple Gaussian mixture model for data generation that complies with Feldman's long tail theory (2020). We demonstrate that a linear classifier cannot decrease the generalization error below a certain level in the proposed…

Machine Learning · Computer Science 2023-07-26 Arman Bolatov , Maxat Tezekbayev , Igor Melnykov , Artur Pak , Vassilina Nikoulina , Zhenisbek Assylbekov

The long-tail distribution, where a few head labels dominate while rare tail labels abound, poses a persistent challenge for large-scale Multi-Label Classification (MLC) in real-world data mining applications. Existing resampling and…

Machine Learning · Computer Science 2026-02-18 Jing Yang , Keze Wang

Diffusion-based models have shown the merits of generating high-quality visual data while preserving better diversity in recent studies. However, such observation is only justified with curated data distribution, where the data samples are…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Yiming Qin , Huangjie Zheng , Jiangchao Yao , Mingyuan Zhou , Ya Zhang

Anomaly detection (AD) aims to identify defective images and localize their defects (if any). Ideally, AD models should be able to detect defects over many image classes; without relying on hard-coded class names that can be uninformative…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Chih-Hui Ho , Kuan-Chuan Peng , Nuno Vasconcelos

Deep neural networks have achieved state-of-the-art performance in a wide range of recognition/classification tasks. However, when applying deep learning to real-world applications, there are still multiple challenges. A typical challenge…

Machine Learning · Computer Science 2021-02-10 Xin Sun , Zhenning Yang , Chi Zhang , Guohao Peng , Keck-Voon Ling

Continual learning from a sequential stream of data is a crucial challenge for machine learning research. Most studies have been conducted on this topic under the single-label classification setting along with an assumption of balanced…

Machine Learning · Computer Science 2020-09-09 Chris Dongjoo Kim , Jinseo Jeong , Gunhee Kim

Deep classifiers have achieved great success in visual recognition. However, real-world data is long-tailed by nature, leading to the mismatch between training and testing distributions. In this paper, we show that the Softmax function,…

Machine Learning · Computer Science 2020-11-24 Jiawei Ren , Cunjun Yu , Shunan Sheng , Xiao Ma , Haiyu Zhao , Shuai Yi , Hongsheng Li

Current out-of-distribution (OOD) detection methods typically assume balanced in-distribution (ID) data, while most real-world data follow a long-tailed distribution. Previous approaches to long-tailed OOD detection often involve balancing…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Yina He , Lei Peng , Yongcun Zhang , Juanjuan Weng , Zhiming Luo , Shaozi Li

Generalized Category Discovery (GCD) seeks to identify novel categories from unlabeled data while retaining the classification ability of seen categories. Prior GCD methods commonly leverage transferable representations from pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Bo Ye , Kai Gan , Tong Wei , Min-Ling Zhang

Novel Class Discovery (NCD) is the problem of trying to discover novel classes in an unlabeled set, given a labeled set of different but related classes. The majority of NCD methods proposed so far only deal with image data, despite tabular…

One potential solution to combat the scarcity of tail observations in extreme value analysis is to integrate information from multiple datasets sharing similar tail properties, for instance, a common extreme value index. In other words, for…

Methodology · Statistics 2025-06-25 Liujun Chen , Marco Oesting , Chen Zhou

Noisy labels, which are common in real-world datasets, can significantly impair the training of deep learning models. However, recent adversarial noise-combating methods overlook the long-tailed distribution of real data, which can…

Machine Learning · Computer Science 2024-08-09 Mengting Li , Chuang Zhu

Machine learning typically relies on the assumption that training and testing distributions are identical and that data is centrally stored for training and testing. However, in real-world scenarios, distributions may differ significantly…

Machine Learning · Computer Science 2025-08-22 Ying Li , Xingwei Wang , Rongfei Zeng , Praveen Kumar Donta , Ilir Murturi , Min Huang , Schahram Dustdar