English
Related papers

Related papers: Reviving Undersampling for Long-Tailed Learning

200 papers

The long-tail distribution of the visual world poses great challenges for deep learning based classification models on how to handle the class imbalance problem. Existing solutions usually involve class-balancing strategies, e.g., by loss…

Computer Vision and Pattern Recognition · Computer Science 2020-02-20 Bingyi Kang , Saining Xie , Marcus Rohrbach , Zhicheng Yan , Albert Gordo , Jiashi Feng , Yannis Kalantidis

Real-world data tends to follow a long-tailed distribution, where the class imbalance results in dominance of the head classes during training. In this paper, we propose a frustratingly simple but effective step-wise learning framework to…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Na Dong , Yongqiang Zhang , Mingli Ding , Gim Hee Lee

Deep classifiers have achieved great success in visual recognition. However, real-world data is long-tailed by nature, leading to the mismatch between training and testing distributions. In this paper, we show that the Softmax function,…

Machine Learning · Computer Science 2020-11-24 Jiawei Ren , Cunjun Yu , Shunan Sheng , Xiao Ma , Haiyu Zhao , Shuai Yi , Hongsheng Li

Real-world data is extremely imbalanced and presents a long-tailed distribution, resulting in models that are biased towards classes with sufficient samples and perform poorly on rare classes. Recent methods propose to rebalance classes but…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Weiqi Li , Fan Lyu , Fanhua Shang , Liang Wan , Wei Feng

In this work, we address the challenging task of long-tailed image recognition. Previous long-tailed recognition methods commonly focus on the data augmentation or re-balancing strategy of the tail classes to give more attention to tail…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Weide Liu , Zhonghua Wu , Yiming Wang , Henghui Ding , Fayao Liu , Jie Lin , Guosheng Lin

Dataset distillation creates a small distilled set that enables efficient training by capturing key information from the full dataset. While existing dataset distillation methods perform well on balanced datasets, they struggle under…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Xiao Cui , Yulei Qin , Xinyue Li , Wengang Zhou , Hongsheng Li , Houqiang Li

Many data distributions in the real world are hardly uniform. Instead, skewed and long-tailed distributions of various kinds are commonly observed. This poses an interesting problem for machine learning, where most algorithms assume or work…

Machine Learning · Computer Science 2024-04-25 Charika de Alvis , Suranga Seneviratne

The success of deep learning depends on large-scale and well-curated training data, while data in real-world applications are commonly long-tailed and noisy. Many methods have been proposed to deal with long-tailed data or noisy data, while…

Machine Learning · Computer Science 2023-05-30 Lefan Zhang , Zhang-Hao Tian , Wujun Zhou , Wei Wang

Many practical medical imaging scenarios include categories that are under-represented but still crucial. The relevance of image recognition models to real-world applications lies in their ability to generalize to these rare classes as well…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Daniya Najiha A. Kareem , Jean Lahoud , Mustansar Fiaz , Amandeep Kumar , Hisham Cholakkal

Recognition problems in long-tailed data, in which the sample size per class is heavily skewed, have gained importance because the distribution of the sample size per class in a dataset is generally exponential unless the sample size is…

Machine Learning · Computer Science 2024-04-30 Naoya Hasegawa , Issei Sato

Long-tailed classification poses a challenge due to its heavy imbalance in class probabilities and tail-sensitivity risks with asymmetric misprediction costs. Recent attempts have used re-balancing loss and ensemble methods, but they are…

Machine Learning · Computer Science 2023-03-22 Bolian Li , Ruqi Zhang

Label distributions in camera-trap images are highly imbalanced and long-tailed, resulting in neural networks tending to be biased towards head-classes that appear frequently. Although long-tail learning has been extremely explored to…

Computer Vision and Pattern Recognition · Computer Science 2022-02-17 Byeongjun Park , Jeongsoo Kim , Seungju Cho , Heeseon Kim , Changick Kim

Classification on long-tailed distributed data is a challenging problem, which suffers from serious class-imbalance and hence poor performance on tail classes with only a few samples. Owing to this paucity of samples, learning on the tail…

Computation and Language · Computer Science 2022-07-25 Taha ValizadehAslani , Yiwen Shi , Jing Wang , Ping Ren , Yi Zhang , Meng Hu , Liang Zhao , Hualou Liang

Real-world data are long-tailed, the lack of tail samples leads to a significant limitation in the generalization ability of the model. Although numerous approaches of class re-balancing perform well for moderate class imbalance problems,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Yanbiao Ma , Licheng Jiao , Fang Liu , Shuyuan Yang , Xu Liu , Puhua Chen

Methods in long-tail learning focus on improving performance for data-poor (rare) classes; however, performance for such classes remains much lower than performance for more data-rich (frequent) classes. Analyzing the predictions of…

Computer Vision and Pattern Recognition · Computer Science 2023-07-27 Nadine Chang , Jayanth Koushik , Aarti Singh , Martial Hebert , Yu-Xiong Wang , Michael J. Tarr

Deep learning algorithms face great challenges with long-tailed data distribution which, however, is quite a common case in real-world scenarios. Previous methods tackle the problem from either the aspect of input space (re-sampling classes…

Computer Vision and Pattern Recognition · Computer Science 2022-05-13 Jiequan Cui , Shu Liu , Zhuotao Tian , Zhisheng Zhong , Jiaya Jia

Balancing performance trade-off on long-tail (LT) data distributions remains a long-standing challenge. In this paper, we posit that this dilemma stems from a phenomenon called "tail performance degradation" (the model tends to severely…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Shenghan Chen , Yiming Liu , Yanzhen Wang , Yujia Wang , Xiankai Lu

Long-tailed learning has garnered increasing attention due to its practical significance. Among the various approaches, the fine-tuning paradigm has gained considerable interest with the advent of foundation models. However, most existing…

Machine Learning · Computer Science 2025-08-11 Jiahao Chen , Bin Qin , Jiangmeng Li , Hao Chen , Bing Su

Real-world visual data often exhibits a long-tailed distribution, where some ''head'' classes have a large number of samples, yet only a few samples are available for ''tail'' classes. Such imbalanced distribution causes a great challenge…

Computer Vision and Pattern Recognition · Computer Science 2020-03-11 Junjie Zhang , Lingqiao Liu , Peng Wang , Chunhua Shen

Class imbalance is a common challenge in real-world recognition tasks, where the majority of classes have few samples, also known as tail classes. We address this challenge with the perspective of generalization and empirically find that…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Yixuan Zhou , Yi Qu , Xing Xu , Hengtao Shen