English
Related papers

Related papers: Invariant Feature Learning for Generalized Long-Ta…

200 papers

Conventional detectors suffer from performance degradation when dealing with long-tailed data due to a classification bias towards the majority head categories. In this paper, we contend that the learning bias originates from two factors:…

Computer Vision and Pattern Recognition · Computer Science 2023-08-07 Tianhao Qi , Hongtao Xie , Pandeng Li , Jiannan Ge , Yongdong Zhang

Long-tailed multi-label visual recognition (LTML) task is a highly challenging task due to the label co-occurrence and imbalanced data distribution. In this work, we propose a unified framework for LTML, namely prompt tuning with…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Peng Xia , Di Xu , Ming Hu , Lie Ju , Zongyuan Ge

Many data distributions in the real world are hardly uniform. Instead, skewed and long-tailed distributions of various kinds are commonly observed. This poses an interesting problem for machine learning, where most algorithms assume or work…

Machine Learning · Computer Science 2024-04-25 Charika de Alvis , Suranga Seneviratne

The fine-tuning paradigm in addressing long-tail learning tasks has sparked significant interest since the emergence of foundation models. Nonetheless, how fine-tuning impacts performance in long-tail learning was not explicitly quantified.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Jiang-Xin Shi , Tong Wei , Zhi Zhou , Jie-Jing Shao , Xin-Yan Han , Yu-Feng Li

The imbalanced distribution of long-tailed data presents a considerable challenge for deep learning models, as it causes them to prioritize the accurate classification of head classes but largely disregard tail classes. The biased decision…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Mengke Li , Zhikai Hu , Yang Lu , Weichao Lan , Yiu-ming Cheung , Hui Huang

Real-world data often follow a long-tailed distribution with a high imbalance in the number of samples between classes. The problem with training from imbalanced data is that some background features, common to all classes, can be…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Sanglee Park , Seung-won Hwang , Jungmin So

Few-shot learning (FSL), purposing to resolve the problem of data-scarce, has attracted considerable attention in recent years. A popular FSL framework contains two phases: (i) the pre-train phase employs the base data to train a CNN-based…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Rui Xu , Lei Xing , Shuai Shao , Lifei Zhao , Baodi Liu , Weifeng Liu , Yicong Zhou

In vision domain, large-scale natural datasets typically exhibit long-tailed distribution which has large class imbalance between head and tail classes. This distribution poses difficulty in learning good representations for tail classes.…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Anthony Meng Huat Tiong , Junnan Li , Guosheng Lin , Boyang Li , Caiming Xiong , Steven C. H. Hoi

The long-tailed recognition (LTR) is the task of learning high-performance classifiers given extremely imbalanced training samples between categories. Most of the existing works address the problem by either enhancing the features of tail…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 Haixu Long , Xiaolin Zhang , Yanbin Liu , Zongtai Luo , Jianbo Liu

Anomaly detection is crucial in industrial applications for identifying rare and unseen patterns to ensure system reliability. Traditional models, trained on a single class of normal data, struggle with real-world distributions where normal…

Machine Learning · Statistics 2026-01-07 Jungi Lee , Jungkwon Kim , Chi Zhang , Sangmin Kim , Kwangsun Yoo , Seok-Joo Byun

Recently computer-aided diagnosis has demonstrated promising performance, effectively alleviating the workload of clinicians. However, the inherent sample imbalance among different diseases leads algorithms biased to the majority…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Li Pan , Yupei Zhang , Qiushi Yang , Tan Li , Zhen Chen

In the real world, long-tailed data distributions are prevalent, making it challenging for models to effectively learn and classify tail classes. However, we discover that in the field of drug chemistry, certain tail classes exhibit higher…

Machine Learning · Computer Science 2025-04-08 Yujia Su , Xinjie Li , Lionel Z. Wang

Generalized Class Discovery (GCD) plays a pivotal role in discerning both known and unknown categories from unlabeled datasets by harnessing the insights derived from a labeled set comprising recognized classes. A significant limitation in…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Ziyun Li , Christoph Meinel , Haojin Yang

As the data scale grows, deep recognition models often suffer from long-tailed data distributions due to the heavy imbalanced sample number across categories. Indeed, real-world data usually exhibit some similarity relation among different…

Computer Vision and Pattern Recognition · Computer Science 2022-08-18 Lei Liu , Li Liu

Long-tailed recognition with imbalanced class distribution naturally emerges in practical machine learning applications. Existing methods such as data reweighing, resampling, and supervised contrastive learning enforce the class balance…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Chengkai Hou , Jieyu Zhang , Haonan Wang , Tianyi Zhou

Multimodal large language models (MLLMs) struggle with numerical regression under long-tailed target distributions. Token-level supervised fine-tuning (SFT) and point-wise regression rewards bias learning toward high-density regions,…

Computation and Language · Computer Science 2026-05-12 Yao Du , Shanshan Song , Xiaomeng Li

Conventional de-noising methods rely on the assumption that all samples are independent and identically distributed, so the resultant classifier, though disturbed by noise, can still easily identify the noises as the outliers of training…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Xuanyu Yi , Kaihua Tang , Xian-Sheng Hua , Joo-Hwee Lim , Hanwang Zhang

Deep neural networks may perform poorly when training datasets are heavily class-imbalanced. Recently, two-stage methods decouple representation learning and classifier learning to improve performance. But there is still the vital issue of…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Zhisheng Zhong , Jiequan Cui , Shu Liu , Jiaya Jia

In this paper, we propose an Aligned Contrastive Learning (ACL) algorithm to address the long-tailed recognition problem. Our findings indicate that while multi-view training boosts the performance, contrastive learning does not…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Jiali Ma , Jiequan Cui , Maeno Kazuki , Lakshmi Subramanian , Karlekar Jayashree , Sugiri Pranata , Hanwang Zhang

Deep neural networks often degrade significantly when training data suffer from class imbalance problems. Existing approaches, e.g., re-sampling and re-weighting, commonly address this issue by rearranging the label distribution of training…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Renzhen Wang , Kaiqin Hu , Yanwen Zhu , Jun Shu , Qian Zhao , Deyu Meng