English
Related papers

Related papers: Enhanced Long-Tailed Recognition with Contrastive …

200 papers

Balancing training on long-tail data distributions remains a long-standing challenge in deep learning. While methods such as re-weighting and re-sampling help alleviate the imbalance issue, limited sample diversity continues to hinder…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Shizhen Zhao , Xin Wen , Jiahui Liu , Chuofan Ma , Chunfeng Yuan , Xiaojuan Qi

There is an inescapable long-tailed class-imbalance issue in many real-world classification problems. Current methods for addressing this problem only consider scenarios where all examples come from the same distribution. However, in many…

Machine Learning · Computer Science 2023-10-09 Xinyu Yang , Huaxiu Yao , Allan Zhou , Chelsea Finn

Classification on long-tailed distributed data is a challenging problem, which suffers from serious class-imbalance and hence poor performance on tail classes with only a few samples. Owing to this paucity of samples, learning on the tail…

Computation and Language · Computer Science 2022-07-25 Taha ValizadehAslani , Yiwen Shi , Jing Wang , Ping Ren , Yi Zhang , Meng Hu , Liang Zhao , Hualou Liang

Deep neural networks may perform poorly when training datasets are heavily class-imbalanced. Recently, two-stage methods decouple representation learning and classifier learning to improve performance. But there is still the vital issue of…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Zhisheng Zhong , Jiequan Cui , Shu Liu , Jiaya Jia

Recent works have proposed incorporating heavy-tailed (HT) noise into diffusion- and flow-based generative models, with the goals of better recovering the tails of target distributions and improving generative diversity. This motivation is…

Machine Learning · Computer Science 2026-05-14 Hamza Cherkaoui , Hélène Halconruy , Antonio Ocello

One of the challenges in contrastive learning is the selection of appropriate \textit{hard negative} examples, in the absence of label information. Random sampling or importance sampling methods based on feature similarity often lead to…

Machine Learning · Computer Science 2022-06-03 Afrina Tabassum , Muntasir Wahed , Hoda Eldardiry , Ismini Lourentzou

Ensuring the realism of computer-generated synthetic images is crucial to deep neural network (DNN) training. Due to different semantic distributions between synthetic and real-world captured datasets, there exists semantic mismatch between…

Computer Vision and Pattern Recognition · Computer Science 2023-04-27 Ganning Zhao , Tingwei Shen , Suya You , C. -C. Jay Kuo

Dataset distillation aims to synthesize a small, information-rich dataset from a large one for efficient model training. However, existing dataset distillation methods struggle with long-tailed datasets, which are prevalent in real-world…

Machine Learning · Computer Science 2025-03-20 Zhenghao Zhao , Haoxuan Wang , Yuzhang Shang , Kai Wang , Yan Yan

For long-tailed classification, most works often pretrain a big model on a large-scale dataset, and then fine-tune the whole model for adapting to long-tailed data. Though promising, fine-tuning the whole pretrained model tends to suffer…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Bowen Dong , Pan Zhou , Shuicheng Yan , Wangmeng Zuo

The imbalance (or long-tail) is the nature of many real-world data distributions, which often induces the undesirable bias of deep classification models toward frequent classes, resulting in poor performance for tail classes. In this paper,…

Machine Learning · Computer Science 2025-10-13 Fudong Lin , Xu Yuan

Imbalanced distributions are ubiquitous in real-world data. They create constraints on Deep Neural Networks to represent the minority labels and avoid bias towards majority labels. The extensive body of imbalanced approaches address…

Machine Learning · Computer Science 2024-03-15 Mahsa Keramati , Lili Meng , R. David Evans

Commit Classification (CC) is an important task in software maintenance, which helps software developers classify code changes into different types according to their nature and purpose. It allows developers to understand better how their…

Software Engineering · Computer Science 2023-08-17 Jiajun Tong , Zhixiao Wang , Xiaobin Rui

Long-tailed object detection faces great challenges because of its extremely imbalanced class distribution. Recent methods mainly focus on the classification bias and its loss function design, while ignoring the subtle influence of the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Ke Zhu , Minghao Fu , Jie Shao , Tianyu Liu , Jianxin Wu

Rare diseases dominate the diagnostic challenge in medical imaging yet are severely underrepresented in clinical datasets, causing classifiers to fail on exactly the conditions where reliable detection matters most. Generative augmentation…

Image and Video Processing · Electrical Eng. & Systems 2026-05-19 Felix Nützel , Mischa Dombrowski , Bernhard Kainz

Long-tailed object detection (LTOD) aims to handle the extreme data imbalance in real-world datasets, where many tail classes have scarce instances. One popular strategy is to explore extra data with image-level labels, yet it produces…

Computer Vision and Pattern Recognition · Computer Science 2023-10-19 Lingchen Meng , Xiyang Dai , Jianwei Yang , Dongdong Chen , Yinpeng Chen , Mengchen Liu , Yi-Ling Chen , Zuxuan Wu , Lu Yuan , Yu-Gang Jiang

Long-tail distribution is widely spread in real-world applications. Due to the extremely small ratio of instances, tail categories often show inferior accuracy. In this paper, we find such performance bottleneck is mainly caused by the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Jingru Tan , Bo Li , Xin Lu , Yongqiang Yao , Fengwei Yu , Tong He , Wanli Ouyang

Effectively handling the co-occurrence of non-IID data and long-tailed distributions remains a critical challenge in federated learning. While fine-tuning vision-language models (VLMs) like CLIP has shown to be promising in addressing…

Machine Learning · Computer Science 2025-03-11 Shihao Hou , Xinyi Shang , Shreyank N Gowda , Yang Lu , Chao Wu , Yan Yan , Hanzi Wang

In the context of Extreme Multi-label Text Classification (XMTC), where labels are assigned to text instances from a large label space, the long-tail distribution of labels presents a significant challenge. Labels can be broadly categorized…

Information Retrieval · Computer Science 2025-07-08 Celso França , Gestefane Rabbi , Thiago Salles , Washington Cunha , Leonardo Rocha , Marcos André Gonçalves

We propose GradTail, an algorithm that uses gradients to improve model performance on the fly in the face of long-tailed training data distributions. Unlike conventional long-tail classifiers which operate on converged - and possibly…

Machine Learning · Computer Science 2022-01-20 Zhao Chen , Vincent Casser , Henrik Kretzschmar , Dragomir Anguelov

We introduce Retrieval Augmented Classification (RAC), a generic approach to augmenting standard image classification pipelines with an explicit retrieval module. RAC consists of a standard base image encoder fused with a parallel retrieval…

Computer Vision and Pattern Recognition · Computer Science 2022-02-24 Alexander Long , Wei Yin , Thalaiyasingam Ajanthan , Vu Nguyen , Pulak Purkait , Ravi Garg , Alan Blair , Chunhua Shen , Anton van den Hengel