English
Related papers

Related papers: Balancing Logit Variation for Long-tailed Semantic…

200 papers

Deep neural networks may perform poorly when training datasets are heavily class-imbalanced. Recently, two-stage methods decouple representation learning and classifier learning to improve performance. But there is still the vital issue of…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Zhisheng Zhong , Jiequan Cui , Shu Liu , Jiaya Jia

Data in the real-world classification problems are always imbalanced or long-tailed, wherein the majority classes have the most of the samples that dominate the model training. In such setting, the naive model tends to have poor performance…

Machine Learning · Computer Science 2023-08-30 Hong Zhu , Runpeng Yu , Xing Tang , Yifei Wang , Yuan Fang , Yisen Wang

This paper studies the long-tailed semi-supervised learning (LTSSL) with distribution mismatch, where the class distribution of the labeled training data follows a long-tailed distribution and mismatches with that of the unlabeled training…

Machine Learning · Computer Science 2025-08-12 Yaxin Hou , Yuheng Jia

Integrating supervised contrastive loss to cross entropy-based communication has recently been proposed as a solution to address the long-tail learning problem. However, when the class imbalance ratio is high, it requires adjusting the…

Machine Learning · Computer Science 2024-07-10 Charika De Alvis , Dishanika Denipitiyage , Suranga Seneviratne

Learning discriminative image representations plays a vital role in long-tailed image classification because it can ease the classifier learning in imbalanced cases. Given the promising performance contrastive learning has shown recently in…

Computer Vision and Pattern Recognition · Computer Science 2021-03-29 Peng Wang , Kai Han , Xiu-Shen Wei , Lei Zhang , Lei Wang

Long-tailed class distributions are prevalent among the practical applications of object detection and instance segmentation. Prior work in long-tail instance segmentation addresses the imbalance of losses between rare and frequent…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Ting-I Hsieh , Esther Robb , Hwann-Tzong Chen , Jia-Bin Huang

This paper studies the distributed optimization problem under the influence of heavy-tailed gradient noises. Here, a heavy-tailed noise means that the noise does not necessarily satisfy the bounded variance assumption. Instead, it satisfies…

Optimization and Control · Mathematics 2025-05-12 Chao Sun , Huiming Zhang , Bo Chen , Li Yu

Learning-based techniques, especially advanced Large Language Models (LLMs) for code, have gained considerable popularity in various software engineering (SE) tasks. However, most existing works focus on designing better learning-based…

Software Engineering · Computer Science 2023-09-08 Xin Zhou , Kisub Kim , Bowen Xu , Jiakun Liu , DongGyun Han , David Lo

Deep learning algorithms face great challenges with long-tailed data distribution which, however, is quite a common case in real-world scenarios. Previous methods tackle the problem from either the aspect of input space (re-sampling classes…

Computer Vision and Pattern Recognition · Computer Science 2022-05-13 Jiequan Cui , Shu Liu , Zhuotao Tian , Zhisheng Zhong , Jiaya Jia

Semantic segmentation, vital for applications ranging from autonomous driving to robotics, faces significant challenges in domains where collecting large annotated datasets is difficult or prohibitively expensive. In such contexts, such as…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Nico Catalano , Matteo Matteucci

We investigate the application of the Adaptive Multilevel Splitting algorithm for the estimation of tail probabilities of solutions of Stochastic Differential Equations evaluated at a given time, and of associated temporal averages. We…

Probability · Mathematics 2019-03-27 Charles-Edouard Bréhier , Tony Lelièvre

In the real open world, data tends to follow long-tailed class distributions, motivating the well-studied long-tailed recognition (LTR) problem. Naive training produces models that are biased toward common classes in terms of higher…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Shaden Alshammari , Yu-Xiong Wang , Deva Ramanan , Shu Kong

The visual world naturally exhibits a long-tailed distribution of open classes, which poses great challenges to modern visual systems. Existing approaches either perform class re-balancing strategies or directly improve network modules to…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Teli Ma , Shijie Geng , Mengmeng Wang , Jing Shao , Jiasen Lu , Hongsheng Li , Peng Gao , Yu Qiao

Existing long-tailed recognition methods, aiming to train class-balanced models from long-tailed data, generally assume the models would be evaluated on the uniform test class distribution. However, practical test class distributions often…

Computer Vision and Pattern Recognition · Computer Science 2022-10-28 Yifan Zhang , Bryan Hooi , Lanqing Hong , Jiashi Feng

Neural networks trained on real-world datasets with long-tailed label distributions are biased towards frequent classes and perform poorly on infrequent classes. The imbalance in the ratio of positive and negative samples for each class…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Kevin Duarte , Yogesh S. Rawat , Mubarak Shah

For long-tailed classification, most works often pretrain a big model on a large-scale dataset, and then fine-tune the whole model for adapting to long-tailed data. Though promising, fine-tuning the whole pretrained model tends to suffer…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Bowen Dong , Pan Zhou , Shuicheng Yan , Wangmeng Zuo

Dynamic link prediction is an important problem considered in many recent works that propose approaches for learning temporal edge patterns. To assess their efficacy, models are evaluated on continuous-time and discrete-time temporal graph…

Machine Learning · Computer Science 2026-02-06 Moritz Lampert , Christopher Blöcker , Ingo Scholtes

Beyond class frequency, we recognize the impact of class-wise relationships among various class-specific predictions and the imbalance in label masks on long-tailed segmentation learning. To address these challenges, we propose an…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Khoi Do , Duong Nguyen , Nguyen H. Tran , Viet Dung Nguyen

Deep models trained on long-tailed datasets exhibit unsatisfactory performance on tail classes. Existing methods usually modify the classification loss to increase the learning focus on tail classes, which unexpectedly sacrifice the…

Computer Vision and Pattern Recognition · Computer Science 2021-04-22 Shaoyu Zhang , Chen Chen , Xiyuan Hu , Silong Peng

The datasets used for Deep Neural Network training (e.g., ImageNet, MSCOCO, etc.) are often manually balanced across categories (classes) to facilitate learning of all the categories. This curation process is often expensive and requires…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Harsh Rangwani