English
Related papers

Related papers: SMCL: Saliency Masked Contrastive Learning for Lon…

200 papers

Many data distributions in the real world are hardly uniform. Instead, skewed and long-tailed distributions of various kinds are commonly observed. This poses an interesting problem for machine learning, where most algorithms assume or work…

Machine Learning · Computer Science 2024-04-25 Charika de Alvis , Suranga Seneviratne

Long-tailed data is prevalent in real-world classification tasks and heavily relies on supervised information, which makes the annotation process exceptionally labor-intensive and time-consuming. Unfortunately, despite being a common…

Machine Learning · Computer Science 2024-12-04 Meng Wei , Zhongnian Li , Yong Zhou , Xinzheng Xu

In the real world, the frequency of occurrence of objects is naturally skewed forming long-tail class distributions, which results in poor performance on the statistically rare classes. A promising solution is to mine tail-class examples to…

Computer Vision and Pattern Recognition · Computer Science 2021-12-16 Gursimran Singh , Lingyang Chu , Lanjun Wang , Jian Pei , Qi Tian , Yong Zhang

Long-tailed instance segmentation is a challenging task due to the extreme imbalance of training samples among classes. It causes severe biases of the head classes (with majority samples) against the tailed ones. This renders "how to…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Yin-Yin He , Peizhen Zhang , Xiu-Shen Wei , Xiangyu Zhang , Jian Sun

Long-tailed recognition has benefited from foundation models and fine-tuning paradigms, yet existing studies and benchmarks are mainly confined to natural image domains, where pre-training and fine-tuning data share similar distributions.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Jiahao Chen , Bing Su

A significant challenge in achieving ubiquitous Artificial Intelligence is the limited ability of models to rapidly learn new information in real-world scenarios where data follows long-tailed distributions, all while avoiding forgetting…

Machine Learning · Computer Science 2024-04-09 Siddeshwar Raghavan , Jiangpeng He , Fengqing Zhu

Balancing performance trade-off on long-tail (LT) data distributions remains a long-standing challenge. In this paper, we posit that this dilemma stems from a phenomenon called "tail performance degradation" (the model tends to severely…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Shenghan Chen , Yiming Liu , Yanzhen Wang , Yujia Wang , Xiankai Lu

Detecting lane markings in road scenes poses a challenge due to their intricate nature, which is susceptible to unfavorable conditions. While lane markings have strong shape priors, their visibility is easily compromised by lighting…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Ali Zoljodi , Sadegh Abadijou , Mina Alibeigi , Masoud Daneshtalab

In this paper, we propose the Generalized Parametric Contrastive Learning (GPaCo/PaCo) which works well on both imbalanced and balanced data. Based on theoretical analysis, we observe that supervised contrastive loss tends to bias…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Jiequan Cui , Zhisheng Zhong , Zhuotao Tian , Shu Liu , Bei Yu , Jiaya Jia

Real-world data often follows a long-tailed distribution, where a few head classes occupy most of the data and a large number of tail classes only contain very limited samples. In practice, deep models often show poor generalization…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Haolin Pan , Yong Guo , Mianjie Yu , Jian Chen

Deep neural networks perform poorly on heavily class-imbalanced datasets. Given the promising performance of contrastive learning, we propose Rebalanced Siamese Contrastive Mining (ResCom) to tackle imbalanced recognition. Based on the…

Computer Vision and Pattern Recognition · Computer Science 2022-06-27 Zhisheng Zhong , Jiequan Cui , Zeming Li , Eric Lo , Jian Sun , Jiaya Jia

Class imbalance is a common problem in the case of real-world object detection and classification tasks. Data of some classes is abundant making them an over-represented majority, and data of other classes is scarce, making them an…

Computer Vision and Pattern Recognition · Computer Science 2017-03-24 Salman H. Khan , Munawar Hayat , Mohammed Bennamoun , Ferdous Sohel , Roberto Togneri

Long-tailed classification poses a challenge due to its heavy imbalance in class probabilities and tail-sensitivity risks with asymmetric misprediction costs. Recent attempts have used re-balancing loss and ensemble methods, but they are…

Machine Learning · Computer Science 2023-03-22 Bolian Li , Ruqi Zhang

In this work, we introduce a novel strategy for long-tail recognition that addresses the tail classes' few-shot problem via training-free knowledge transfer. Our objective is to transfer knowledge acquired from information-rich common…

Computer Vision and Pattern Recognition · Computer Science 2022-04-13 Sarah Parisot , Pedro M. Esperanca , Steven McDonagh , Tamas J. Madarasz , Yongxin Yang , Zhenguo Li

Long-term forecasting presents unique challenges due to the time and memory complexity of handling long sequences. Existing methods, which rely on sliding windows to process long sequences, struggle to effectively capture long-term…

Machine Learning · Computer Science 2024-03-26 Junwoo Park , Daehoon Gwak , Jaegul Choo , Edward Choi

Despite the recent success of deep neural networks, it remains challenging to effectively model the long-tail class distribution in visual recognition tasks. To address this problem, we first investigate the performance bottleneck of the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Songyang Zhang , Zeming Li , Shipeng Yan , Xuming He , Jian Sun

Class-wise characteristics of training examples affect the performance of deep classifiers. A well-studied example is when the number of training examples of classes follows a long-tailed distribution, a situation that is likely to yield…

Machine Learning · Computer Science 2025-05-02 Z. S. Baltaci , K. Oksuz , S. Kuzucu , K. Tezoren , B. K. Konar , A. Ozkan , E. Akbas , S. Kalkan

Object detection is an important task in remote sensing image analysis. To reduce the computational complexity of redundant information and improve the efficiency of image processing, visual saliency models have been widely applied in this…

Computer Vision and Pattern Recognition · Computer Science 2021-04-21 Zhou Huang , Huai-Xin Chen , Tao Zhou , Yun-Zhi Yang , Chang-Yin Wang , Bi-Yuan Liu

Self-supervised learning (SSL) as an effective paradigm of representation learning has achieved tremendous success on various curated datasets in diverse scenarios. Nevertheless, when facing the long-tailed distribution in real-world…

Machine Learning · Computer Science 2023-10-27 Zhihan Zhou , Jiangchao Yao , Feng Hong , Ya Zhang , Bo Han , Yanfeng Wang

Mixup is a popular data augmentation method, with many variants subsequently proposed. These methods mainly create new examples via convex combination of random data pairs and their corresponding one-hot labels. However, most of them adhere…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Shaoyu Zhang , Chen Chen , Xiujuan Zhang , Silong Peng