English
Related papers

Related papers: Long-Tail Learning with Rebalanced Contrastive Los…

200 papers

Image classification datasets exhibit a non-negligible fraction of mislabeled examples, often due to human error when one class superficially resembles another. This issue poses challenges in supervised contrastive learning (SCL), where the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Zijun Long , George Killick , Lipeng Zhuang , Richard McCreadie , Gerardo Aragon Camarasa , Paul Henderson

Complementary-label learning (CLL) is widely used in weakly supervised classification, but it faces a significant challenge in real-world datasets when confronted with class-imbalanced training samples. In such scenarios, the number of…

Machine Learning · Computer Science 2024-03-21 Meng Wei , Yong Zhou , Zhongnian Li , Xinzheng Xu

Contrastive Learning first extracts features from unlabeled data, followed by linear probing with labeled data. Adversarial Contrastive Learning (ACL) integrates Adversarial Training into the first phase to enhance feature robustness…

Machine Learning · Computer Science 2025-10-28 Ngoc N. Tran , Lam Tran , Hoang Phan , Anh Bui , Tung Pham , Toan Tran , Dinh Phung , Trung Le

The task of Long-tailed Class Incremental Learning (LT-CIL) addresses the sequential learning of new classes from datasets with imbalanced class distributions. This scenario intensifies the fundamental problem of catastrophic forgetting,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Taigo Sakai , Kazuhiro Hotta

Detecting lane markings in road scenes poses a challenge due to their intricate nature, which is susceptible to unfavorable conditions. While lane markings have strong shape priors, their visibility is easily compromised by lighting…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Ali Zoljodi , Sadegh Abadijou , Mina Alibeigi , Masoud Daneshtalab

Balancing training on long-tail data distributions remains a long-standing challenge in deep learning. While methods such as re-weighting and re-sampling help alleviate the imbalance issue, limited sample diversity continues to hinder…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Shizhen Zhao , Xin Wen , Jiahui Liu , Chuofan Ma , Chunfeng Yuan , Xiaojuan Qi

State-of-the-art pre-trained image models predominantly adopt a two-stage approach: initial unsupervised pre-training on large-scale datasets followed by task-specific fine-tuning using Cross-Entropy loss~(CE). However, it has been…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Zijun Long , George Killick , Lipeng Zhuang , Gerardo Aragon-Camarasa , Zaiqiao Meng , Richard Mccreadie

Although deep learning-based segmentation models have achieved impressive performance on public benchmarks, generalizing well to unseen environments remains a major challenge. To improve the model's generalization ability to the new domain…

Computer Vision and Pattern Recognition · Computer Science 2023-11-15 Yunlong Zhang , Yuxuan Sun , Sunyi Zheng , Zhongyi Shui , Chenglu Zhu , Lin Yang

Contrastive learning (CL) can learn generalizable feature representations and achieve the state-of-the-art performance of downstream tasks by finetuning a linear classifier on top of it. However, as adversarial robustness becomes vital in…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Lijie Fan , Sijia Liu , Pin-Yu Chen , Gaoyuan Zhang , Chuang Gan

Diffusion models have made significant advances recently in high-quality image synthesis and related tasks. However, diffusion models trained on real-world datasets, which often follow long-tailed distributions, yield inferior fidelity for…

Computer Vision and Pattern Recognition · Computer Science 2024-02-19 Divin Yan , Lu Qi , Vincent Tao Hu , Ming-Hsuan Yang , Meng Tang

Benchmark datasets for visual recognition assume that data is uniformly distributed, while real-world datasets obey long-tailed distribution. Current approaches handle the long-tailed problem to transform the long-tailed dataset to uniform…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Renhui Zhang , Tiancheng Lin , Rui Zhang , Yi Xu

Learning self-supervised representations using reconstruction or contrastive losses improves performance and sample complexity of image-based and multimodal reinforcement learning (RL). Here, different self-supervised loss functions have…

Machine Learning · Computer Science 2024-06-27 Philipp Becker , Sebastian Mossburger , Fabian Otto , Gerhard Neumann

The visual world naturally exhibits a long-tailed distribution of open classes, which poses great challenges to modern visual systems. Existing approaches either perform class re-balancing strategies or directly improve network modules to…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Teli Ma , Shijie Geng , Mengmeng Wang , Jing Shao , Jiasen Lu , Hongsheng Li , Peng Gao , Yu Qiao

Large language models (LLMs) can learn vast amounts of knowledge from diverse domains during pre-training. However, long-tail knowledge from specialized domains is often scarce and underrepresented, rarely appearing in the models'…

Computation and Language · Computer Science 2025-02-11 Shuyang Yu , Runxue Bao , Parminder Bhatia , Taha Kass-Hout , Jiayu Zhou , Cao Xiao

Conventional multi-label classification (MLC) methods assume that all samples are fully labeled and identically distributed. Unfortunately, this assumption is unrealistic in large-scale MLC data that has long-tailed (LT) distribution and…

Machine Learning · Computer Science 2023-04-24 Wenqiao Zhang , Changshuo Liu , Lingze Zeng , Beng Chin Ooi , Siliang Tang , Yueting Zhuang

Most Neural Networks (NNs) for classification are trained using Cross-Entropy as a loss function. This approach requires the model to have an explicit classification layer. However, there exist alternative approaches, such as Contrastive…

Machine Learning · Computer Science 2026-04-27 Leonardo Arrighi , Julia Eva Belloni , Aurélie Gallet , Ivan Gentile , Matteo Lippi , Marco Zullich

Long-tailed classification poses a challenge due to its heavy imbalance in class probabilities and tail-sensitivity risks with asymmetric misprediction costs. Recent attempts have used re-balancing loss and ensemble methods, but they are…

Machine Learning · Computer Science 2023-03-22 Bolian Li , Ruqi Zhang

Due to the advantages of leveraging unlabeled data and learning meaningful representations, semi-supervised learning and contrastive learning have been progressively combined to achieve better performances in popular applications with few…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Bowen Tao , Lan Li , Xin-Chun Li , De-Chuan Zhan

Recently, image-text matching has attracted more and more attention from academia and industry, which is fundamental to understanding the latent correspondence across visual and textual modalities. However, most existing methods implicitly…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Yang Qin , Yuan Sun , Dezhong Peng , Joey Tianyi Zhou , Xi Peng , Peng Hu

Recognising detailed facial or clothing attributes in images of people is a challenging task for computer vision, especially when the training data are both in very large scale and extremely imbalanced among different attribute classes. To…

Computer Vision and Pattern Recognition · Computer Science 2017-12-11 Qi Dong , Shaogang Gong , Xiatian Zhu