English
Related papers

Related papers: Decoupled Contrastive Learning for Long-Tailed Rec…

200 papers

Semi-supervised medical image segmentation (SSMIS) has been demonstrated the potential to mitigate the issue of limited medical labeled data. However, confirmation and cognitive biases may affect the prevalent teacher-student based SSMIS…

Image and Video Processing · Electrical Eng. & Systems 2024-10-07 Bentao Song , Qingfeng Wang

As the data scale grows, deep recognition models often suffer from long-tailed data distributions due to the heavy imbalanced sample number across categories. Indeed, real-world data usually exhibit some similarity relation among different…

Computer Vision and Pattern Recognition · Computer Science 2022-08-18 Lei Liu , Li Liu

Video contrastive learning (V-CL) has emerged as a popular framework for unsupervised video representation learning, demonstrating strong results in tasks such as action classification and detection. Yet, to harness these benefits, it is…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Zeen Song , Wenwen Qiang , Changwen Zheng , Hui Xiong , Gang Hua

We propose a distance supervised relation extraction approach for long-tailed, imbalanced data which is prevalent in real-world settings. Here, the challenge is to learn accurate "few-shot" models for classes existing at the tail of the…

Information Retrieval · Computer Science 2023-01-26 Ningyu Zhang , Shumin Deng , Zhanlin Sun , Guanying Wang , Xi Chen , Wei Zhang , Huajun Chen

Modern image classifiers perform well on populated classes, while degrading considerably on tail classes with only a few instances. Humans, by contrast, effortlessly handle the long-tailed recognition challenge, since they can learn the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Yingjun Du , Jiayi Shen , Xiantong Zhen , Cees G. M. Snoek

Contrastive learning is a representation learning method performed by contrasting a sample to other similar samples so that they are brought closely together, forming clusters in the feature space. The learning process is typically…

Machine Learning · Computer Science 2022-09-28 Valentino Vito , Lim Yohanes Stefanus

Semi-supervised learning (SSL) has achieved great success in leveraging a large amount of unlabeled data to learn a promising classifier. A popular approach is pseudo-labeling that generates pseudo labels only for those unlabeled data with…

Computer Vision and Pattern Recognition · Computer Science 2022-12-29 Qinyi Deng , Yong Guo , Zhibang Yang , Haolin Pan , Jian Chen

Contrastive Learning (CL) has been proved to be a powerful self-supervised approach for a wide range of domains, including computer vision and graph representation learning. However, the incremental learning issue of CL has rarely been…

Machine Learning · Computer Science 2023-01-31 Cheng Ji , Jianxin Li , Hao Peng , Jia Wu , Xingcheng Fu , Qingyun Sun , Phillip S. Yu

Real-world visual recognition requires handling the extreme sample imbalance in large-scale long-tailed data. We propose a "divide&conquer" strategy for the challenging LVIS task: divide the whole data into balanced parts and then apply…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Xinting Hu , Yi Jiang , Kaihua Tang , Jingyuan Chen , Chunyan Miao , Hanwang Zhang

Semi-supervised learning (SSL), which aims at leveraging a few labeled images and a large number of unlabeled images for network training, is beneficial for relieving the burden of data annotation in medical image segmentation. According to…

Image and Video Processing · Electrical Eng. & Systems 2022-02-15 Xinkai Zhao , Chaowei Fang , De-Jun Fan , Xutao Lin , Feng Gao , Guanbin Li

While modern visual recognition systems have made significant advancements, many continue to struggle with the open problem of learning from few exemplars. This paper focuses on the task of object detection in the setting where object…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Phi Vu Tran

Conventional knowledge distillation, designed for model compression, fails on long-tailed distributions because the teacher model tends to be biased toward head classes and provides limited supervision for tail classes. We propose…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Seonghak Kim

For a widely-studied data model and general loss and sample-hardening functions we prove that the losses of Supervised Contrastive Learning (SCL), Hard-SCL (HSCL), and Unsupervised Contrastive Learning (UCL) are minimized by representations…

Machine Learning · Computer Science 2025-05-08 Ruijie Jiang , Thuan Nguyen , Shuchin Aeron , Prakash Ishwar

Real-world data consistently exhibits a long-tailed distribution, often spanning multiple categories. This complexity underscores the challenge of content comprehension, particularly in scenarios requiring Long-Tailed Multi-Label image…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Jiexuan Yan , Sheng Huang , Nankun Mu , Luwen Huangfu , Bo Liu

Learning useful data representations without requiring labels is a cornerstone of modern deep learning. Self-supervised learning methods, particularly contrastive learning (CL), have proven successful by leveraging data augmentations to…

Machine Learning · Computer Science 2023-12-11 Sacha Morin , Somjit Nath , Samira Ebrahimi Kahou , Guy Wolf

Medical image segmentation is a critical yet challenging task, primarily due to the difficulty of obtaining extensive datasets of high-quality, expert-annotated images. Contrastive learning presents a potential but still problematic…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Shuang Zeng , Lei Zhu , Xinliang Zhang , Hangzhou He , Yanye Lu

Federated learning is designed to enhance data security and privacy, but faces challenges when dealing with heterogeneous data in long-tailed and non-IID distributions. This paper explores an overlooked scenario where tail classes are…

Machine Learning · Computer Science 2024-03-14 Zhuoxin Chen , Zhenyu Wu , Yang Ji

Recently, multi-expert methods have led to significant improvements in long-tail recognition (LTR). We summarize two aspects that need further enhancement to contribute to LTR boosting: (1) More diverse experts; (2) Lower model variance.…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Qihao Zhao , Chen Jiang , Wei Hu , Fan Zhang , Jun Liu

Contrastive learning (CL) has become a powerful approach for learning representations from unlabeled images. However, existing CL methods focus predominantly on visual appearance features while neglecting topological characteristics (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Guangyu Meng , Pengfei Gu , Peixian Liang , John P. Lalor , Erin Wolf Chambers , Danny Z. Chen

Graph Contrastive Learning (GCL) has emerged as a powerful tool for extracting consistent representations from graphs, independent of labeled information. However, existing methods predominantly focus on undirected graphs, disregarding the…

Machine Learning · Computer Science 2025-10-21 Daohan Su , Yang Zhang , Xunkai Li , Rong-Hua Li , Guoren Wang