English
Related papers

Related papers: Targeted Supervised Contrastive Learning for Long-…

200 papers

Classification on long-tailed distributed data is a challenging problem, which suffers from serious class-imbalance and accordingly unpromising performance especially on tail classes. Recently, the ensembling based methods achieve the…

Machine Learning · Computer Science 2022-03-28 Bolian Li , Zongbo Han , Haining Li , Huazhu Fu , Changqing Zhang

The visual world naturally exhibits an imbalance in the number of object or scene instances resulting in a \emph{long-tailed distribution}. This imbalance poses significant challenges for classification models based on deep learning.…

Computer Vision and Pattern Recognition · Computer Science 2021-11-12 Rahul Vigneswaran , Marc T. Law , Vineeth N. Balasubramanian , Makarand Tapaswi

Deep learning models are modern tools for spatio-temporal graph (STG) forecasting. Though successful, we argue that data scarcity is a key factor limiting their recent improvements. Meanwhile, contrastive learning has been an effective…

Machine Learning · Computer Science 2022-11-04 Xu Liu , Yuxuan Liang , Chao Huang , Yu Zheng , Bryan Hooi , Roger Zimmermann

The conventional detectors tend to make imbalanced classification and suffer performance drop, when the distribution of the training data is severely skewed. In this paper, we propose to use the mean classification score to indicate the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Chengjian Feng , Yujie Zhong , Weilin Huang

Biologically inspired spiking neural networks (SNNs) have garnered considerable attention due to their low-energy consumption and spatio-temporal information processing capabilities. Most existing SNNs training methods first integrate…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Haonan Qiu , Zeyin Song , Yanqi Chen , Munan Ning , Wei Fang , Tao Sun , Zhengyu Ma , Li Yuan , Yonghong Tian

While long-tailed semi-supervised learning (LTSSL) has attracted growing attention in many real-world classification tasks, existing LTSSL algorithms typically assume that labeled and unlabeled data share nearly identical class…

Machine Learning · Computer Science 2026-05-19 Kai Gan , Tong Wei , Min-Ling Zhang

Deep neural networks may perform poorly when training datasets are heavily class-imbalanced. Recently, two-stage methods decouple representation learning and classifier learning to improve performance. But there is still the vital issue of…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Zhisheng Zhong , Jiequan Cui , Shu Liu , Jiaya Jia

We present a novel technique for self-supervised video representation learning by: (a) decoupling the learning objective into two contrastive subtasks respectively emphasizing spatial and temporal features, and (b) performing it…

Computer Vision and Pattern Recognition · Computer Science 2021-09-02 Zehua Zhang , David Crandall

This work considers supervised contrastive learning for semantic segmentation. We apply contrastive learning to enhance the discriminative power of the multi-scale features extracted by semantic segmentation networks. Our key methodological…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Theodoros Pissas , Claudio S. Ravasio , Lyndon Da Cruz , Christos Bergeles

Meta-reinforcement learning typically requires orders of magnitude more samples than single task reinforcement learning methods. This is because meta-training needs to deal with more diverse distributions and train extra components such as…

Machine Learning · Computer Science 2021-03-12 Bernie Wang , Simon Xu , Kurt Keutzer , Yang Gao , Bichen Wu

Self-supervised contrastive learning is a powerful tool to learn visual representation without labels. Prior work has primarily focused on evaluating the recognition accuracy of various pre-training algorithms, but has overlooked other…

Computer Vision and Pattern Recognition · Computer Science 2022-06-13 Yuanyi Zhong , Haoran Tang , Junkun Chen , Jian Peng , Yu-Xiong Wang

Deep neural networks perform poorly on heavily class-imbalanced datasets. Given the promising performance of contrastive learning, we propose Rebalanced Siamese Contrastive Mining (ResCom) to tackle imbalanced recognition. Based on the…

Computer Vision and Pattern Recognition · Computer Science 2022-06-27 Zhisheng Zhong , Jiequan Cui , Zeming Li , Eric Lo , Jian Sun , Jiaya Jia

Adversarial attacks exploit the vulnerabilities of convolutional neural networks by introducing imperceptible perturbations that lead to misclassifications, exposing weaknesses in feature representations and decision boundaries. This paper…

Machine Learning · Computer Science 2024-12-30 Longwei Wang , Navid Nayyem , Abdullah Rakin

Contrastive learning has emerged as a powerful framework for learning generalizable representations, yet its theoretical understanding remains limited, particularly under imbalanced data distributions that are prevalent in real-world…

Machine Learning · Computer Science 2026-02-12 Haixu Liao , Yating Zhou , Songyang Zhang , Meng Wang , Shuai Zhang

Graph classification, aiming at learning the graph-level representations for effective class assignments, has received outstanding achievements, which heavily relies on high-quality datasets that have balanced class distribution. In fact,…

Machine Learning · Computer Science 2023-09-06 Siyu Yi , Zhengyang Mao , Wei Ju , Yongdao Zhou , Luchen Liu , Xiao Luo , Ming Zhang

Supervised contrastive learning (SCL) frameworks treat each class as independent and thus consider all classes to be equally important. This neglects the common scenario in which label hierarchy exists, where fine-grained classes under the…

Machine Learning · Computer Science 2024-02-02 Ruixue Lian , William A. Sethares , Junjie Hu

Contrastive learning has demonstrated great effectiveness in representation learning especially for image classification tasks. However, there is still a shortage in the studies targeting regression tasks, and more specifically applications…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Mohamad Dhaini , Maxime Berar , Paul Honeine , Antonin Van Exem

To address the problem of long-tail distribution for the large vocabulary object detection task, existing methods usually divide the whole categories into several groups and treat each group with different strategies. These methods bring…

Computer Vision and Pattern Recognition · Computer Science 2021-04-05 Tong Wang , Yousong Zhu , Chaoyang Zhao , Wei Zeng , Jinqiao Wang , Ming Tang

Real-world data universally confronts a severe class-imbalance problem and exhibits a long-tailed distribution, i.e., most labels are associated with limited instances. The na\"ive models supervised by such datasets would prefer dominant…

Computer Vision and Pattern Recognition · Computer Science 2021-11-09 Zhengzhuo Xu , Zenghao Chai , Chun Yuan

Recently, pretext-task based methods are proposed one after another in self-supervised video feature learning. Meanwhile, contrastive learning methods also yield good performance. Usually, new methods can beat previous ones as claimed that…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Li Tao , Xueting Wang , Toshihiko Yamasaki