English
Related papers

Related papers: Hierarchical Consistent Contrastive Learning for S…

200 papers

Contrastive learning is a representation learning method performed by contrasting a sample to other similar samples so that they are brought closely together, forming clusters in the feature space. The learning process is typically…

Machine Learning · Computer Science 2022-09-28 Valentino Vito , Lim Yohanes Stefanus

Fine-grained remote sensing datasets often use hierarchical label structures to differentiate objects in a coarse-to-fine manner, with each object annotated across multiple levels. However, embedding this semantic hierarchy into the…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Jingzhou Chen , Dexin Chen , Fengchao Xiong , Yuntao Qian , Liang Xiao

In contrastive self-supervised learning, the common way to learn discriminative representation is to pull different augmented "views" of the same image closer while pushing all other images further apart, which has been proven to be…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Kaiyou Song , Shan Zhang , Zihao An , Zimeng Luo , Tong Wang , Jin Xie

In this work, we present Multi-Level Contrastive Learning for Dense Prediction Task (MCL), an efficient self-supervised method for learning region-level feature representation for dense prediction tasks. Our method is motivated by the three…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Qiushan Guo , Yizhou Yu , Yi Jiang , Jiannan Wu , Zehuan Yuan , Ping Luo

Existing graph contrastive learning methods rely on augmentation techniques based on random perturbations (e.g., randomly adding or dropping edges and nodes). Nevertheless, altering certain edges or nodes can unexpectedly change the graph…

Machine Learning · Computer Science 2022-11-08 Huidong Liang , Xingjian Du , Bilei Zhu , Zejun Ma , Ke Chen , Junbin Gao

The high cost of annotating data makes self-supervised approaches, such as contrastive learning methods, appealing for Human Activity Recognition (HAR). Effective contrastive learning relies on selecting informative positive and negative…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Yavuz Yarici , Kiran Kokilepersaud , Mohit Prabhushankar , Ghassan AlRegib

Recently, self-supervised methods show remarkable achievements in image-level representation learning. Nevertheless, their image-level self-supervisions lead the learned representation to sub-optimal for dense prediction tasks, such as…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Yunsung Lee , Teakgyu Hong , Han-Cheol Cho , Junbum Cha , Seungryong Kim

Graph-level contrastive learning, aiming to learn the representations for each graph by contrasting two augmented graphs, has attracted considerable attention. Previous studies usually simply assume that a graph and its augmented graph as a…

Artificial Intelligence · Computer Science 2024-04-15 Yanbei Liu , Yu Zhao , Xiao Wang , Lei Geng , Zhitao Xiao

Contrastive learning is one of the fastest growing research areas in machine learning due to its ability to learn useful representations without labeled data. However, contrastive learning is susceptible to feature suppression, i.e., it may…

Machine Learning · Computer Science 2021-11-30 Tianhong Li , Lijie Fan , Yuan Yuan , Hao He , Yonglong Tian , Rogerio Feris , Piotr Indyk , Dina Katabi

In this paper, we address self-supervised representation learning from human skeletons for action recognition. Previous methods, which usually learn feature presentations from a single reconstruction task, may come across the overfitting…

Computer Vision and Pattern Recognition · Computer Science 2020-10-15 Lilang Lin , Sijie Song , Wenhan Yan , Jiaying Liu

Unsupervised Re-ID methods aim at learning robust and discriminative features from unlabeled data. However, existing methods often ignore the relationship between module parameters of Re-ID framework and feature distributions, which may…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Ziqi He , Mengjia Xue , Yunhao Du , Zhicheng Zhao , Fei Su

We introduce TempCLR, a new time-coherent contrastive learning approach for the structured regression task of 3D hand reconstruction. Unlike previous time-contrastive methods for hand pose estimation, our framework considers temporal…

Computer Vision and Pattern Recognition · Computer Science 2022-09-02 Andrea Ziani , Zicong Fan , Muhammed Kocabas , Sammy Christen , Otmar Hilliges

Anomaly detection (AD), aiming to find samples that deviate from the training distribution, is essential in safety-critical applications. Though recent self-supervised learning based attempts achieve promising results by creating virtual…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Guodong Wang , Yunhong Wang , Jie Qin , Dongming Zhang , Xiuguo Bao , Di Huang

Graph contrastive learning (GCL) aims to learn discriminative semantic invariance by contrasting different views of the same graph that share critical topological patterns. However, existing GCL approaches with structural augmentations…

Machine Learning · Computer Science 2025-12-03 Qirui Ji , Bin Qin , Yifan Jin , Yunze Zhao , Chuxiong Sun , Changwen Zheng , Jianwen Cao , Jiangmeng Li

Contrastive representation learning has been outstandingly successful in practice. In this work, we identify two key properties related to the contrastive loss: (1) alignment (closeness) of features from positive pairs, and (2) uniformity…

Machine Learning · Computer Science 2022-08-17 Tongzhou Wang , Phillip Isola

Distant supervision assumes that any sentence containing the same entity pairs reflects identical relationships. Previous works of distantly supervised relation extraction (DSRE) task generally focus on sentence-level or bag-level…

Computation and Language · Computer Science 2022-03-03 Dongyang Li , Taolin Zhang , Nan Hu , Chengyu Wang , Xiaofeng He

With rapid advancements in depth sensors and deep learning, skeleton-based person re-identification (re-ID) models have recently achieved remarkable progress with many advantages. Most existing solutions learn single-level skeleton features…

Computer Vision and Pattern Recognition · Computer Science 2023-09-20 Haocong Rao , Cyril Leung , Chunyan Miao

In this paper, we propose an Aligned Contrastive Learning (ACL) algorithm to address the long-tailed recognition problem. Our findings indicate that while multi-view training boosts the performance, contrastive learning does not…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Jiali Ma , Jiequan Cui , Maeno Kazuki , Lakshmi Subramanian , Karlekar Jayashree , Sugiri Pranata , Hanwang Zhang

Contrastive self-supervised learning (CSL) has managed to match or surpass the performance of supervised learning in image and video classification. However, it is still largely unknown if the nature of the representations induced by the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Rohit Gupta , Naveed Akhtar , Ajmal Mian , Mubarak Shah

Despite recent success of self-supervised based contrastive learning model for 3D point clouds representation, the adversarial robustness of such pre-trained models raised concerns. Adversarial contrastive learning (ACL) is considered an…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Junxuan Huang , Yatong An , Lu cheng , Bai Chen , Junsong Yuan , Chunming Qiao