中文
相关论文

相关论文: Cross-Stream Contrastive Learning for Self-Supervi…

200 篇论文

Graph contrastive learning (GCL) is a popular method for leaning graph representations by maximizing the consistency of features across augmented views. Traditional GCL methods utilize single-perspective i.e. data or model-perspective)…

机器学习 · 计算机科学 2024-06-04 Zelin Yao , Chuang Liu , Xueqi Ma , Mukun Chen , Jia Wu , Xiantao Cai , Bo Du , Wenbin Hu

Learning view-invariant representation is a key to improving feature discrimination power for skeleton-based action recognition. Existing approaches cannot effectively remove the impact of viewpoint due to the implicit view-dependent…

计算机视觉与模式识别 · 计算机科学 2023-04-04 Qianhui Men , Edmond S. L. Ho , Hubert P. H. Shum , Howard Leung

Multi-modal Contrastive Representation learning aims to encode different modalities into a semantically aligned shared space. This paradigm shows remarkable generalization ability on numerous downstream tasks across various modalities.…

机器学习 · 计算机科学 2023-10-20 Zehan Wang , Yang Zhao , Xize Cheng , Haifeng Huang , Jiageng Liu , Li Tang , Linjun Li , Yongqi Wang , Aoxiong Yin , Ziang Zhang , Zhou Zhao

The learn-to-compare paradigm of contrastive representation learning (CRL), which compares positive samples with negative ones for representation learning, has achieved great success in a wide range of domains, including natural language…

信息检索 · 计算机科学 2022-06-02 Lanling Xu , Jianxun Lian , Wayne Xin Zhao , Ming Gong , Linjun Shou , Daxin Jiang , Xing Xie , Ji-Rong Wen

Contrastive self-supervised learning (CSL) has attracted increasing attention for model pre-training via unlabeled data. The resulted CSL models provide instance-discriminative visual features that are uniformly scattered in the feature…

计算机视觉与模式识别 · 计算机科学 2021-10-15 Yifan Zhang , Bryan Hooi , Dapeng Hu , Jian Liang , Jiashi Feng

Recommender systems (RecSys) are essential for online platforms, providing personalized suggestions to users within a vast sea of information. Self-supervised graph learning seeks to harness high-order collaborative filtering signals…

信息检索 · 计算机科学 2025-07-18 Weizhi Zhang , Liangwei Yang , Zihe Song , Henrry Peng Zou , Ke Xu , Yuanjie Zhu , Philip S. Yu

In the past few years, we have witnessed remarkable breakthroughs in self-supervised representation learning. Despite the success and adoption of representations learned through this paradigm, much is yet to be understood about how…

计算机视觉与模式识别 · 计算机科学 2021-08-20 Klemen Kotar , Gabriel Ilharco , Ludwig Schmidt , Kiana Ehsani , Roozbeh Mottaghi

Contrastive learning has shown promising potential for learning robust representations by utilizing unlabeled data. However, constructing effective positive-negative pairs for contrastive learning on facial behavior datasets remains…

计算机视觉与模式识别 · 计算机科学 2023-08-28 Xiang Zhang , Taoyue Wang , Xiaotian Li , Huiyuan Yang , Lijun Yin

Despite recent success of self-supervised based contrastive learning model for 3D point clouds representation, the adversarial robustness of such pre-trained models raised concerns. Adversarial contrastive learning (ACL) is considered an…

计算机视觉与模式识别 · 计算机科学 2022-09-16 Junxuan Huang , Yatong An , Lu cheng , Bai Chen , Junsong Yuan , Chunming Qiao

As one of the most effective self-supervised representation learning methods, contrastive learning (CL) relies on multiple negative pairs to contrast against each positive pair. In the standard practice of contrastive learning, data…

机器学习 · 计算机科学 2024-01-18 Lu Wang , Chao Du , Pu Zhao , Chuan Luo , Zhangchi Zhu , Bo Qiao , Wei Zhang , Qingwei Lin , Saravan Rajmohan , Dongmei Zhang , Qi Zhang

Due to the fast processing-speed and robustness it can achieve, skeleton-based action recognition has recently received the attention of the computer vision community. The recent Convolutional Neural Network (CNN)-based methods have shown…

计算机视觉与模式识别 · 计算机科学 2021-11-23 Han Chen , Yifan Jiang , Hanseok Ko

The high cost of annotating data makes self-supervised approaches, such as contrastive learning methods, appealing for Human Activity Recognition (HAR). Effective contrastive learning relies on selecting informative positive and negative…

计算机视觉与模式识别 · 计算机科学 2025-07-08 Yavuz Yarici , Kiran Kokilepersaud , Mohit Prabhushankar , Ghassan AlRegib

Masked image modelling (e.g., Masked AutoEncoder) and contrastive learning (e.g., Momentum Contrast) have shown impressive performance on unsupervised visual representation learning. This work presents Masked Contrastive Representation…

计算机视觉与模式识别 · 计算机科学 2022-11-14 Yuchong Yao , Nandakishor Desai , Marimuthu Palaniswami

Low-light image enhancement (LLE) remains challenging due to the unfavorable prevailing low-contrast and weak-visibility problems of single RGB images. In this paper, we respond to the intriguing learning-related question -- if leveraging…

计算机视觉与模式识别 · 计算机科学 2021-12-14 Dong Liang , Ling Li , Mingqiang Wei , Shuo Yang , Liyan Zhang , Wenhan Yang , Yun Du , Huiyu Zhou

Most Neural Networks (NNs) for classification are trained using Cross-Entropy as a loss function. This approach requires the model to have an explicit classification layer. However, there exist alternative approaches, such as Contrastive…

机器学习 · 计算机科学 2026-04-27 Leonardo Arrighi , Julia Eva Belloni , Aurélie Gallet , Ivan Gentile , Matteo Lippi , Marco Zullich

Recent approaches in self-supervised learning of image representations can be categorized into different families of methods and, in particular, can be divided into contrastive and non-contrastive approaches. While differences between the…

机器学习 · 计算机科学 2023-06-27 Quentin Garrido , Yubei Chen , Adrien Bardes , Laurent Najman , Yann Lecun

Learning discriminative image representations plays a vital role in long-tailed image classification because it can ease the classifier learning in imbalanced cases. Given the promising performance contrastive learning has shown recently in…

计算机视觉与模式识别 · 计算机科学 2021-03-29 Peng Wang , Kai Han , Xiu-Shen Wei , Lei Zhang , Lei Wang

Whilst contrastive learning has recently brought notable benefits to deep clustering of unlabelled images by learning sample-specific discriminative visual features, its potential for explicitly inferring class decision boundaries is less…

计算机视觉与模式识别 · 计算机科学 2022-11-22 Jiabo Huang , Shaogang Gong

Self-supervised methods have shown tremendous success in the field of computer vision, including applications in remote sensing and medical imaging. Most popular contrastive-loss based methods like SimCLR, MoCo, MoCo-v2 use multiple views…

计算机视觉与模式识别 · 计算机科学 2022-09-07 Umangi Jain , Alex Wilson , Varun Gulshan

Contrastive learning has recently attracted plenty of attention in deep graph clustering for its promising performance. However, complicated data augmentations and time-consuming graph convolutional operation undermine the efficiency of…

机器学习 · 计算机科学 2022-06-28 Yue Liu , Xihong Yang , Sihang Zhou , Xinwang Liu