English
Related papers

Related papers: DuoCLR: Dual-Surrogate Contrastive Learning for Sk…

200 papers

Semi-supervised learning is a sound measure to relieve the strict demand of abundant annotated datasets, especially for challenging multi-organ segmentation . However, most existing SSL methods predict pixels in a single image…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Lu Wen , Zhenghao Feng , Yun Hou , Peng Wang , Xi Wu , Jiliu Zhou , Yan Wang

High dimensional data analysis for exploration and discovery includes three fundamental tasks: dimensionality reduction, clustering, and visualization. When the three associated tasks are done separately, as is often the case thus far,…

Machine Learning · Computer Science 2020-12-02 Stan Z. Li , Lirong Wu , Zelin Zang

Self-supervised representation learning (SSRL) methods have shown great success in computer vision. In recent studies, augmentation-based contrastive learning methods have been proposed for learning representations that are invariant or…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Xia Xu , Jochen Triesch

Contrastive Learning (CL) enhances the training of sequential recommendation (SR) models through informative self-supervision signals. Existing methods often rely on data augmentation strategies to create positive samples and promote…

Information Retrieval · Computer Science 2026-04-06 Zhikai Wang , Yanyan Shen , Zexi Zhang , Li He , Yichun Li , Hao Gu , Yinghua Zhang

Semi-supervised action recognition aims to improve spatio-temporal reasoning ability with a few labeled data in conjunction with a large amount of unlabeled data. Albeit recent advancements, existing powerful methods are still prone to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Yu Wang , Sanping Zhou , Kun Xia , Le Wang

The self-supervised pretraining paradigm has achieved great success in learning 3D action representations for skeleton-based action recognition using contrastive learning. However, learning effective representations for skeleton-based…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Qiushuo Cheng , Jingjing Liu , Catherine Morgan , Alan Whone , Majid Mirmehdi

Prototypical contrastive learning (PCL) has been widely used to learn class-wise domain-invariant features recently. These methods are based on the assumption that the prototypes, which are represented as the central value of the same class…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Muxin Liao , Shishun Tian , Yuhang Zhang , Guoguang Hua , Wenbin Zou , Xia Li

The human cerebral cortex has many bumps and grooves called gyri and sulci. Even though there is a high inter-individual consistency for the main cortical folds, this is not the case when we examine the exact shapes and details of the…

Machine Learning · Computer Science 2024-02-01 Aymeric Gaudin , Louise Guillon , Clara Fischer , Arnaud Cachia , Denis Rivière , Jean-François Mangin , Joël Chavas

Multi-view contrastive clustering (MVCC) has gained significant attention for generating consistent clustering structures from multiple views through contrastive learning. However, most existing MVCC methods create cross-views by combining…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Hanning Yuan , Zhihui Zhang , Qi Guo , Lianhua Chi , Sijie Ruan , Jinhui Pang , Xiaoshuai Hao

Self-supervised learning approach like contrastive learning is attached great attention in natural language processing. It uses pairs of training data augmentations to build a classification task for an encoder with well representation…

Computation and Language · Computer Science 2021-12-03 Deshui Miao , Jiaqi Zhang , Wenbo Xie , Jian Song , Xin Li , Lijuan Jia , Ning Guo

We present ConCur, a contrastive video representation learning method that uses curriculum learning to impose a dynamic sampling strategy in contrastive training. More specifically, ConCur starts the contrastive training with easy positive…

Computer Vision and Pattern Recognition · Computer Science 2022-09-05 Shuvendu Roy , Ali Etemad

We introduce EfficientCL, a memory-efficient continual pretraining method that applies contrastive learning with novel data augmentation and curriculum learning. For data augmentation, we stack two types of operation sequentially: cutoff…

Computation and Language · Computer Science 2021-10-19 Seonghyeon Ye , Jiseon Kim , Alice Oh

Learning universal time series representations applicable to various types of downstream tasks is challenging but valuable in real applications. Recently, researchers have attempted to leverage the success of self-supervised contrastive…

Machine Learning · Computer Science 2023-12-27 Jiexi Liu , Songcan Chen

Human Activity Recognition (HAR) constitutes one of the most important tasks for wearable and mobile sensing given its implications in human well-being and health monitoring. Motivated by the limitations of labeled datasets in HAR,…

Machine Learning · Computer Science 2021-02-12 Chi Ian Tang , Ignacio Perez-Pozuelo , Dimitris Spathis , Cecilia Mascolo

Contrastive learning has been successfully leveraged to learn action representations for addressing the problem of semi-supervised skeleton-based action recognition. However, most contrastive learning-based methods only contrast global…

Computer Vision and Pattern Recognition · Computer Science 2023-02-07 Binqian Xu , Xiangbo Shu

In skeleton-based human activity understanding, existing methods often adopt the contrastive learning paradigm to construct a discriminative feature space. However, many of these approaches fail to exploit the structural inter-class…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Hongda Liu , Yunfan Liu , Min Ren , Lin Sui , Yunlong Wang , Zhenan Sun

Heterogeneous sequential recommendation (HSR) aims to learn dynamic behavior dependencies from the diverse behaviors of user-item interactions to facilitate precise sequential recommendation. Despite many efforts yielding promising…

Information Retrieval · Computer Science 2026-04-17 Jing Xiao , Dongqi Wu , Liwei Pan , Yawen Luo , Weike Pan , Zhong Ming

Contrastive pretraining is well-known to improve downstream task performance and model generalisation, especially in limited label settings. However, it is sensitive to the choice of augmentation pipeline. Positive pairs should preserve…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Melanie Roschewitz , Fabio De Sousa Ribeiro , Tian Xia , Galvin Khara , Ben Glocker

Recently, some contrastive learning methods have been proposed to simultaneously learn representations and clustering assignments, achieving significant improvements. However, these methods do not take the category information and…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Huasong Zhong , Jianlong Wu , Chong Chen , Jianqiang Huang , Minghua Deng , Liqiang Nie , Zhouchen Lin , Xian-Sheng Hua

Contrastive learning (CL) methods effectively learn data representations in a self-supervision manner, where the encoder contrasts each positive sample over multiple negative samples via a one-vs-many softmax cross-entropy loss. By…

Machine Learning · Computer Science 2023-08-16 Huangjie Zheng , Xu Chen , Jiangchao Yao , Hongxia Yang , Chunyuan Li , Ya Zhang , Hao Zhang , Ivor Tsang , Jingren Zhou , Mingyuan Zhou