English
Related papers

Related papers: Contrastive Learning from Spatio-Temporal Mixed Sk…

200 papers

Contrastive learning has achieved great success in self-supervised visual representation learning, but existing approaches mostly ignored spatial information which is often crucial for visual representation. This paper presents…

Computer Vision and Pattern Recognition · Computer Science 2020-11-20 Xinyue Huo , Lingxi Xie , Longhui Wei , Xiaopeng Zhang , Hao Li , Zijie Yang , Wengang Zhou , Houqiang Li , Qi Tian

Fully supervised skeleton-based action recognition has achieved great progress with the blooming of deep learning techniques. However, these methods require sufficient labeled data which is not easy to obtain. In contrast, self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Wenhan Wu , Yilei Hua , Ce Zheng , Shiqian Wu , Chen Chen , Aidong Lu

Multifold observations are common for different data modalities, e.g., a 3D shape can be represented by multi-view images and an image can be described with different captions. Existing cross-modal contrastive representation learning…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Ye Wang , Bowei Jiang , Changqing Zou , Rui Ma

We present MaCLR, a novel method to explicitly perform cross-modal self-supervised video representations learning from visual and motion modalities. Compared to previous video representation learning methods that mostly focus on learning…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Fanyi Xiao , Joseph Tighe , Davide Modolo

We focus on contrastive methods for self-supervised video representation learning. A common paradigm in contrastive learning is to construct positive pairs by sampling different data views for the same instance, with different data…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Chen Sun , Arsha Nagrani , Yonglong Tian , Cordelia Schmid

Self-Supervised Learning (SSL) is a paradigm that leverages unlabeled data for model training. Empirical studies show that SSL can achieve promising performance in distribution shift scenarios, where the downstream and training…

Machine Learning · Computer Science 2023-12-13 Xuyang Zhao , Tianqi Du , Yisen Wang , Jun Yao , Weiran Huang

Multi-modal contrastive representation (MCR) of more than three modalities is critical in multi-modal learning. Although recent methods showcase impressive achievements, the high dependence on large-scale, high-quality paired data and the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-16 Zehan Wang , Ziang Zhang , Luping Liu , Yang Zhao , Haifeng Huang , Tao Jin , Zhou Zhao

Data augmentation plays a critical role in generating high-quality positive and negative pairs necessary for effective contrastive learning. However, common practices involve using a single augmentation policy repeatedly to generate…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Nazim Bendib

Recent self-supervised contrastive learning methods greatly benefit from the Siamese structure that aims to minimizing distances between positive pairs. These methods usually apply random data augmentation to input images, expecting the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-16 Sheng Wang , Zixu Zhuang , Xi Ouyang , Lichi Zhang , Zheren Li , Chong Ma , Tianming Liu , Dinggang Shen , Qian Wang

The major paradigm of applying a pre-trained language model to downstream tasks is to fine-tune it on labeled task data, which often suffers instability and low performance when the labeled examples are scarce.~One way to alleviate this…

Computation and Language · Computer Science 2021-06-07 Ruikun Luo , Guanhuan Huang , Xiaojun Quan

Existing self-supervised contrastive learning methods for skeleton-based action recognition often process all skeleton regions uniformly, and adopt a first-in-first-out (FIFO) queue to store negative samples, which leads to motion…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Yanshan Li , Ke Ma , Miaomiao Wei , Linhui Dai

Most semi-supervised skeleton-based action recognition approaches aim to learn the skeleton action representations only at the joint level, but neglect the crucial motion characteristics at the coarser-grained body (e.g., limb, trunk) level…

Computer Vision and Pattern Recognition · Computer Science 2023-02-07 Binqian Xu , Xiangbo Shu

Graph contrastive learning (GCL), as a popular approach to graph self-supervised learning, has recently achieved a non-negligible effect. To achieve superior performance, the majority of existing GCL methods elaborate on graph data…

Machine Learning · Computer Science 2022-05-03 Yuansheng Wang , Wangbin Sun , Kun Xu , Zulun Zhu , Liang Chen , Zibin Zheng

Skeleton-based action recognition has made great progress recently, but many problems still remain unsolved. For example, most of the previous methods model the representations of skeleton sequences without abundant spatial structure…

Computer Vision and Pattern Recognition · Computer Science 2018-12-04 Chenyang Si , Ya Jing , Wei Wang , Liang Wang , Tieniu Tan

In recent years, the introduction of self-supervised contrastive learning (SSCL) has demonstrated remarkable improvements in representation learning across various domains, including natural language processing and computer vision. By…

Machine Learning · Computer Science 2023-08-15 Chiyu Zhang , Qi Yan , Lili Meng , Tristan Sylvain

3D Skeleton-based human action recognition has attracted increasing attention in recent years. Most of the existing work focuses on supervised learning which requires a large number of labeled action sequences that are often expensive and…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Siyuan Yang , Jun Liu , Shijian Lu , Er Meng Hwa , Yongjian Hu , Alex C. Kot

This paper focuses on learning representation on the whole graph level in an unsupervised manner. Learning graph-level representation plays an important role in a variety of real-world issues such as molecule property prediction, protein…

Machine Learning · Computer Science 2024-01-08 Ge Wang , Zelin Zang , Jiangbin Zheng , Jun Xia , Stan Z. Li

Person re-identification (re-ID) via 3D skeletons is an important emerging topic with many merits. Existing solutions rarely explore valuable body-component relations in skeletal structure or motion, and they typically lack the ability to…

Computer Vision and Pattern Recognition · Computer Science 2022-08-26 Haocong Rao , Chunyan Miao

The success of Transformer-based models has encouraged many researchers to learn CAD models using sequence-based approaches. However, learning CAD models is still a challenge, because they can be represented as complex shapes with long…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Minseop Jung , Minseong Kim , Jibum Kim

Learning discriminative image representations plays a vital role in long-tailed image classification because it can ease the classifier learning in imbalanced cases. Given the promising performance contrastive learning has shown recently in…

Computer Vision and Pattern Recognition · Computer Science 2021-03-29 Peng Wang , Kai Han , Xiu-Shen Wei , Lei Zhang , Lei Wang