English
Related papers

Related papers: Variational Contrastive Learning for Skeleton-base…

200 papers

We propose a novel contrastive learning framework to effectively address the challenges of data heterogeneity in federated learning. We first analyze the inconsistency of gradient updates across clients during local training and establish…

Machine Learning · Computer Science 2024-06-03 Seonguk Seo , Jinkyu Kim , Geeho Kim , Bohyung Han

Supervised learning of skeleton sequence encoders for action recognition has received significant attention in recent times. However, learning such encoders without labels continues to be a challenging problem. While prior works have shown…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Anshul Shah , Aniket Roy , Ketul Shah , Shlok Kumar Mishra , David Jacobs , Anoop Cherian , Rama Chellappa

Multi-view representation learning has developed rapidly over the past decades and has been applied in many fields. However, most previous works assumed that each view is complete and aligned. This leads to an inevitable deterioration in…

Computer Vision and Pattern Recognition · Computer Science 2022-11-10 Yiming Wang , Dongxia Chang , Zhiqiang Fu , Jie Wen , Yao Zhao

Learning from 3D protein structures has gained wide interest in protein modeling and structural bioinformatics. Unfortunately, the number of available structures is orders of magnitude lower than the training data sizes commonly used in…

Biomolecules · Quantitative Biology 2022-06-01 Pedro Hermosilla , Timo Ropinski

Modality representation learning is an important problem for multimodal sentiment analysis (MSA), since the highly distinguishable representations can contribute to improving the analysis effect. Previous works of MSA have usually focused…

Multimedia · Computer Science 2023-01-31 Peipei Liu , Xin Zheng , Hong Li , Jie Liu , Yimo Ren , Hongsong Zhu , Limin Sun

Skeleton-based action recognition is a central task in computer vision and human-robot interaction. However, most previous methods suffer from overlooking the explicit exploitation of the latent data distributions (i.e., the intra-class…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Shaojie Zhang , Jianqin Yin , Yonghao Dang

Learning discriminative image representations plays a vital role in long-tailed image classification because it can ease the classifier learning in imbalanced cases. Given the promising performance contrastive learning has shown recently in…

Computer Vision and Pattern Recognition · Computer Science 2021-03-29 Peng Wang , Kai Han , Xiu-Shen Wei , Lei Zhang , Lei Wang

Self-supervised contrastive learning has emerged as a powerful paradigm for skeleton-based action recognition by enforcing consistency in the embedding space. However, existing methods rely on binary contrastive objectives that overlook the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Yingjie Feng , Yi Wang , Jiaze Wang , Anfeng Liu , Zhuotao Tian

In this paper, we investigate the effectiveness of contrastive learning methods for predicting grasp outcomes in an unsupervised manner. By utilizing a publicly available dataset, we demonstrate that contrastive learning methods perform…

Robotics · Computer Science 2023-09-22 Chengliang Liu , Binhua Huang , Yiwen Liu , Yuanzhe Su , Ke Mai , Yupo Zhang , Zhengkun Yi , Xinyu Wu

For pursuing accurate skeleton-based action recognition, most prior methods use the strategy of combining Graph Convolution Networks (GCNs) with attention-based methods in a serial way. However, they regard the human skeleton as a complete…

Computer Vision and Pattern Recognition · Computer Science 2023-01-30 Chen Pang , Xuequan Lu , Lei Lyu

Contrastive representation learning has emerged as a promising technique for continual learning as it can learn representations that are robust to catastrophic forgetting and generalize well to unseen future tasks. Previous work in…

Computer Vision and Pattern Recognition · Computer Science 2023-11-06 Rouzbeh Meshkinnejad , Jie Mei , Daniel Lizotte , Yalda Mohsenzadeh

In the past few years, we have witnessed remarkable breakthroughs in self-supervised representation learning. Despite the success and adoption of representations learned through this paradigm, much is yet to be understood about how…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Klemen Kotar , Gabriel Ilharco , Ludwig Schmidt , Kiana Ehsani , Roozbeh Mottaghi

Previous deep learning approaches for survival analysis have primarily relied on ranking losses to improve discrimination performance, which often comes at the expense of calibration performance. To address such an issue, we propose a novel…

Machine Learning · Computer Science 2024-11-22 Dongjoon Lee , Hyeryn Park , Changhee Lee

Contrastive learning has revolutionized the field of computer vision, learning rich representations from unlabeled data, which generalize well to diverse vision tasks. Consequently, it has become increasingly important to explain these…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Fawaz Sammani , Boris Joukovsky , Nikos Deligiannis

Learning robust representations to discriminate cell phenotypes based on microscopy images is important for drug discovery. Drug development efforts typically analyse thousands of cell images to screen for potential treatments. Early works…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Alexis Perakis , Ali Gorji , Samriddhi Jain , Krishna Chaitanya , Simone Rizza , Ender Konukoglu

In skeleton-based human activity understanding, existing methods often adopt the contrastive learning paradigm to construct a discriminative feature space. However, many of these approaches fail to exploit the structural inter-class…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Hongda Liu , Yunfan Liu , Min Ren , Lin Sui , Yunlong Wang , Zhenan Sun

The success of most advanced facial expression recognition works relies heavily on large-scale annotated datasets. However, it poses great challenges in acquiring clean and consistent annotations for facial expression datasets. On the other…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Yuxuan Shu , Xiao Gu , Guang-Zhong Yang , Benny Lo

In this work, we study self-supervised representation learning for 3D skeleton-based action recognition. We extend Bootstrap Your Own Latent (BYOL) for representation learning on skeleton sequence data and propose a new data augmentation…

Computer Vision and Pattern Recognition · Computer Science 2022-04-20 Olivier Moliner , Sangxia Huang , Kalle Åström

Skeleton-based human action recognition has received widespread attention in recent years due to its diverse range of application scenarios. Due to the different sources of human skeletons, skeleton data naturally exhibit heterogeneity. The…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Hongsong Wang , Xiaoyan Ma , Jidong Kuang , Jie Gui

Due to the fast processing-speed and robustness it can achieve, skeleton-based action recognition has recently received the attention of the computer vision community. The recent Convolutional Neural Network (CNN)-based methods have shown…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Han Chen , Yifan Jiang , Hanseok Ko