English
Related papers

Related papers: Motion Matters: Motion-guided Modulation Network f…

200 papers

Micro-expressions are typically regarded as unconscious manifestations of a person's genuine emotions. However, their short duration and subtle signals pose significant challenges for downstream recognition. We propose a multi-task learning…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Xuxiong Liu , Tengteng Dong , Fei Wang , Weijie Feng , Xiao Sun

Skeleton-based Human Activity Recognition has achieved great interest in recent years as skeleton data has demonstrated being robust to illumination changes, body scales, dynamic camera views, and complex background. In particular,…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Chiara Plizzari , Marco Cannici , Matteo Matteucci

Human action recognition is a crucial task for intelligent robotics, particularly within the context of human-robot collaboration research. In self-supervised skeleton-based action recognition, the mask-based reconstruction paradigm learns…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Wei Wei , Shaojie Zhang , Yonghao Dang , Jianqin Yin

In late fusion, each modality is processed in a separate unimodal Convolutional Neural Network (CNN) stream and the scores of each modality are fused at the end. Due to its simplicity late fusion is still the predominant approach in many…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Hamid Reza Vaezi Joze , Amirreza Shaban , Michael L. Iuzzolino , Kazuhito Koishida

We study the problem of human action recognition using motion capture (MoCap) sequences. Unlike existing techniques that take multiple manual steps to derive standardized skeleton representations as model input, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Xiaoyu Zhu , Po-Yao Huang , Junwei Liang , Celso M. de Melo , Alexander Hauptmann

Micro-actions are subtle, localized movements lasting 1-3 seconds such as scratching one's head or tapping fingers. Such subtle actions are essential for social communication, ubiquitously used in natural interactions, and thus critical for…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Naga VS Raviteja Chappa , Evangelos Sariyanidi , Lisa Yankowitz , Gokul Nair , Casey J. Zampella , Robert T. Schultz , Birkan Tunç

Gait recognition aims to identify individual-specific walking patterns by observing the different periodic movements of each body part. However, most existing methods treat each part equally and fail to account for the data redundancy…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Lei Wang , Bo Liu , Bincheng Wang , Fuqiang Yu

Action understanding, encompassing action detection and anticipation, plays a crucial role in numerous practical applications. However, untrimmed videos are often characterized by substantial redundant information and noise. Moreover, in…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Xinyu Yang , Zheheng Jiang , Feixiang Zhou , Yihang Zhu , Na Lv , Nan Xing , Nishan Canagarajah , Huiyu Zhou

Micro-expressions serve as essential cues for understanding individuals' genuine emotional states. Recognizing micro-expressions attracts increasing research attention due to its various applications in fields such as business negotiation…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Fengyuan Zhang , Zhaopei Huang , Xinjie Zhang , Qin Jin

Skeleton-based gesture recognition methods have achieved high success using Graph Convolutional Network (GCN). In addition, context-dependent adaptive topology as a neighborhood vertex information and attention mechanism leverages a model…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Ikuo Nakamura

Zero-shot skeleton action recognition is a non-trivial task that requires robust unseen generalization with prior knowledge from only seen classes and shared semantics. Existing methods typically build the skeleton-semantics interactions by…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Yang Chen , Jingcai Guo , Song Guo , Dacheng Tao

Recently, transformers have demonstrated great potential for modeling long-term dependencies from skeleton sequences and thereby gained ever-increasing attention in skeleton action recognition. However, the existing transformer-based…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Wenhan Wu , Ce Zheng , Zihao Yang , Chen Chen , Srijan Das , Aidong Lu

Zero-shot action recognition is challenging due to the semantic gap between seen and unseen classes. We present a novel framework that enhances CLIP with disentangled embeddings and semantic-guided interaction. A Motion Separation Module…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Yiming Wang , Frederick W. B. Li , Jingyun Wang

Human actions captured in video sequences contain two crucial factors for action recognition, i.e., visual appearance and motion dynamics. To model these two aspects, Convolutional and Recurrent Neural Networks (CNNs and RNNs) are adopted…

Computer Vision and Pattern Recognition · Computer Science 2019-05-01 Yuan Yuan , Dong Wang , Qi Wang

Skeleton-based human action recognition has achieved a great interest in recent years, as skeleton data has been demonstrated to be robust to illumination changes, body scales, dynamic camera views, and complex background. Nevertheless, an…

Computer Vision and Pattern Recognition · Computer Science 2021-06-24 Chiara Plizzari , Marco Cannici , Matteo Matteucci

Graph convolutional networks have been widely used for skeleton-based action recognition due to their excellent modeling ability of non-Euclidean data. As the graph convolution is a local operation, it can only utilize the short-range joint…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Zhan Chen , Sicheng Li , Bing Yang , Qinghan Li , Hong Liu

Several recent works have directly extended the image masked autoencoder (MAE) with random masking into video domain, achieving promising results. However, unlike images, both spatial and temporal information are important for video…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 David Fan , Jue Wang , Shuai Liao , Yi Zhu , Vimal Bhat , Hector Santos-Villalobos , Rohith MV , Xinyu Li

Skeleton-based human action recognition has attracted a lot of research attention during the past few years. Recent works attempted to utilize recurrent neural networks to model the temporal dependencies between the 3D positional…

Computer Vision and Pattern Recognition · Computer Science 2017-06-27 Jun Liu , Amir Shahroudy , Dong Xu , Alex C. Kot , Gang Wang

Zero-shot human skeleton-based action recognition aims to construct a model that can recognize actions outside the categories seen during training. Previous research has focused on aligning sequences' visual and semantic spatial…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Haojun Xu , Yan Gao , Jie Li , Xinbo Gao

Recent advances in unsupervised video object segmentation have highlighted the potential of two-stream architectures that integrate appearance and motion cues. However, fully leveraging these complementary sources of information requires…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Inseok Jeon , Suhwan Cho , Minhyeok Lee , Seunghoon Lee , Minseok Kang , Jungho Lee , Chaewon Park , Donghyeong Kim , Sangyoun Lee