English
Related papers

Related papers: Focal and Global Spatial-Temporal Transformer for …

200 papers

Previous methods for dynamic facial expression recognition (DFER) in the wild are mainly based on Convolutional Neural Networks (CNNs), whose local operations ignore the long-range dependencies in videos. Transformer-based methods for DFER…

Computer Vision and Pattern Recognition · Computer Science 2023-05-08 Fuyan Ma , Bin Sun , Shutao Li

The task of skeleton-based action recognition remains a core challenge in human-centred scene understanding due to the multiple granularities and large variation in human motion. Existing approaches typically employ a single neural…

Computer Vision and Pattern Recognition · Computer Science 2021-08-11 Tailin Chen , Desen Zhou , Jian Wang , Shidong Wang , Yu Guan , Xuming He , Errui Ding

Skeleton-based action recognition methods are limited by the semantic extraction of spatio-temporal skeletal maps. However, current methods have difficulty in effectively combining features from both temporal and spatial graph dimensions…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Shengqin Wang , Yongji Zhang , Minghao Zhao , Hong Qi , Kai Wang , Fenglin Wei , Yu Jiang

Transformer-based methods have recently achieved significant success in 3D human pose estimation, owing to their strong ability to model long-range dependencies. However, relying solely on the global attention mechanism is insufficient for…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Guangsheng Xu , Guoyi Zhang , Lejia Ye , Shuwei Gan , Xiaohu Zhang , Xia Yang

Human Action Recognition (HAR) is an interesting research area in human-computer interaction used to monitor the activities of elderly and disabled individuals affected by physical and mental health. In the recent era, skeleton-based HAR…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Faisal Mehmood , Enqing Chen , Touqeer Abbas , Samah M. Alzanin

Previous methods for dynamic facial expression in the wild are mainly based on Convolutional Neural Networks (CNNs), whose local operations ignore the long-range dependencies in videos. To solve this problem, we propose the spatio-temporal…

Computer Vision and Pattern Recognition · Computer Science 2022-05-11 Fuyan Ma , Bin Sun , Shutao Li

Action recognition with 3D skeleton sequences is becoming popular due to its speed and robustness. The recently proposed Convolutional Neural Networks (CNN) based methods have shown good performance in learning spatio-temporal…

Computer Vision and Pattern Recognition · Computer Science 2018-04-12 Zhengyuan Yang , Yuncheng Li , Jianchao Yang , Jiebo Luo

This paper tackles the challenge of automatically assessing physical rehabilitation exercises for patients who perform the exercises without clinician supervision. The objective is to provide a quality score to ensure correct performance…

Image and Video Processing · Electrical Eng. & Systems 2025-02-26 Youssef Mourchid , Rim Slama

Modelling various spatio-temporal dependencies is the key to recognising human actions in skeleton sequences. Most existing methods excessively relied on the design of traversal rules or graph topologies to draw the dependencies of the…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Tailin Chen , Shidong Wang , Desen Zhou , Yu Guan

Triggered by the success of transformers in various visual tasks, the spatial self-attention mechanism has recently attracted more and more attention in the computer vision community. However, we empirically found that a typical vision…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Jiayin Sun , Hong Wang , Qiulei Dong

We propose ST-DETR, a Spatio-Temporal Transformer-based architecture for object detection from a sequence of temporal frames. We treat the temporal frames as sequences in both space and time and employ the full attention mechanisms to take…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Eslam Mohamed , Ahmad El-Sallab

Dynamic skeletal data, represented as the 2D/3D coordinates of human joints, has been widely studied for human action recognition due to its high-level semantic information and environmental robustness. However, previous methods heavily…

Computer Vision and Pattern Recognition · Computer Science 2020-07-08 Lei Shi , Yifan Zhang , Jian Cheng , Hanqing Lu

Human action recognition in 3D skeleton sequences has attracted a lot of research attention. Recently, Long Short-Term Memory (LSTM) networks have shown promising performance in this task due to their strengths in modeling the dependencies…

Computer Vision and Pattern Recognition · Computer Science 2018-02-14 Jun Liu , Gang Wang , Ling-Yu Duan , Kamila Abdiyeva , Alex C. Kot

Skeleton-based human action recognition has attracted much attention with the prevalence of accessible depth sensors. Recently, graph convolutional networks (GCNs) have been widely used for this task due to their powerful capability to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Zhen Huang , Xu Shen , Xinmei Tian , Houqiang Li , Jianqiang Huang , Xian-Sheng Hua

We propose a novel Transformer-based architecture for the task of generative modelling of 3D human motion. Previous work commonly relies on RNN-based models considering shorter forecast horizons reaching a stationary and often implausible…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Emre Aksan , Manuel Kaufmann , Peng Cao , Otmar Hilliges

In recent years, action recognition has received much attention and wide application due to its important role in video understanding. Most of the researches on action recognition methods focused on improving the performance via various…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Pengcheng Dong , Wenbo Wan , Huaxiang Zhang , Shuai Li , Sujuan Hou , Jiande Sun

The dynamics of human skeletons have significant information for the task of action recognition. The similarity between trajectories of corresponding joints is an indicating feature of the same action, while this similarity may subject to…

Computer Vision and Pattern Recognition · Computer Science 2020-04-22 Qi Li , Hanlin Mo , Jinghan Zhao , Hongxiang Hao , Hua Li

In recent years, 2D Convolutional Networks-based video action recognition has encouragingly gained wide popularity; However, constrained by the lack of long-range non-linear temporal relation modeling and reverse motion information…

Computer Vision and Pattern Recognition · Computer Science 2021-12-20 Yongkang Zhang , Jun Li , Guoming Wu , Han Zhang , Zhiping Shi , Zhaoxun Liu , Zizhang Wu

Recently Transformer-based hyperspectral image (HSI) change detection methods have shown remarkable performance. Nevertheless, existing attention mechanisms in Transformers have limitations in local feature representation. To address this…

Image and Video Processing · Electrical Eng. & Systems 2024-11-22 Ziyi Wang , Feng Gao , Junyu Dong , Qian Du

Remote photoplethysmography (rPPG), which aims at measuring heart activities and physiological signals from facial video without any contact, has great potential in many applications (e.g., remote healthcare and affective computing). Recent…

Computer Vision and Pattern Recognition · Computer Science 2023-02-08 Zitong Yu , Yuming Shen , Jingang Shi , Hengshuang Zhao , Yawen Cui , Jiehua Zhang , Philip Torr , Guoying Zhao