English
Related papers

Related papers: Action Recognition with Spatio-Temporal Visual Att…

200 papers

Skeleton-based action recognition receives increasing attention because the skeleton representations reduce the amount of training data by eliminating visual information irrelevant to actions. To further improve the sample efficiency,…

Computer Vision and Pattern Recognition · Computer Science 2022-09-22 Anqi Zhu , Qiuhong Ke , Mingming Gong , James Bailey

Skeleton-based action recognition receives the attention of many researchers as it is robust to viewpoint and illumination changes, and its processing is much more efficient than the processing of video frames. With the emergence of deep…

Computer Vision and Pattern Recognition · Computer Science 2024-08-01 Ozge Oztimur Karadag

Pose-based action recognition has drawn considerable attention recently. Existing methods exploit the joint positions to extract the body-part features from the activation map of the convolutional networks to assist human action…

Computer Vision and Pattern Recognition · Computer Science 2019-12-02 Lei Shi , Yifan Zhang , Jian Cheng , Hanqing Lu

This paper presents a novel keypoints-based attention mechanism for visual recognition in still images. Deep Convolutional Neural Networks (CNNs) for recognizing images with distinctive classes have shown great success, but their…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Asish Bera , Zachary Wharton , Yonghuai Liu , Nik Bessis , Ardhendu Behera

Lane detection is a crucial perception task for all levels of automated vehicles (AVs) and Advanced Driver Assistance Systems, particularly in mixed-traffic environments where AVs must interact with human-driven vehicles (HDVs) and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Sandeep Patil , Yongqi Dong , Haneen Farah , Hans Hellendoorn

The dominant paradigm for video-based action segmentation is composed of two steps: first, for each frame, compute low-level features using Dense Trajectories or a Convolutional Neural Network that encode spatiotemporal information locally,…

Computer Vision and Pattern Recognition · Computer Science 2016-08-31 Colin Lea , Rene Vidal , Austin Reiter , Gregory D. Hager

Attention based models have achieved many remarkable breakthroughs in numerous applications. However, the quadratic complexity of Attention makes the vanilla Attention based models hard to apply to long sequence tasks. Various improved…

Machine Learning · Computer Science 2024-09-18 Xue Wang , Tian Zhou , Jianqing Zhu , Jialin Liu , Kun Yuan , Tao Yao , Wotao Yin , Rong Jin , HanQin Cai

Skeleton-based human action recognition has recently drawn increasing attentions with the availability of large-scale skeleton datasets. The most crucial factors for this task lie in two aspects: the intra-frame representation for joint…

Computer Vision and Pattern Recognition · Computer Science 2018-04-18 Chao Li , Qiaoyong Zhong , Di Xie , Shiliang Pu

Spatio-temporal information is key to resolve occlusion and depth ambiguity in 3D pose estimation. Previous methods have focused on either temporal contexts or local-to-global architectures that embed fixed-length spatio-temporal…

Computer Vision and Pattern Recognition · Computer Science 2020-10-21 Junfa Liu , Juan Rojas , Zhijun Liang , Yihui Li , Yisheng Guan

3D action recognition - analysis of human actions based on 3D skeleton data - becomes popular recently due to its succinctness, robustness, and view-invariant representation. Recent attempts on this problem suggested to develop RNN-based…

Computer Vision and Pattern Recognition · Computer Science 2016-07-27 Jun Liu , Amir Shahroudy , Dong Xu , Gang Wang

Human skeleton-based action recognition has long been an indispensable aspect of artificial intelligence. Current state-of-the-art methods tend to consider only the dependencies between connected skeletal joints, limiting their ability to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Yuheng Yang

Modeling and recognition of surgical activities poses an interesting research problem. Although a number of recent works studied automatic recognition of surgical activities, generalizability of these works across different tasks and…

Computer Vision and Pattern Recognition · Computer Science 2020-08-17 Duygu Sarikaya , Pierre Jannin

For multimodal skeleton-based action recognition, Graph Convolutional Networks (GCNs) are effective models. Still, their reliance on floating-point computations leads to high energy consumption, limiting their applicability in…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Naichuan Zheng , Yuchen Du , Hailun Xia , Zeyu Liang

Human actions in video sequences are three-dimensional (3D) spatio-temporal signals characterizing both the visual appearance and motion dynamics of the involved humans and objects. Inspired by the success of convolutional neural networks…

Computer Vision and Pattern Recognition · Computer Science 2015-10-05 Lin Sun , Kui Jia , Dit-Yan Yeung , Bertram E. Shi

Current state-of-the-art methods for skeleton-based action recognition are supervised and rely on labels. The reliance is limiting the performance due to the challenges involved in annotation and mislabeled data. Unsupervised methods have…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Jingyuan Li , Eli Shlizerman

Graph convolutional networks have been widely used for skeleton-based action recognition due to their excellent modeling ability of non-Euclidean data. As the graph convolution is a local operation, it can only utilize the short-range joint…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Zhan Chen , Sicheng Li , Bing Yang , Qinghan Li , Hong Liu

Human action recognition from skeletal data is a hot research topic and important in many open domain applications of computer vision, thanks to recently introduced 3D sensors. In the literature, naive methods simply transfer off-the-shelf…

Computer Vision and Pattern Recognition · Computer Science 2017-08-04 Jacopo Cavazza , Pietro Morerio , Vittorio Murino

In the task of emotion recognition from videos, a key improvement has been to focus on emotions over time rather than a single frame. There are many architectures to address this task such as GRUs, LSTMs, Self-Attention, Transformers, and…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Alexander Mehta , William Yang

Skeleton-based human action recognition has received widespread attention in recent years due to its diverse range of application scenarios. Due to the different sources of human skeletons, skeleton data naturally exhibit heterogeneity. The…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Hongsong Wang , Xiaoyan Ma , Jidong Kuang , Jie Gui

Human actions in video sequences are characterized by the complex interplay between spatial features and their temporal dynamics. In this paper, we propose novel tensor representations for compactly capturing such higher-order relationships…

Computer Vision and Pattern Recognition · Computer Science 2021-08-31 Piotr Koniusz , Lei Wang , Anoop Cherian