English
Related papers

Related papers: Action Recognition with Spatio-Temporal Visual Att…

200 papers

We propose a Few-shot Learning pipeline for 3D skeleton-based action recognition by Joint tEmporal and cAmera viewpoiNt alIgnmEnt (JEANIE). To factor out misalignment between query and support sequences of 3D body joints, we propose an…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Lei Wang , Piotr Koniusz

Skeleton-based action recognition has gained considerable traction thanks to its utilization of succinct and robust skeletal representations. Nonetheless, current methodologies often lean towards utilizing a solitary backbone to model…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Jinfu Liu , Baiqiao Yin , Jiaying Lin , Jiajun Wen , Yue Li , Mengyuan Liu

Skeleton-based action recognition is a hotspot in image processing. A key challenge of this task lies in its dependence on large, manually labeled datasets whose acquisition is costly and time-consuming. This paper devises a novel,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Hichem Sahbi

Existing multimodal-based human action recognition approaches are computationally intensive, limiting their deployment in real-time applications. In this work, we present a novel and efficient pose-driven attention-guided multimodal network…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Ahmed Abdelkawy , Asem Ali , Aly Farag

Skeleton-based action recognition, which classifies human actions based on the coordinates of joints and their connectivity within skeleton data, is widely utilized in various scenarios. While Graph Convolutional Networks (GCNs) have been…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Jeonghyeok Do , Munchurl Kim

One essential problem in skeleton-based action recognition is how to extract discriminative features over all skeleton joints. However, the complexity of the State-Of-The-Art (SOTA) models of this task tends to be exceedingly sophisticated…

Computer Vision and Pattern Recognition · Computer Science 2020-10-21 Yi-Fan Song , Zhang Zhang , Caifeng Shan , Liang Wang

Visual attention mechanisms have proven to be integrally important constituent components of many modern deep neural architectures. They provide an efficient and effective way to utilize visual information selectively, which has shown to be…

Computer Vision and Pattern Recognition · Computer Science 2019-05-24 Siddhesh Khandelwal , Leonid Sigal

Gait recognition, a long-distance biometric technology, has aroused intense interest recently. Currently, the two dominant gait recognition works are appearance-based and model-based, which extract features from silhouettes and skeletons,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Likai Wang , Ruize Han , Wei Feng

Human action recognition as an important application of computer vision has been studied for decades. Among various approaches, skeleton-based methods recently attract increasing attention due to their robust and superior performance.…

Computer Vision and Pattern Recognition · Computer Science 2021-02-26 Tingtian Li , Zixun Sun , Xiao Chen

Human activity and gesture recognition is an important component of rapidly growing domain of ambient intelligence, in particular in assisting living and smart homes. In this paper, we propose to combine the power of two deep learning…

Computer Vision and Pattern Recognition · Computer Science 2020-07-24 Kenneth Lai , Svetlana N. Yanushkevich

In this paper, we propose a Few-shot Learning pipeline for 3D skeleton-based action recognition by Joint tEmporal and cAmera viewpoiNt alIgnmEnt (JEANIE). To factor out misalignment between query and support sequences of 3D body joints, we…

Computer Vision and Pattern Recognition · Computer Science 2021-12-24 Lei Wang , Jun Liu , Piotr Koniusz

This paper presents a 2D skeleton-based action segmentation method with applications in fine-grained human activity recognition. In contrast with state-of-the-art methods which directly take sequences of 3D skeleton coordinates as inputs…

Computer Vision and Pattern Recognition · Computer Science 2024-04-29 Syed Waleed Hyder , Muhammad Usama , Anas Zafar , Muhammad Naufil , Fawad Javed Fateh , Andrey Konin , M. Zeeshan Zia , Quoc-Huy Tran

Sliding window is one direct way to extend a successful recognition system to handle the more challenging detection problem. While action recognition decides only whether or not an action is present in a pre-segmented video sequence, action…

Computer Vision and Pattern Recognition · Computer Science 2015-12-29 Moustafa Meshry , Mohamed E. Hussein , Marwan Torki

A challenge of skeleton-based action recognition is the difficulty to classify actions with similar motions and object-related actions. Visual clues from other streams help in that regard. RGB data are sensible to illumination conditions,…

Computer Vision and Pattern Recognition · Computer Science 2021-01-25 Alban Main de Boissiere , Rita Noumeir

Graph convolutional networks (GCNs) are an effective skeleton-based human action recognition (HAR) technique. GCNs enable the specification of CNNs to a non-Euclidean frame that is more flexible. The previous GCN-based models still have a…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Faisal Mehmood , Xin Guo , Enqing Chen , Muhammad Azeem Akbar , Arif Ali Khan , Sami Ullah

Self-supervised learning has demonstrated remarkable capability in representation learning for skeleton-based action recognition. Existing methods mainly focus on applying global data augmentation to generate different views of the skeleton…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Yujie Zhou , Haodong Duan , Anyi Rao , Bing Su , Jiaqi Wang

This paper presents a novel spatiotemporal transformer network that introduces several original components to detect actions in untrimmed videos. First, the multi-feature selective semantic attention model calculates the correlations…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Matthew Korban , Peter Youngs , Scott T. Acton

We propose a new spatio-temporal attention based mechanism for human action recognition able to automatically attend to the hands most involved into the studied action and detect the most discriminative moments in an action. Attention is…

Computer Vision and Pattern Recognition · Computer Science 2017-12-22 Fabien Baradel , Christian Wolf , Julien Mille

Most of human actions consist of complex temporal compositions of more simple actions. Action recognition tasks usually relies on complex handcrafted structures as features to represent the human action model. Convolutional Neural Nets…

Computer Vision and Pattern Recognition · Computer Science 2015-12-15 Mahdyar Ravanbakhsh , Hossein Mousavi , Mohammad Rastegari , Vittorio Murino , Larry S. Davis

Visual attention has been successfully applied in structural prediction tasks such as visual captioning and question answering. Existing visual attention models are generally spatial, i.e., the attention is modeled as spatial probabilities…

Computer Vision and Pattern Recognition · Computer Science 2017-04-13 Long Chen , Hanwang Zhang , Jun Xiao , Liqiang Nie , Jian Shao , Wei Liu , Tat-Seng Chua