English
Related papers

Related papers: Pose-conditioned Spatio-Temporal Attention for Hum…

200 papers

Skeleton-based action recognition is an important task that requires the adequate understanding of movement characteristics of a human action from the given skeleton sequence. Recent studies have shown that exploring spatial and temporal…

Computer Vision and Pattern Recognition · Computer Science 2019-04-01 Chenyang Si , Wentao Chen , Wei Wang , Liang Wang , Tieniu Tan

Understanding accurate information on human behaviours is one of the most important tasks in machine intelligence. Human Activity Recognition that aims to understand human activities from a video is a challenging task due to various…

Computer Vision and Pattern Recognition · Computer Science 2021-06-25 Ivaxi Sheth

Face analysis has been studied from different angles to infer emotion, poses, shapes, and landmarks. Traditionally RGB cameras are used, yet for fine-grained tasks standard sensors might not be up to the task due to their latency, making it…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Luca Cultrera , Federico Becattini , Lorenzo Berlincioni , Claudio Ferrari , Alberto Del Bimbo

We present a self-supervised approach using spatio-temporal signals between video frames for action recognition. A two-stream architecture is leveraged to tangle spatial and temporal representation learning. Our task is formulated as both a…

Computer Vision and Pattern Recognition · Computer Science 2018-06-20 Ahmed Taha , Moustafa Meshry , Xitong Yang , Yi-Ting Chen , Larry Davis

We propose Human Pose Models that represent RGB and depth images of human poses independent of clothing textures, backgrounds, lighting conditions, body shapes and camera viewpoints. Learning such universal models requires training images…

Computer Vision and Pattern Recognition · Computer Science 2018-05-02 Jian Liu , Naveed Akhtar , Ajmal Mian

Existing multimodal-based human action recognition approaches are computationally intensive, limiting their deployment in real-time applications. In this work, we present a novel and efficient pose-driven attention-guided multimodal network…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Ahmed Abdelkawy , Asem Ali , Aly Farag

Despite the notable progress made in action recognition tasks, not much work has been done in action recognition specifically for human-robot interaction. In this paper, we deeply explore the characteristics of the action recognition task…

Computer Vision and Pattern Recognition · Computer Science 2020-07-03 Ziyang Song , Ziyi Yin , Zejian Yuan , Chong Zhang , Wanchao Chi , Yonggen Ling , Shenghao Zhang

This paper proposes a simple yet effective method for human action recognition in video. The proposed method separately extracts local appearance and motion features using state-of-the-art three-dimensional convolutional neural networks…

Computer Vision and Pattern Recognition · Computer Science 2020-02-24 David Torpey , Turgay Celik

Human action Recognition for unknown views is a challenging task. We propose a view-invariant deep human action recognition framework, which is a novel integration of two important action cues: motion and shape temporal dynamics (STD). The…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Chhavi Dhiman , Dinesh Kumar Vishwakarma

Human action recognition is one of the challenging tasks in computer vision. The current action recognition methods use computationally expensive models for learning spatio-temporal dependencies of the action. Models utilizing RGB channels…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Labina Shrestha , Shikha Dubey , Farrukh Olimov , Muhammad Aasim Rafique , Moongu Jeon

Vision-based human activity recognition has emerged as one of the essential research areas in video analytics domain. Over the last decade, numerous advanced deep learning algorithms have been introduced to recognize complex human actions…

Computer Vision and Pattern Recognition · Computer Science 2022-08-11 Hayat Ullah , Arslan Munir

This study presents a novel method to recognize human physical activities using CNN followed by LSTM. Achieving high accuracy by traditional machine learning algorithms, (such as SVM, KNN and random forest method) is a challenging task…

Signal Processing · Electrical Eng. & Systems 2020-03-16 Waqar Ahmad , Misbah Kazmi , Hazrat Ali

In this paper, we newly introduce the concept of temporal attention filters, and describe how they can be used for human activity recognition from videos. Many high-level activities are often composed of multiple temporal parts (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2016-12-28 AJ Piergiovanni , Chenyou Fan , Michael S. Ryoo

We propose a soft attention based model for the task of action recognition in videos. We use multi-layered Recurrent Neural Networks (RNNs) with Long Short-Term Memory (LSTM) units which are deep both spatially and temporally. Our model…

Machine Learning · Computer Science 2016-02-16 Shikhar Sharma , Ryan Kiros , Ruslan Salakhutdinov

Several video-based 3D pose and shape estimation algorithms have been proposed to resolve the temporal inconsistency of single-image-based methods. However it still remains challenging to have stable and accurate reconstruction. In this…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Ziwen Li , Bo Xu , Han Huang , Cheng Lu , Yandong Guo

We propose a method for human activity recognition from RGB data that does not rely on any pose information during test time and does not explicitly calculate pose information internally. Instead, a visual attention module learns to predict…

Computer Vision and Pattern Recognition · Computer Science 2018-08-22 Fabien Baradel , Christian Wolf , Julien Mille , Graham W. Taylor

This paper presents the ARN-LSTM architecture, a novel multi-stream action recognition model designed to address the challenge of simultaneously capturing spatial motion and temporal dynamics in action sequences. Traditional methods often…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Chuanchuan Wang , Ahmad Sufril Azlan Mohmamed , Mohd Halim Bin Mohd Noor , Xiao Yang , Feifan Yi , Xiang Li

This paper proposes a two-stream flow-guided convolutional attention networks for action recognition in videos. The central idea is that optical flows, when properly compensated for the camera motion, can be used to guide attention to the…

Computer Vision and Pattern Recognition · Computer Science 2017-08-31 An Tran , Loong-Fah Cheong

This paper presents a novel multimodal human activity recognition system. It uses a two-stream decision level fusion of vision and inertial sensors. In the first stream, raw RGB frames are passed to a part affinity field-based pose…

Computer Vision and Pattern Recognition · Computer Science 2023-06-29 Santosh Kumar Yadav , Muhtashim Rafiqi , Egna Praneeth Gummana , Kamlesh Tiwari , Hari Mohan Pandey , Shaik Ali Akbara

The recognition of human actions in videos is one of the most active research fields in computer vision. The canonical approach consists in a more or less complex preprocessing stages of the raw video data, followed by a relatively simple…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Enrico Picco , Piotr Antonik , Serge Massar