English
Related papers

Related papers: Spatio-Temporal LSTM with Trust Gates for 3D Human…

200 papers

Using raw sensor data to model and train networks for Human Activity Recognition can be used in many different applications, from fitness tracking to safety monitoring applications. These models can be easily extended to be trained with…

Machine Learning · Computer Science 2019-05-03 Schalk Wilhelm Pienaar , Reza Malekian

In visual surveillance systems, it is necessary to recognize the behavior of people handling objects such as a phone, a cup, or a plastic bag. In this paper, to address this problem, we propose a new framework for recognizing object-related…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Sunoh Kim , Kimin Yun , Jongyoul Park , Jin Young Choi

We propose a new architecture for the learning of predictive spatio-temporal motion models from data alone. Our approach, dubbed the Dropout Autoencoder LSTM, is capable of synthesizing natural looking motion sequences over long time…

Computer Vision and Pattern Recognition · Computer Science 2017-12-05 Partha Ghosh , Jie Song , Emre Aksan , Otmar Hilliges

There is significant progress in recognizing traditional human activities from videos focusing on highly distinctive actions involving discriminative body movements, body-object and/or human-human interactions. Driver's activities are…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Zachary Wharton , Ardhendu Behera , Yonghuai Liu , Nik Bessis

We propose a method for human action recognition, one that can localize the spatiotemporal regions that `define' the actions. This is a challenging task due to the subtlety of human actions in video and the co-occurrence of contextual…

Computer Vision and Pattern Recognition · Computer Science 2019-04-12 Yang Wang , Vinh Tran , Gedas Bertasius , Lorenzo Torresani , Minh Hoai

Spatio-temporal action recognition has been a challenging task that involves detecting where and when actions occur. Current state-of-the-art action detectors are mostly anchor-based, requiring sensitive anchor designs and huge computations…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Shentong Mo , Jingfei Xia , Xiaoqing Tan , Bhiksha Raj

Large Language Models (LLMs) hold rich implicit knowledge and powerful transferability. In this paper, we explore the combination of LLMs with the human skeleton to perform action classification and description. However, when treating LLM…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Qilang Ye , Yu Zhou , Lian He , Jie Zhang , Xuanming Guo , Jiayu Zhang , Mingkui Tan , Weicheng Xie , Yue Sun , Tao Tan , Xiaochen Yuan , Ghada Khoriba , Zitong Yu

In vision-based action recognition, spatio-temporal features from different modalities are used for recognizing activities. Temporal modeling is a long challenge of action recognition. However, there are limited methods such as pre-computed…

Computer Vision and Pattern Recognition · Computer Science 2023-02-06 Elham Shabaninia , Hossein Nezamabadi-pour , Fatemeh Shafizadegan

This paper propose a novel dictionary learning approach to detect event action using skeletal information extracted from RGBD video. The event action is represented as several latent atoms and composed of latent spatial and temporal…

Computer Vision and Pattern Recognition · Computer Science 2021-10-04 Hao Xing , Yuxuan Xue , Mingchuan Zhou , Darius Burschka

Accurate prediction of human behavior is crucial for AI systems to effectively support real-world applications, such as autonomous robots anticipating and assisting with human tasks. Real-world scenarios frequently present challenges such…

Human-Computer Interaction · Computer Science 2025-07-21 Kojiro Takeyama , Yimeng Liu , Misha Sra

Real-time 3D human action recognition has broad industrial applications, such as surveillance, human-computer interaction, and healthcare monitoring. By relying on complex spatio-temporal local encoding, most existing point cloud sequence…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Xing Li , Qian Huang , Zhijian Wang , Zhenjie Hou , Tianjin Yang , Zhuang Miao

Understanding human actions in visual data is tied to advances in complementary research areas including object recognition, human dynamics, domain adaptation and semantic segmentation. Over the last decade, human action analysis evolved…

Computer Vision and Pattern Recognition · Computer Science 2017-02-02 Samitha Herath , Mehrtash Harandi , Fatih Porikli

3D skeleton-based action recognition and motion prediction are two essential problems of human activity understanding. In many previous works: 1) they studied two tasks separately, neglecting internal correlations; 2) they did not capture…

Computer Vision and Pattern Recognition · Computer Science 2019-10-08 Maosen Li , Siheng Chen , Xu Chen , Ya Zhang , Yanfeng Wang , Qi Tian

Skeleton-based human action recognition has attracted great interest thanks to the easy accessibility of the human skeleton data. Recently, there is a trend of using very deep feedforward neural networks to model the 3D coordinates of…

Computer Vision and Pattern Recognition · Computer Science 2020-04-20 Pengfei Zhang , Cuiling Lan , Wenjun Zeng , Junliang Xing , Jianru Xue , Nanning Zheng

This paper proposes a new 3D Human Action Recognition system as a two-phase system: (1) Deep Metric Learning Module which learns a similarity metric between two 3D joint sequences using Siamese-LSTM networks; (2) A Multiclass Classification…

Computer Vision and Pattern Recognition · Computer Science 2020-04-27 Seyma Yucer , Yusuf Sinan Akgul

Self-supervised learning (SSL), which aims to learn meaningful prior representations from unlabeled data, has been proven effective for skeleton-based action understanding. Different from the image domain, skeleton data possesses sparser…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Jiahang Zhang , Lilang Lin , Shuai Yang , Jiaying Liu

Human action recognition is an important problem in computer vision. It has a wide range of applications in surveillance, human-computer interaction, augmented reality, video indexing, and retrieval. The varying pattern of spatio-temporal…

Computer Vision and Pattern Recognition · Computer Science 2020-09-03 Yogesh S Rawat , Shruti Vyas

Skeleton-aware sign language recognition (SLR) has gained popularity due to its ability to remain unaffected by background information and its lower computational requirements. Current methods utilize spatial graph modules and temporal…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Lianyu Hu , Liqing Gao , Zekang Liu , Wei Feng

The drastic variation of motion in spatial and temporal dimensions makes the video prediction task extremely challenging. Existing RNN models obtain higher performance by deepening or widening the model. They obtain the multi-scale features…

Computer Vision and Pattern Recognition · Computer Science 2024-02-19 Zhifeng Ma , Hao Zhang , Jie Liu

In this paper, we investigate a weakly-supervised object detection framework. Most existing frameworks focus on using static images to learn object detectors. However, these detectors often fail to generalize to videos because of the…

Computer Vision and Pattern Recognition · Computer Science 2017-08-03 Yuan Yuan , Xiaodan Liang , Xiaolong Wang , Dit-Yan Yeung , Abhinav Gupta