English
Related papers

Related papers: Interpretable 3D Human Action Analysis with Tempor…

200 papers

3D Convolutional Neural Network (3D CNN) captures spatial and temporal information on 3D data such as video sequences. However, due to the convolution and pooling mechanism, the information loss seems unavoidable. To improve the visual…

Computer Vision and Pattern Recognition · Computer Science 2022-08-17 Novanto Yudistira , Muthu Subash Kavitha , Takio Kurita

Spatiotemporal graph convolutional networks (STGCNs) have emerged as a desirable model for skeleton-based human action recognition. Despite achieving state-of-the-art performance, there is a limited understanding of the representations…

Image and Video Processing · Electrical Eng. & Systems 2023-12-14 Pratyusha Das , Sarath Shekkizhar , Antonio Ortega

Connectionist temporal classification (CTC) is a popular sequence prediction approach for automatic speech recognition that is typically used with models based on recurrent neural networks (RNNs). We explore whether deep convolutional…

Computation and Language · Computer Science 2018-02-16 Kalpesh Krishna , Liang Lu , Kevin Gimpel , Karen Livescu

Decoding human activity accurately from wearable sensors can aid in applications related to healthcare and context awareness. The present approaches in this domain use recurrent and/or convolutional models to capture the spatio-temporal…

Human-Computer Interaction · Computer Science 2020-12-21 Satya P. Singh , Aimé Lay-Ekuakille , Deepak Gangwar , Madan Kumar Sharma , Sukrit Gupta

Action recognition is a critical task for social robots to meaningfully engage with their environment. 3D human skeleton-based action recognition is an attractive research area in recent years. Although, the existing approaches are good at…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Hui Feng , Shanshan Wang , Shuzhi Sam Ge

In this paper, we propose to improve the traditional use of RNNs by employing a many to many model for video classification. We analyze the importance of modeling spatial layout and temporal encoding for daily living action recognition.…

Computer Vision and Pattern Recognition · Computer Science 2018-06-18 Srijan Das , Michal Koperski , Francois Bremond , Gianpiero Francesca

Spatio-temporal prediction plays an important role in many application areas especially in traffic domain. However, due to complicated spatio-temporal dependency and high non-linear dynamics in road networks, traffic prediction task is…

Machine Learning · Computer Science 2019-03-05 Bing Yu , Mengzhang Li , Jiyong Zhang , Zhanxing Zhu

3D skeleton-based motion prediction and activity recognition are two interwoven tasks in human behaviour analysis. In this work, we propose a motion context modeling methodology that provides a new way to combine the advantages of both…

Computer Vision and Pattern Recognition · Computer Science 2021-08-04 Dianhao Zhang , Ngo Anh Vien , Mien Van , Sean McLoone

Human actions recognition has attracted more and more people's attention. Many technology have been developed to express human action's features, such as image, skeleton-based, and channel state information(CSI). Among them, on account of…

Computer Vision and Pattern Recognition · Computer Science 2019-11-22 Liu Yafeng , Chen Tian , Liu Zhongyu , Zhang Lei , Hu Yanjun , Ding Enjie

Many time-series classification problems involve developing metrics that are invariant to temporal misalignment. In human activity analysis, temporal misalignment arises due to various reasons including differing initial phase, sensor…

Computer Vision and Pattern Recognition · Computer Science 2019-06-17 Suhas Lohit , Qiao Wang , Pavan Turaga

Graph convolutional networks (GCNs) are an effective skeleton-based human action recognition (HAR) technique. GCNs enable the specification of CNNs to a non-Euclidean frame that is more flexible. The previous GCN-based models still have a…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Faisal Mehmood , Xin Guo , Enqing Chen , Muhammad Azeem Akbar , Arif Ali Khan , Sami Ullah

Automatic surgical phase recognition is a challenging and crucial task with the potential to improve patient safety and become an integral part of intra-operative decision-support systems. In this paper, we propose, for the first time in…

Image and Video Processing · Electrical Eng. & Systems 2022-03-23 Tobias Czempiel , Magdalini Paschali , Matthias Keicher , Walter Simson , Hubertus Feussner , Seong Tae Kim , Nassir Navab

Despite the steady progress in video analysis led by the adoption of convolutional neural networks (CNNs), the relative improvement has been less drastic as that in 2D static image classification. Three main challenges exist including…

Computer Vision and Pattern Recognition · Computer Science 2018-07-30 Saining Xie , Chen Sun , Jonathan Huang , Zhuowen Tu , Kevin Murphy

Infrared (IR) imaging has the potential to enable more robust action recognition systems compared to visible spectrum cameras due to lower sensitivity to lighting conditions and appearance variability. While the action recognition task on…

Computer Vision and Pattern Recognition · Computer Science 2017-05-19 Zhuolin Jiang , Viktor Rozgic , Sancar Adali

Skeleton-based action recognition is an important task that requires the adequate understanding of movement characteristics of a human action from the given skeleton sequence. Recent studies have shown that exploring spatial and temporal…

Computer Vision and Pattern Recognition · Computer Science 2019-04-01 Chenyang Si , Wentao Chen , Wei Wang , Liang Wang , Tieniu Tan

Research in human action recognition has accelerated significantly since the introduction of powerful machine learning tools such as Convolutional Neural Networks (CNNs). However, effective and efficient methods for incorporation of…

Computer Vision and Pattern Recognition · Computer Science 2018-03-21 Jinliang Zang , Le Wang , Ziyi Liu , Qilin Zhang , Zhenxing Niu , Gang Hua , Nanning Zheng

Classifying the behavior of humans or animals from videos is important in biomedical fields for understanding brain function and response to stimuli. Action recognition, classifying activities performed by one or more subjects in a trimmed…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Michael Perez , Corey Toler-Franklin

Generating long-range skeleton-based human actions has been a challenging problem since small deviations of one frame can cause a malformed action sequence. Most existing methods borrow ideas from video generation, which naively treat…

Graphics · Computer Science 2020-08-18 Ping Yu , Yang Zhao , Chunyuan Li , Junsong Yuan , Changyou Chen

Deep learning has achieved substantial improvement on single-channel speech enhancement tasks. However, the performance of multi-layer perceptions (MLPs)-based methods is limited by the ability to capture the long-term effective history…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-19 Qiquan Zhang , Aaron Nicolson , Mingjiang Wang , Kuldip K. Paliwal , Chenxu Wang

The work in this paper is driven by the question if spatio-temporal correlations are enough for 3D convolutional neural networks (CNN)? Most of the traditional 3D networks use local spatio-temporal features. We introduce a new block that…

Computer Vision and Pattern Recognition · Computer Science 2019-02-08 Ali Diba , Mohsen Fayyaz , Vivek Sharma , M. Mahdi Arzani , Rahman Yousefzadeh , Juergen Gall , Luc Van Gool