English
Related papers

Related papers: Action Recognition with Multi-stream Motion Modeli…

200 papers

Among the existing modalities for 3D action recognition, 3D flow has been poorly examined, although conveying rich motion information cues for human actions. Presumably, its susceptibility to noise renders it intractable, thus challenging…

Computer Vision and Pattern Recognition · Computer Science 2023-06-26 Vasileios Magoulianitis , Athanasios Psaltis

Human action recognition remains an important yet challenging task. This work proposes a novel action recognition system. It uses a novel Multiple View Region Adaptive Multi-resolution in time Depth Motion Map (MV-RAMDMM) formulation…

Computer Vision and Pattern Recognition · Computer Science 2019-04-15 Mahmoud Al-Faris , John P. Chiverton , Yanyan Yang , David L. Ndzi

In this paper, we propose a convolutional layer inspired by optical flow algorithms to learn motion representations. Our representation flow layer is a fully-differentiable layer designed to capture the `flow' of any representation channel…

Computer Vision and Pattern Recognition · Computer Science 2019-08-05 AJ Piergiovanni , Michael S. Ryoo

The traditional methods of action recognition are not specific for the operator, thus results are easy to be disturbed when other actions are operated in videos. The network based on mixed convolutional resnet and RPN is proposed in this…

Computer Vision and Pattern Recognition · Computer Science 2020-01-08 Mingjie Li , Youqian Feng , Zhonghai Yin , Cheng Zhou , Fanghao Dong , Yuan Lin , Yuhao Dong

This paper is a brief report to our submission to the VIPriors Action Recognition Challenge. Action recognition has attracted many researchers attention for its full application, but it is still challenging. In this paper, we study previous…

Computer Vision and Pattern Recognition · Computer Science 2020-07-17 Zhipeng Luo , Dawei Xu , Zhiguang Zhang

We investigate architectures of discriminatively trained deep Convolutional Networks (ConvNets) for action recognition in video. The challenge is to capture the complementary information on appearance from still frames and motion between…

Computer Vision and Pattern Recognition · Computer Science 2014-11-13 Karen Simonyan , Andrew Zisserman

State-of-the-art methods for video action recognition commonly use an ensemble of two networks: the spatial stream, which takes RGB frames as input, and the temporal stream, which takes optical flow as input. In recent work, both of these…

Computer Vision and Pattern Recognition · Computer Science 2019-02-07 Jonathan C. Stroud , David A. Ross , Chen Sun , Jia Deng , Rahul Sukthankar

Online action recognition is an important task for human centered intelligent services, which is still difficult to achieve due to the varieties and uncertainties of spatial and temporal scales of human actions. In this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2020-11-04 Guoliang Liu , Qinghui Zhang , Yichao Cao , Junwei Li , Hao Wu , Guohui Tian

Analyzing videos of human actions involves understanding the temporal relationships among video frames. State-of-the-art action recognition approaches rely on traditional optical flow estimation methods to pre-compute motion information for…

Computer Vision and Pattern Recognition · Computer Science 2018-10-31 Yi Zhu , Zhenzhong Lan , Shawn Newsam , Alexander G. Hauptmann

Infrared (IR) imaging has the potential to enable more robust action recognition systems compared to visible spectrum cameras due to lower sensitivity to lighting conditions and appearance variability. While the action recognition task on…

Computer Vision and Pattern Recognition · Computer Science 2017-05-19 Zhuolin Jiang , Viktor Rozgic , Sancar Adali

This paper addresses the problem of real-time action recognition in trimmed videos, for which deep neural networks have defined the state-of-the-art performance in the recent literature. For attaining higher recognition accuracies with…

Computer Vision and Pattern Recognition · Computer Science 2018-10-30 Marian K. Y. Boktor , Ahmad Al-Kabbany , Radwa Khalil , Said El-Khamy

Human action recognition in video is an active yet challenging research topic due to high variation and complexity of data. In this paper, a novel video based action recognition framework utilizing complementary cues is proposed to handle…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Muhammad Usman Khalid , Jie Yu

In recent years, a number of approaches based on 2D or 3D convolutional neural networks (CNN) have emerged for video action recognition, achieving state-of-the-art results on several large-scale benchmark datasets. In this paper, we carry…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Chun-Fu Chen , Rameswar Panda , Kandan Ramakrishnan , Rogerio Feris , John Cohn , Aude Oliva , Quanfu Fan

This paper presents the ARN-LSTM architecture, a novel multi-stream action recognition model designed to address the challenge of simultaneously capturing spatial motion and temporal dynamics in action sequences. Traditional methods often…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Chuanchuan Wang , Ahmad Sufril Azlan Mohmamed , Mohd Halim Bin Mohd Noor , Xiao Yang , Feifan Yi , Xiang Li

The deep two-stream architecture exhibited excellent performance on video based action recognition. The most computationally expensive step in this approach comes from the calculation of optical flow which prevents it to be real-time. This…

Computer Vision and Pattern Recognition · Computer Science 2016-04-27 Bowen Zhang , Limin Wang , Zhe Wang , Yu Qiao , Hanli Wang

Action recognition is an open and challenging problem in computer vision. While current state-of-the-art models offer excellent recognition results, their computational expense limits their impact for many real-world applications. In this…

Computer Vision and Pattern Recognition · Computer Science 2020-08-03 Yue Meng , Chung-Ching Lin , Rameswar Panda , Prasanna Sattigeri , Leonid Karlinsky , Aude Oliva , Kate Saenko , Rogerio Feris

The goal of this paper is to detect the spatio-temporal extent of an action. The two-stream detection network based on RGB and flow provides state-of-the-art accuracy at the expense of a large model-size and heavy computation. We propose to…

Computer Vision and Pattern Recognition · Computer Science 2019-06-12 Jiaojiao Zhao , Cees G. M. Snoek

Motion is a salient cue to recognize actions in video. Modern action recognition models leverage motion information either explicitly by using optical flow as input or implicitly by means of 3D convolutional filters that simultaneously…

Computer Vision and Pattern Recognition · Computer Science 2020-05-28 Heng Wang , Du Tran , Lorenzo Torresani , Matt Feiszli

In this work, we present a novel approach to multi-view action recognition where we guide learned action representations to be separated from view-relevant information in a video. When trying to classify action instances captured from…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Nyle Siddiqui , Praveen Tirupattur , Mubarak Shah

This thesis focuses on video understanding for human action and interaction recognition. We start by identifying the main challenges related to action recognition from videos and review how they have been addressed by current methods. Based…

Computer Vision and Pattern Recognition · Computer Science 2021-10-06 Alexandros Stergiou