English
Related papers

Related papers: Motion Representation Using Residual Frames with 3…

200 papers

The traditional methods of action recognition are not specific for the operator, thus results are easy to be disturbed when other actions are operated in videos. The network based on mixed convolutional resnet and RPN is proposed in this…

Computer Vision and Pattern Recognition · Computer Science 2020-01-08 Mingjie Li , Youqian Feng , Zhonghai Yin , Cheng Zhou , Fanghao Dong , Yuan Lin , Yuhao Dong

Human action recognition in videos is a critical task with significant implications for numerous applications, including surveillance, sports analytics, and healthcare. The challenge lies in creating models that are both precise in their…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Yufei Xie

With the advent of 2-dimensional Convolution Neural Networks (2D CNNs), the face recognition accuracy has reached above 99%. However, face recognition is still a challenge in real world conditions. A video, instead of an image, as an input…

Computer Vision and Pattern Recognition · Computer Science 2021-02-03 Nayaneesh Kumar Mishra , Satish Kumar Singh

In this paper, we are interested in self-supervised learning the motion cues in videos using dynamic motion filters for a better motion representation to finally boost human action recognition in particular. Thus far, the vision community…

Computer Vision and Pattern Recognition · Computer Science 2019-04-26 Ali Diba , Vivek Sharma , Luc Van Gool , Rainer Stiefelhagen

The deep two-stream architecture exhibited excellent performance on video based action recognition. The most computationally expensive step in this approach comes from the calculation of optical flow which prevents it to be real-time. This…

Computer Vision and Pattern Recognition · Computer Science 2016-04-27 Bowen Zhang , Limin Wang , Zhe Wang , Yu Qiao , Hanli Wang

Extracting per-frame features using convolutional neural networks for real-time processing of video data is currently mainly performed on powerful GPU-accelerated workstations and compute clusters. However, there are many applications such…

Computer Vision and Pattern Recognition · Computer Science 2017-11-10 Lukas Cavigelli , Philippe Degen , Luca Benini

We investigate architectures of discriminatively trained deep Convolutional Networks (ConvNets) for action recognition in video. The challenge is to capture the complementary information on appearance from still frames and motion between…

Computer Vision and Pattern Recognition · Computer Science 2014-11-13 Karen Simonyan , Andrew Zisserman

Motion has shown to be useful for video understanding, where motion is typically represented by optical flow. However, computing flow from video frames is very time-consuming. Recent works directly leverage the motion vectors and residuals…

Computer Vision and Pattern Recognition · Computer Science 2019-05-09 Zheng Shou , Xudong Lin , Yannis Kalantidis , Laura Sevilla-Lara , Marcus Rohrbach , Shih-Fu Chang , Zhicheng Yan

Spatio-temporal representations in frame sequences play an important role in the task of action recognition. Previously, a method of using optical flow as a temporal information in combination with a set of RGB images that contain spatial…

Computer Vision and Pattern Recognition · Computer Science 2018-08-02 Myunggi Lee , Seungeui Lee , Sungjoon Son , Gyutae Park , Nojun Kwak

The recognition of actions from video sequences has many applications in health monitoring, assisted living, surveillance, and smart homes. Despite advances in sensing, in particular related to 3D video, the methodologies to process the…

Computer Vision and Pattern Recognition · Computer Science 2018-10-03 Rui Zhao , Haider Ali , Patrick van der Smagt

Deep neural networks have achieved remarkable success for video-based action recognition. However, most of existing approaches cannot be deployed in practice due to the high computational cost. To address this challenge, we propose a new…

Computer Vision and Pattern Recognition · Computer Science 2020-06-18 Kun Liu , Wu Liu , Huadong Ma , Mingkui Tan , Chuang Gan

Despite the steady progress in video analysis led by the adoption of convolutional neural networks (CNNs), the relative improvement has been less drastic as that in 2D static image classification. Three main challenges exist including…

Computer Vision and Pattern Recognition · Computer Science 2018-07-30 Saining Xie , Chen Sun , Jonathan Huang , Zhuowen Tu , Kevin Murphy

State-of-the-art methods for video action recognition commonly use an ensemble of two networks: the spatial stream, which takes RGB frames as input, and the temporal stream, which takes optical flow as input. In recent work, both of these…

Computer Vision and Pattern Recognition · Computer Science 2019-02-07 Jonathan C. Stroud , David A. Ross , Chen Sun , Jia Deng , Rahul Sukthankar

There has been huge progress on video action recognition in recent years. However, many works focus on tweaking existing 2D backbones due to the reliance of ImageNet pretraining, which restrains the models from achieving higher efficiency…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Zhe Wang , Xulei Yang

In this paper we discuss several forms of spatiotemporal convolutions for video analysis and study their effects on action recognition. Our motivation stems from the observation that 2D CNNs applied to individual frames of the video have…

Computer Vision and Pattern Recognition · Computer Science 2018-04-13 Du Tran , Heng Wang , Lorenzo Torresani , Jamie Ray , Yann LeCun , Manohar Paluri

The computer vision community is currently focusing on solving action recognition problems in real videos, which contain thousands of samples with many challenges. In this process, Deep Convolutional Neural Networks (D-CNNs) have played a…

Computer Vision and Pattern Recognition · Computer Science 2018-03-22 Huy-Hieu Pham , Louahdi Khoudour , Alain Crouzil , Pablo Zegers , Sergio A. Velastin

Analyzing videos of human actions involves understanding the temporal relationships among video frames. State-of-the-art action recognition approaches rely on traditional optical flow estimation methods to pre-compute motion information for…

Computer Vision and Pattern Recognition · Computer Science 2018-10-31 Yi Zhu , Zhenzhong Lan , Shawn Newsam , Alexander G. Hauptmann

In video super-resolution, the spatio-temporal coherence between, and among the frames must be exploited appropriately for accurate prediction of the high resolution frames. Although 2D convolutional neural networks (CNNs) are powerful in…

Computer Vision and Pattern Recognition · Computer Science 2019-06-21 Soo Ye Kim , Jeongyeon Lim , Taeyoung Na , Munchurl Kim

Deep convolutional neural networks (CNNs) have made impressive progress in many video recognition tasks such as video pose estimation and video object detection. However, CNN inference on video is computationally expensive due to processing…

Computer Vision and Pattern Recognition · Computer Science 2018-02-28 Bowen Pan , Wuwei Lin , Xiaolin Fang , Chaoqin Huang , Bolei Zhou , Cewu Lu

Training of Convolutional Neural Networks (CNNs) on long video sequences is computationally expensive due to the substantial memory requirements and the massive number of parameters that deep architectures demand. Early fusion of video…

Computer Vision and Pattern Recognition · Computer Science 2017-04-07 Jue Wang , Anoop Cherian , Fatih Porikli