English
Related papers

Related papers: Deep Analysis of CNN-based Spatio-temporal Represe…

200 papers

Learning the spatial-temporal representation of motion information is crucial to human action recognition. Nevertheless, most of the existing features or descriptors cannot capture motion information effectively, especially for long-term…

Computer Vision and Pattern Recognition · Computer Science 2017-02-13 Yemin Shi , Yonghong Tian , Yaowei Wang , Tiejun Huang

Dynamic imaging is a recently proposed action description paradigm for simultaneously capturing motion and temporal evolution information, particularly in the context of deep convolutional neural networks (CNNs). Compared with optical flow…

Computer Vision and Pattern Recognition · Computer Science 2018-12-31 Yang Xiao , Jun Chen , Yancheng Wang , Zhiguo Cao , Joey Tianyi Zhou , Xiang Bai

Human actions in video sequences are three-dimensional (3D) spatio-temporal signals characterizing both the visual appearance and motion dynamics of the involved humans and objects. Inspired by the success of convolutional neural networks…

Computer Vision and Pattern Recognition · Computer Science 2015-10-05 Lin Sun , Kui Jia , Dit-Yan Yeung , Bertram E. Shi

3D Convolutional Neural Network (3D CNN) captures spatial and temporal information on 3D data such as video sequences. However, due to the convolution and pooling mechanism, the information loss seems unavoidable. To improve the visual…

Computer Vision and Pattern Recognition · Computer Science 2022-08-17 Novanto Yudistira , Muthu Subash Kavitha , Takio Kurita

Classifying the behavior of humans or animals from videos is important in biomedical fields for understanding brain function and response to stimuli. Action recognition, classifying activities performed by one or more subjects in a trimmed…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Michael Perez , Corey Toler-Franklin

Human activity recognition is one of the most important tasks in computer vision and has proved useful in different fields such as healthcare, sports training and security. There are a number of approaches that have been explored to solve…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Sheryl Mathew , Annapoorani Subramanian , Pooja , Balamurugan MS , Manoj Kumar Rajagopal

Different from RGB videos, depth data in RGB-D videos provide key complementary information for tristimulus visual data which potentially could achieve accuracy improvement for action recognition. However, most of the existing action…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Haokui Zhang , Ying Li , Peng Wang , Yu Liu , Chunhua Shen

Video action recognition is one of the representative tasks for video understanding. Over the last decade, we have witnessed great advancements in video action recognition thanks to the emergence of deep learning. But we also encountered…

Computer Vision and Pattern Recognition · Computer Science 2020-12-14 Yi Zhu , Xinyu Li , Chunhui Liu , Mohammadreza Zolfaghari , Yuanjun Xiong , Chongruo Wu , Zhi Zhang , Joseph Tighe , R. Manmatha , Mu Li

Recognizing the actions of others from visual stimuli is a crucial aspect of human visual perception that allows individuals to respond to social cues. Humans are able to identify similar behaviors and discriminate between distinct actions…

Neurons and Cognition · Quantitative Biology 2018-02-07 Andrea Tacchetti , Leyla Isik , Tomaso Poggio

We propose a novel deep supervised neural network for the task of action recognition in videos, which implicitly takes advantage of visual tracking and shares the robustness of both deep Convolutional Neural Network (CNN) and Recurrent…

Computer Vision and Pattern Recognition · Computer Science 2016-07-12 Jialin Wu , Gu Wang , Wukui Yang , Xiangyang Ji

Human action recognition has become an important research focus in computer vision due to the wide range of applications where it is used. 3D Resnet-based CNN models, particularly MC3, R3D, and R(2+1)D, have different convolutional filters…

Computer Vision and Pattern Recognition · Computer Science 2026-01-19 Mohammad Rasras , Iuliana Marin , Serban Radu , Irina Mocanu

Fine-grained action recognition is a challenging task in computer vision. As fine-grained datasets have small inter-class variations in spatial and temporal space, fine-grained action recognition model requires good temporal reasoning and…

Computer Vision and Pattern Recognition · Computer Science 2022-08-04 Mei Chee Leong , Haosong Zhang , Hui Li Tan , Liyuan Li , Joo Hwee Lim

Convolutional Neural Networks with 3D kernels (3D-CNNs) currently achieve state-of-the-art results in video recognition tasks due to their supremacy in extracting spatiotemporal features within video frames. There have been many successful…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Okan Köpüklü , Stefan Hörmann , Fabian Herzog , Hakan Cevikalp , Gerhard Rigoll

Traditional action recognition models are constructed around the paradigm of 2D perspective imagery. Though sophisticated time-series models have pushed the field forward, much of the information is still not exploited by confining the…

Computer Vision and Pattern Recognition · Computer Science 2019-11-21 Michael Peven , Gregory D. Hager , Austin Reiter

Recently, three dimensional (3D) convolutional neural networks (CNNs) have emerged as dominant methods to capture spatiotemporal representations in videos, by adding to pre-existing 2D CNNs a third, temporal dimension. Such 3D CNNs,…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Gurkirt Singh , Fabio Cuzzolin

Action recognition is a prerequisite for many applications in laparoscopic video analysis including but not limited to surgical training, operation room planning, follow-up surgery preparation, post-operative surgical assessment, and…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Sahar Nasirihaghighi , Negin Ghamsarian , Daniela Stefanics , Klaus Schoeffmann , Heinrich Husslein

The purpose of this study is to determine whether current video datasets have sufficient data for training very deep convolutional neural networks (CNNs) with spatio-temporal three-dimensional (3D) kernels. Recently, the performance levels…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Kensho Hara , Hirokatsu Kataoka , Yutaka Satoh

Despite the success in still image recognition, deep neural networks for spatiotemporal signal tasks (such as human action recognition in videos) still suffers from low efficacy and inefficiency over the past years. Recently, human experts…

Computer Vision and Pattern Recognition · Computer Science 2020-04-13 Yizhou Zhou , Xiaoyan Sun , Chong Luo , Zheng-Jun Zha , Wenjun Zeng

Most of human actions consist of complex temporal compositions of more simple actions. Action recognition tasks usually relies on complex handcrafted structures as features to represent the human action model. Convolutional Neural Nets…

Computer Vision and Pattern Recognition · Computer Science 2015-12-15 Mahdyar Ravanbakhsh , Hossein Mousavi , Mohammad Rastegari , Vittorio Murino , Larry S. Davis

With the rapid development of digital multimedia, video understanding has become an important field. For action recognition, temporal dimension plays an important role, and this is quite different from image recognition. In order to learn…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 Qian Liu , Tao Wang , Jie Liu , Yang Guan , Qi Bu , Longfei Yang