English
Related papers

Related papers: Spatio-Temporal FAST 3D Convolutions for Human Act…

200 papers

We propose a novel scheme for human action recognition in videos, using a 3-dimensional Convolutional Neural Network (3D CNN) based classifier. Traditionally in deep learning based human activity recognition approaches, either a few random…

Computer Vision and Pattern Recognition · Computer Science 2020-02-10 S. H. Shabbeer Basha , Viswanath Pulabaigari , Snehasis Mukherjee

Recently, three dimensional (3D) convolutional neural networks (CNNs) have emerged as dominant methods to capture spatiotemporal representations in videos, by adding to pre-existing 2D CNNs a third, temporal dimension. Such 3D CNNs,…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Gurkirt Singh , Fabio Cuzzolin

Human action recognition has become an important research focus in computer vision due to the wide range of applications where it is used. 3D Resnet-based CNN models, particularly MC3, R3D, and R(2+1)D, have different convolutional filters…

Computer Vision and Pattern Recognition · Computer Science 2026-01-19 Mohammad Rasras , Iuliana Marin , Serban Radu , Irina Mocanu

We address the problem of temporal activity detection in continuous, untrimmed video streams. This is a difficult task that requires extracting meaningful spatio-temporal features to capture activities, accurately localizing the start and…

Computer Vision and Pattern Recognition · Computer Science 2019-06-07 Huijuan Xu , Abir Das , Kate Saenko

Convolutional Neural Networks with 3D kernels (3D-CNNs) currently achieve state-of-the-art results in video recognition tasks due to their supremacy in extracting spatiotemporal features within video frames. There have been many successful…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Okan Köpüklü , Stefan Hörmann , Fabian Herzog , Hakan Cevikalp , Gerhard Rigoll

Human action recognition is one of the challenging tasks in computer vision. The current action recognition methods use computationally expensive models for learning spatio-temporal dependencies of the action. Models utilizing RGB channels…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Labina Shrestha , Shikha Dubey , Farrukh Olimov , Muhammad Aasim Rafique , Moongu Jeon

Dynamic imaging is a recently proposed action description paradigm for simultaneously capturing motion and temporal evolution information, particularly in the context of deep convolutional neural networks (CNNs). Compared with optical flow…

Computer Vision and Pattern Recognition · Computer Science 2018-12-31 Yang Xiao , Jun Chen , Yancheng Wang , Zhiguo Cao , Joey Tianyi Zhou , Xiang Bai

Convolutional Neural Network (CNN) based image segmentation has made great progress in recent years. However, video object segmentation remains a challenging task due to its high computational complexity. Most of the previous methods employ…

Computer Vision and Pattern Recognition · Computer Science 2019-07-23 Rui Hou , Chen Chen , Rahul Sukthankar , Mubarak Shah

3D Convolutional Neural Network (3D CNN) captures spatial and temporal information on 3D data such as video sequences. However, due to the convolution and pooling mechanism, the information loss seems unavoidable. To improve the visual…

Computer Vision and Pattern Recognition · Computer Science 2022-08-17 Novanto Yudistira , Muthu Subash Kavitha , Takio Kurita

Deep convolutional networks have achieved great success for visual recognition in still images. However, for action recognition in videos, the advantage over traditional methods is not so evident. This paper aims to discover the principles…

Computer Vision and Pattern Recognition · Computer Science 2016-08-03 Limin Wang , Yuanjun Xiong , Zhe Wang , Yu Qiao , Dahua Lin , Xiaoou Tang , Luc Van Gool

We investigate architectures of discriminatively trained deep Convolutional Networks (ConvNets) for action recognition in video. The challenge is to capture the complementary information on appearance from still frames and motion between…

Computer Vision and Pattern Recognition · Computer Science 2014-11-13 Karen Simonyan , Andrew Zisserman

The ability to identify and temporally segment fine-grained human actions throughout a video is crucial for robotics, surveillance, education, and beyond. Typical approaches decouple this problem by first extracting local spatiotemporal…

Computer Vision and Pattern Recognition · Computer Science 2016-11-17 Colin Lea , Michael D. Flynn , Rene Vidal , Austin Reiter , Gregory D. Hager

Spatiotemporal and motion features are two complementary and crucial information for video action recognition. Recent state-of-the-art methods adopt a 3D CNN stream to learn spatiotemporal features and another flow stream to learn motion…

Computer Vision and Pattern Recognition · Computer Science 2019-08-19 Boyuan Jiang , Mengmeng Wang , Weihao Gan , Wei Wu , Junjie Yan

Motivated by the success of data-driven convolutional neural networks (CNNs) in object recognition on static images, researchers are working hard towards developing CNN equivalents for learning video features. However, learning video…

Computer Vision and Pattern Recognition · Computer Science 2015-05-19 Zhenzhong Lan , Dezhong Yao , Ming Lin , Shoou-I Yu , Alexander Hauptmann

Consider a set of n images of a scene with dynamic objects captured with a static or a handheld camera. Let the temporal order in which these images are captured be unknown. There can be n! possibilities for the temporal order in which…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 Gagan Kanojia , Shanmuganathan Raman

Despite receiving significant attention from the research community, the task of segmenting and tracking objects in monocular videos still has much room for improvement. Existing works have simultaneously justified the efficacy of dilated…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 Christian Schmidt , Ali Athar , Sabarinath Mahadevan , Bastian Leibe

Convolutional neural networks with spatio-temporal 3D kernels (3D CNNs) have an ability to directly extract spatio-temporal features from videos for action recognition. Although the 3D kernels tend to overfit because of a large number of…

Computer Vision and Pattern Recognition · Computer Science 2017-08-28 Kensho Hara , Hirokatsu Kataoka , Yutaka Satoh

Video-based behavior recognition is essential in fields such as public safety, intelligent surveillance, and human-computer interaction. Traditional 3D Convolutional Neural Network (3D CNN) effectively capture local spatiotemporal features…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Xiuliang Zhang , Tadiwa Elisha Nyamasvisva , Chuntao Liu

Image pre-training, the current de-facto paradigm for a wide range of visual tasks, is generally less favored in the field of video recognition. By contrast, a common strategy is to directly train with spatiotemporal convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2022-08-03 Xianhang Li , Huiyu Wang , Chen Wei , Jieru Mei , Alan Yuille , Yuyin Zhou , Cihang Xie

Convolutional Neural Networks (ConvNets) have recently shown promising performance in many computer vision tasks, especially image-based recognition. How to effectively apply ConvNets to sequence-based data is still an open problem. This…

Computer Vision and Pattern Recognition · Computer Science 2017-01-02 Pichao Wang , Wanqing Li , Chuankun Li , Yonghong Hou