English
Related papers

Related papers: Rethinking Spatiotemporal Feature Learning: Speed-…

200 papers

Motivated by the previous success of Two-Dimensional Convolutional Neural Network (2D CNN) on image recognition, researchers endeavor to leverage it to characterize videos. However, one limitation of applying 2D CNN to analyze videos is…

Computer Vision and Pattern Recognition · Computer Science 2020-07-16 Junwu Weng , Donghao Luo , Yabiao Wang , Ying Tai , Chengjie Wang , Jilin Li , Feiyue Huang , Xudong Jiang , Junsong Yuan

Convolutional Neural Networks (CNNs) have recently been shown to excel at performing visual place recognition under changing appearance and viewpoint. Previously, place recognition has been improved by intelligently selecting relevant…

Robotics · Computer Science 2018-10-31 Stephen Hausler , Adam Jacobson , Michael Milford

Video-based behavior recognition is essential in fields such as public safety, intelligent surveillance, and human-computer interaction. Traditional 3D Convolutional Neural Network (3D CNN) effectively capture local spatiotemporal features…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Xiuliang Zhang , Tadiwa Elisha Nyamasvisva , Chuntao Liu

Infrared (IR) imaging has the potential to enable more robust action recognition systems compared to visible spectrum cameras due to lower sensitivity to lighting conditions and appearance variability. While the action recognition task on…

Computer Vision and Pattern Recognition · Computer Science 2017-05-19 Zhuolin Jiang , Viktor Rozgic , Sancar Adali

The task of object segmentation in videos is usually accomplished by processing appearance and motion information separately using standard 2D convolutional networks, followed by a learned fusion of the two sources of information. On the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Sabarinath Mahadevan , Ali Athar , Aljoša Ošep , Sebastian Hennen , Laura Leal-Taixé , Bastian Leibe

Despite the success of deep learning for static image understanding, it remains unclear what are the most effective network architectures for the spatial-temporal modeling in videos. In this paper, in contrast to the existing CNN+RNN or…

Computer Vision and Pattern Recognition · Computer Science 2018-12-12 Dongliang He , Zhichao Zhou , Chuang Gan , Fu Li , Xiao Liu , Yandong Li , Limin Wang , Shilei Wen

Convolutional Neural Networks (CNN) have been regarded as a powerful class of models for visual recognition problems. Nevertheless, the convolutional filters in these networks are local operations while ignoring the large-range dependency.…

Computer Vision and Pattern Recognition · Computer Science 2019-06-14 Zhaofan Qiu , Ting Yao , Chong-Wah Ngo , Xinmei Tian , Tao Mei

Convolutional neural networks (CNNs) define the current state-of-the-art for image recognition. With their emerging popularity, especially for critical applications like medical image analysis or self-driving cars, confirmability is…

Computer Vision and Pattern Recognition · Computer Science 2018-01-08 Keyang Zhou , Bernhard Kainz

Various convolutional neural networks (CNNs) were developed recently that achieved accuracy comparable with that of human beings in computer vision tasks such as image recognition, object detection and tracking, etc. Most of these networks,…

Computer Vision and Pattern Recognition · Computer Science 2019-03-20 Tianchen Wang , Jinjun Xiong , Xiaowei Xu , Yiyu Shi

It remains a challenge to efficiently extract spatialtemporal information from skeleton sequences for 3D human action recognition. Although most recent action recognition methods are based on Recurrent Neural Networks which present…

Computer Vision and Pattern Recognition · Computer Science 2017-06-08 Hong Liu , Juanhui Tu , Mengyuan Liu

We propose a novel scheme for human action recognition in videos, using a 3-dimensional Convolutional Neural Network (3D CNN) based classifier. Traditionally in deep learning based human activity recognition approaches, either a few random…

Computer Vision and Pattern Recognition · Computer Science 2020-02-10 S. H. Shabbeer Basha , Viswanath Pulabaigari , Snehasis Mukherjee

Convolutional neural networks with spatio-temporal 3D kernels (3D CNNs) have an ability to directly extract spatio-temporal features from videos for action recognition. Although the 3D kernels tend to overfit because of a large number of…

Computer Vision and Pattern Recognition · Computer Science 2017-08-28 Kensho Hara , Hirokatsu Kataoka , Yutaka Satoh

This study introduces a method for efficiently detecting objects within 3D point clouds using convolutional neural networks (CNNs). Our approach adopts a unique feature-centric voting mechanism to construct convolutional layers that…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Tianyi Lyu , Dian Gu , Peiyuan Chen , Yaoting Jiang , Zhenhong Zhang , Huadong Pang , Li Zhou , Yiping Dong

Visual attributes in individual video frames, such as the presence of characteristic objects and scenes, offer substantial information for action recognition in videos. With individual 2D video frame as input, visual attributes extraction…

Computer Vision and Pattern Recognition · Computer Science 2018-05-09 Yunfeng Wang , Wengang Zhou , Qilin Zhang , Houqiang Li

A number of techniques for interpretability have been presented for deep learning in computer vision, typically with the goal of understanding what the networks have based their classification on. However, interpretability for deep video…

Computer Vision and Pattern Recognition · Computer Science 2020-07-13 Joonatan Mänttäri , Sofia Broomé , John Folkesson , Hedvig Kjellström

Spatio-temporal feature learning is of central importance for action recognition in videos. Existing deep neural network models either learn spatial and temporal features independently (C2D) or jointly with unconstrained parameters (C3D).…

Computer Vision and Pattern Recognition · Computer Science 2019-03-05 Chao Li , Qiaoyong Zhong , Di Xie , Shiliang Pu

Convolutional Neural Networks (CNNs) were recently shown to provide state-of-the-art results for object category viewpoint estimation. However different ways of formulating this problem have been proposed and the competing approaches have…

Computer Vision and Pattern Recognition · Computer Science 2016-09-14 Francisco Massa , Renaud Marlet , Mathieu Aubry

Convolutional Neural Networks with 3D kernels (3D-CNNs) currently achieve state-of-the-art results in video recognition tasks due to their supremacy in extracting spatiotemporal features within video frames. There have been many successful…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Okan Köpüklü , Stefan Hörmann , Fabian Herzog , Hakan Cevikalp , Gerhard Rigoll

The purpose of this study is to determine whether current video datasets have sufficient data for training very deep convolutional neural networks (CNNs) with spatio-temporal three-dimensional (3D) kernels. Recently, the performance levels…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Kensho Hara , Hirokatsu Kataoka , Yutaka Satoh

The modeling, computational cost, and accuracy of traditional Spatio-temporal networks are the three most concentrated research topics in video action recognition. The traditional 2D convolution has a low computational cost, but it cannot…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Zhaoqilin Yang , Gaoyun An