English
Related papers

Related papers: Long-term Temporal Convolutions for Action Recogni…

200 papers

Most action recognition methods base on a) a late aggregation of frame level CNN features using average pooling, max pooling, or RNN, among others, or b) spatio-temporal aggregation via 3D convolutions. The first assume independence among…

Computer Vision and Pattern Recognition · Computer Science 2019-05-30 Swathikiran Sudhakaran , Sergio Escalera , Oswald Lanz

The work in this paper is driven by the question if spatio-temporal correlations are enough for 3D convolutional neural networks (CNN)? Most of the traditional 3D networks use local spatio-temporal features. We introduce a new block that…

Computer Vision and Pattern Recognition · Computer Science 2019-02-08 Ali Diba , Mohsen Fayyaz , Vivek Sharma , M. Mahdi Arzani , Rahman Yousefzadeh , Juergen Gall , Luc Van Gool

We investigate video classification via a two-stream convolutional neural network (CNN) design that directly ingests information extracted from compressed video bitstreams. Our approach begins with the observation that all modern video…

Computer Vision and Pattern Recognition · Computer Science 2017-12-21 Aaron Chadha , Alhabib Abbas , Yiannis Andreopoulos

Action recognition is currently one of the top-challenging research fields in computer vision. Convolutional Neural Networks (CNNs) have significantly boosted its performance but rely on fixed-size spatio-temporal windows of analysis,…

Computer Vision and Pattern Recognition · Computer Science 2020-08-27 Alejandro López-Cifuentes , Marcos Escudero-Viñolo , Jesús Bescós

Dynamic imaging is a recently proposed action description paradigm for simultaneously capturing motion and temporal evolution information, particularly in the context of deep convolutional neural networks (CNNs). Compared with optical flow…

Computer Vision and Pattern Recognition · Computer Science 2018-12-31 Yang Xiao , Jun Chen , Yancheng Wang , Zhiguo Cao , Joey Tianyi Zhou , Xiang Bai

Action recognition is a fundamental problem in computer vision with a lot of potential applications such as video surveillance, human computer interaction, and robot learning. Given pre-segmented videos, the task is to recognize actions…

Computer Vision and Pattern Recognition · Computer Science 2017-06-28 Ahsan Iqbal , Alexander Richard , Hilde Kuehne , Juergen Gall

We propose an approach to learn spatio-temporal features in videos from intermediate visual representations we call "percepts" using Gated-Recurrent-Unit Recurrent Networks (GRUs).Our method relies on percepts that are extracted from all…

Computer Vision and Pattern Recognition · Computer Science 2016-03-02 Nicolas Ballas , Li Yao , Chris Pal , Aaron Courville

Existing action localization approaches adopt shallow temporal convolutional networks (\ie, TCN) on 1D feature map extracted from video frames. In this paper, we empirically find that stacking more conventional temporal convolution layers…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Xin Li , Tianwei Lin , Xiao Liu , Chuang Gan , Wangmeng Zuo , Chao Li , Xiang Long , Dongliang He , Fu Li , Shilei Wen

Temporal cues in videos provide important information for recognizing actions accurately. However, temporal-discriminative features can hardly be extracted without using an annotated large-scale video action dataset for training. This paper…

Computer Vision and Pattern Recognition · Computer Science 2020-08-06 Jinpeng Wang , Yiqi Lin , Andy J. Ma , Pong C. Yuen

Violence and abnormal behavior detection research have known an increase of interest in recent years, due mainly to a rise in crimes in large cities worldwide. In this work, we propose a deep learning architecture for violence detection…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Abdarahmane Traoré , Moulay A. Akhloufi

Recent applications of Convolutional Neural Networks (ConvNets) for human action recognition in videos have proposed different solutions for incorporating the appearance and motion information. We study a number of ways of fusing ConvNet…

Computer Vision and Pattern Recognition · Computer Science 2016-09-27 Christoph Feichtenhofer , Axel Pinz , Andrew Zisserman

Video activity recognition by deep neural networks is impressive for many classes. However, it falls short of human performance, especially for challenging to discriminate activities. Humans differentiate these complex activities by…

Computer Vision and Pattern Recognition · Computer Science 2022-01-12 Joseph Chrol-Cannon , Andrew Gilbert , Ranko Lazic , Adithya Madhusoodanan , Frank Guerin

Spatiotemporal graph convolutional networks (STGCNs) have emerged as a desirable model for skeleton-based human action recognition. Despite achieving state-of-the-art performance, there is a limited understanding of the representations…

Image and Video Processing · Electrical Eng. & Systems 2023-12-14 Pratyusha Das , Sarath Shekkizhar , Antonio Ortega

Currently, video behavior recognition is one of the most foundational tasks of computer vision. The 2D neural networks of deep learning are built for recognizing pixel-level information such as images with RGB, RGB-D, or optical flow…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Zihan Wang , Yang Yang , Zhi Liu , Yifan Zheng

We present Long Short-term TRansformer (LSTR), a temporal modeling algorithm for online action detection, which employs a long- and short-term memory mechanism to model prolonged sequence data. It consists of an LSTR encoder that…

Computer Vision and Pattern Recognition · Computer Science 2021-12-23 Mingze Xu , Yuanjun Xiong , Hao Chen , Xinyu Li , Wei Xia , Zhuowen Tu , Stefano Soatto

Recently, attempts have been made to collect millions of videos to train CNN models for action recognition in videos. However, curating such large-scale video datasets requires immense human labor, and training CNNs on millions of videos…

Computer Vision and Pattern Recognition · Computer Science 2015-12-23 Shugao Ma , Sarah Adel Bargal , Jianming Zhang , Leonid Sigal , Stan Sclaroff

Learning image representations with ConvNets by pre-training on ImageNet has proven useful across many visual understanding tasks including object detection, semantic segmentation, and image captioning. Although any image representation can…

Computer Vision and Pattern Recognition · Computer Science 2017-08-18 Du Tran , Jamie Ray , Zheng Shou , Shih-Fu Chang , Manohar Paluri

We propose a simple, yet effective approach for spatiotemporal feature learning using deep 3-dimensional convolutional networks (3D ConvNets) trained on a large scale supervised video dataset. Our findings are three-fold: 1) 3D ConvNets are…

Computer Vision and Pattern Recognition · Computer Science 2015-10-08 Du Tran , Lubomir Bourdev , Rob Fergus , Lorenzo Torresani , Manohar Paluri

We propose a novel approach based on deep Convolutional Neural Networks (CNN) to recognize human actions in still images by predicting the future motion, and detecting the shape and location of the salient parts of the image. We make the…

Computer Vision and Pattern Recognition · Computer Science 2017-05-15 Marjaneh Safaei , Hassan Foroosh

In videos, the human's actions are of three-dimensional (3D) signals. These videos investigate the spatiotemporal knowledge of human behavior. The promising ability is investigated using 3D convolution neural networks (CNNs). The 3D CNNs…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Arslan Syed , Eman A. Aldhahri , Muhammad Munawar Iqbal , Abid Ali , Ammar Muthanna , Harun Jamil , Faisal Jamil