English
Related papers

Related papers: Class Feature Pyramids for Video Explanation

200 papers

We propose an approach to learn spatio-temporal features in videos from intermediate visual representations we call "percepts" using Gated-Recurrent-Unit Recurrent Networks (GRUs).Our method relies on percepts that are extracted from all…

Computer Vision and Pattern Recognition · Computer Science 2016-03-02 Nicolas Ballas , Li Yao , Chris Pal , Aaron Courville

Deep convolutional neutral networks have achieved great success on image recognition tasks. Yet, it is non-trivial to transfer the state-of-the-art image recognition networks to videos as per-frame evaluation is too slow and unaffordable.…

Computer Vision and Pattern Recognition · Computer Science 2017-06-06 Xizhou Zhu , Yuwen Xiong , Jifeng Dai , Lu Yuan , Yichen Wei

Convolutional Neural Network (CNN) based image segmentation has made great progress in recent years. However, video object segmentation remains a challenging task due to its high computational complexity. Most of the previous methods employ…

Computer Vision and Pattern Recognition · Computer Science 2019-07-23 Rui Hou , Chen Chen , Rahul Sukthankar , Mubarak Shah

Deep convolutional neural networks (DCNNs) have shown remarkable performance in image classification tasks in recent years. Generally, deep neural network architectures are stacks consisting of a large number of convolutional layers, and…

Computer Vision and Pattern Recognition · Computer Science 2017-09-07 Dongyoon Han , Jiwhan Kim , Junmo Kim

This work introduces pyramidal convolution (PyConv), which is capable of processing the input at multiple filter scales. PyConv contains a pyramid of kernels, where each level involves different types of filters with varying size and depth,…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Ionut Cosmin Duta , Li Liu , Fan Zhu , Ling Shao

Motivated by the previous success of Two-Dimensional Convolutional Neural Network (2D CNN) on image recognition, researchers endeavor to leverage it to characterize videos. However, one limitation of applying 2D CNN to analyze videos is…

Computer Vision and Pattern Recognition · Computer Science 2020-07-16 Junwu Weng , Donghao Luo , Yabiao Wang , Ying Tai , Chengjie Wang , Jilin Li , Feiyue Huang , Xudong Jiang , Junsong Yuan

We propose a novel video object segmentation algorithm based on pixel-level matching using Convolutional Neural Networks (CNN). Our network aims to distinguish the target area from the background on the basis of the pixel-level similarity…

Computer Vision and Pattern Recognition · Computer Science 2017-08-18 Jae Shin Yoon , Francois Rameau , Junsik Kim , Seokju Lee , Seunghak Shin , In So Kweon

3D convolution is powerful for video classification but often computationally expensive, recent studies mainly focus on decomposing it on spatial-temporal and/or channel dimensions. Unfortunately, most approaches fail to achieve a…

Computer Vision and Pattern Recognition · Computer Science 2021-06-04 Kunchang Li , Xianhang Li , Yali Wang , Jun Wang , Yu Qiao

Group convolution has been shown to offer great computational savings in various 2D convolutional architectures for image classification. It is natural to ask: 1) if group convolution can help to alleviate the high computational cost of…

Computer Vision and Pattern Recognition · Computer Science 2019-11-20 Du Tran , Heng Wang , Lorenzo Torresani , Matt Feiszli

We introduce Continual 3D Convolutional Neural Networks (Co3D CNNs), a new computational formulation of spatio-temporal 3D CNNs, in which videos are processed frame-by-frame rather than by clip. In online tasks demanding frame-wise…

Computer Vision and Pattern Recognition · Computer Science 2023-01-25 Lukas Hedegaard , Alexandros Iosifidis

Recently, convolutional neural networks with 3D kernels (3D CNNs) have been very popular in computer vision community as a result of their superior ability of extracting spatio-temporal features within video frames compared to 2D CNNs.…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Okan Köpüklü , Neslihan Kose , Ahmet Gunduz , Gerhard Rigoll

Spatio-temporal feature learning is of central importance for action recognition in videos. Existing deep neural network models either learn spatial and temporal features independently (C2D) or jointly with unconstrained parameters (C3D).…

Computer Vision and Pattern Recognition · Computer Science 2019-03-05 Chao Li , Qiaoyong Zhong , Di Xie , Shiliang Pu

Deep neural networks have achieved great success for video analysis and understanding. However, designing a high-performance neural architecture requires substantial efforts and expertise. In this paper, we make the first attempt to let…

Computer Vision and Pattern Recognition · Computer Science 2019-07-11 Wei Peng , Xiaopeng Hong , Guoying Zhao

Violence and abnormal behavior detection research have known an increase of interest in recent years, due mainly to a rise in crimes in large cities worldwide. In this work, we propose a deep learning architecture for violence detection…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Abdarahmane Traoré , Moulay A. Akhloufi

In this paper, we introduce a deep learning solution for video activity recognition that leverages an innovative combination of convolutional layers with a linear-complexity attention mechanism. Moreover, we introduce a novel quantization…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Gabriele Lagani , Fabrizio Falchi , Claudio Gennaro , Giuseppe Amato

Most video based action recognition approaches create the video-level representation by temporally pooling the features extracted at each frame. The pooling methods that they adopt, however, usually completely or partially neglect the…

Computer Vision and Pattern Recognition · Computer Science 2016-02-02 Peng Wang , Lingqiao Liu , Chunhua Shen , Heng Tao Shen

Infrared (IR) imaging has the potential to enable more robust action recognition systems compared to visible spectrum cameras due to lower sensitivity to lighting conditions and appearance variability. While the action recognition task on…

Computer Vision and Pattern Recognition · Computer Science 2017-05-19 Zhuolin Jiang , Viktor Rozgic , Sancar Adali

Most action recognition methods base on a) a late aggregation of frame level CNN features using average pooling, max pooling, or RNN, among others, or b) spatio-temporal aggregation via 3D convolutions. The first assume independence among…

Computer Vision and Pattern Recognition · Computer Science 2019-05-30 Swathikiran Sudhakaran , Sergio Escalera , Oswald Lanz

Deep convolutional networks have achieved great success for object recognition in still images. However, for action recognition in videos, the improvement of deep convolutional networks is not so evident. We argue that there are two reasons…

Computer Vision and Pattern Recognition · Computer Science 2015-07-09 Limin Wang , Yuanjun Xiong , Zhe Wang , Yu Qiao

Convolutional Neural Networks demonstrate high performance on ImageNet Large-Scale Visual Recognition Challenges contest. Nevertheless, the published results only show the overall performance for all image classes. There is no further…

Computer Vision and Pattern Recognition · Computer Science 2015-06-23 Mingming Wang