English
Related papers

Related papers: D3D: Distilled 3D Networks for Video Action Recogn…

200 papers

We present a new data-driven video inpainting method for recovering missing regions of video frames. A novel deep learning architecture is proposed which contains two sub-networks: a temporal structure inference network and a spatial detail…

Computer Vision and Pattern Recognition · Computer Science 2018-12-04 Chuan Wang , Haibin Huang , Xiaoguang Han , Jue Wang

Deep neural networks have achieved great success for video analysis and understanding. However, designing a high-performance neural architecture requires substantial efforts and expertise. In this paper, we make the first attempt to let…

Computer Vision and Pattern Recognition · Computer Science 2019-07-11 Wei Peng , Xiaopeng Hong , Guoying Zhao

Even with the recent advances in convolutional neural networks (CNN) in various visual recognition tasks, the state-of-the-art action recognition system still relies on hand crafted motion feature such as optical flow to achieve the best…

Computer Vision and Pattern Recognition · Computer Science 2018-02-20 Joe Yue-Hei Ng , Jonghyun Choi , Jan Neumann , Larry S. Davis

Convolutional neural networks (CNNs) have demonstrated their superiority in numerous computer vision tasks, yet their computational cost results prohibitive for many real-time applications such as pedestrian detection which is usually…

Computer Vision and Pattern Recognition · Computer Science 2018-01-03 Farzin Ghorban , Javier Marín , Yu Su , Alessandro Colombo , Anton Kummert

We propose a novel method for temporally pooling frames in a video for the task of human action recognition. The method is motivated by the observation that there are only a small number of frames which, together, contain sufficient…

Computer Vision and Pattern Recognition · Computer Science 2017-06-27 Amlan Kar , Nishant Rai , Karan Sikka , Gaurav Sharma

Among the existing modalities for 3D action recognition, 3D flow has been poorly examined, although conveying rich motion information cues for human actions. Presumably, its susceptibility to noise renders it intractable, thus challenging…

Computer Vision and Pattern Recognition · Computer Science 2023-06-26 Vasileios Magoulianitis , Athanasios Psaltis

Convolutional Neural Networks (CNNs) are prone to overfit small training datasets. We present a novel two-phase pipeline that leverages self-supervised learning and knowledge distillation to improve the generalization ability of CNN models…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Bingchen Zhao , Xin Wen

In this paper, we revive the use of old-fashioned handcrafted video representations for action recognition and put new life into these techniques via a CNN-based hallucination step. Despite of the use of RGB and optical flow frames, the I3D…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Lei Wang , Piotr Koniusz , Du Q. Huynh

Infrared human action recognition has many advantages, i.e., it is insensitive to illumination change, appearance variability, and shadows. Existing methods for infrared action recognition are either based on spatial or local temporal…

Computer Vision and Pattern Recognition · Computer Science 2019-09-19 Yang Liu , Zhaoyang Lu , Jing Li , Tao Yang , Chao Yao

Information of time differentiation is extremely important cue for a motion representation. We have applied first-order differential velocity from a positional information, moreover we believe that second-order differential acceleration is…

Computer Vision and Pattern Recognition · Computer Science 2016-08-31 Hirokatsu Kataoka , Yun He , Soma Shirakabe , Yutaka Satoh

Analyzing spatio-temporal data like video is a challenging task that requires processing visual and temporal information effectively. Convolutional Neural Networks have shown promise as baseline fixed feature extractors through transfer…

Computer Vision and Pattern Recognition · Computer Science 2017-11-06 Dillon Graham , Seyed Hamed Fatemi Langroudi , Christopher Kanan , Dhireesha Kudithipudi

Forecasting future traffic flows from previous ones is a challenging problem because of their complex and dynamic nature of spatio-temporal structures. Most existing graph-based CNNs attempt to capture the static relations while largely…

Computer Vision and Pattern Recognition · Computer Science 2020-03-06 Ken Chen , Fei Chen , Baisheng Lai , Zhongming Jin , Yong Liu , Kai Li , Long Wei , Pengfei Wang , Yandong Tang , Jianqiang Huang , Xian-Sheng Hua

A major emerging challenge is how to protect people's privacy as cameras and computer vision are increasingly integrated into our daily lives, including in smart devices inside homes. A potential solution is to capture and record just the…

Computer Vision and Pattern Recognition · Computer Science 2018-01-15 Mingze Xu , Aidean Sharghi , Xin Chen , David J Crandall

Deep ConvNets have shown its good performance in image classification tasks. However it still remains as a problem in deep video representation for action recognition. The problem comes from two aspects: on one hand, current video ConvNets…

Computer Vision and Pattern Recognition · Computer Science 2015-11-09 Shichao Zhao , Yanbin Liu , Yahong Han , Richang Hong

Spatial-temporal, channel-wise, and motion patterns are three complementary and crucial types of information for video action recognition. Conventional 2D CNNs are computationally cheap but cannot catch temporal relationships; 3D CNNs can…

Computer Vision and Pattern Recognition · Computer Science 2021-03-15 Zhengwei Wang , Qi She , Aljosa Smolic

This thesis explore different approaches using Convolutional and Recurrent Neural Networks to classify and temporally localize activities on videos, furthermore an implementation to achieve it has been proposed. As the first step, features…

Computer Vision and Pattern Recognition · Computer Science 2017-03-06 Alberto Montes , Amaia Salvador , Santiago Pascual , Xavier Giro-i-Nieto

Large Language Models have shown remarkable efficacy in generating streaming data such as text and audio, thanks to their temporally uni-directional attention mechanism, which models correlations between the current token and previous…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Zhening Xing , Gereon Fox , Yanhong Zeng , Xingang Pan , Mohamed Elgharib , Christian Theobalt , Kai Chen

Recent two-stream deep Convolutional Neural Networks (ConvNets) have made significant progress in recognizing human actions in videos. Despite their success, methods extending the basic two-stream ConvNet have not systematically explored…

Computer Vision and Pattern Recognition · Computer Science 2017-04-03 Chih-Yao Ma , Min-Hung Chen , Zsolt Kira , Ghassan AlRegib

Video analysis is a major computer vision task that has received a lot of attention in recent years. The current state-of-the-art performance for video analysis is achieved with Deep Neural Networks (DNNs) that have high computational costs…

Computer Vision and Pattern Recognition · Computer Science 2023-09-25 Mireille El-Assal , Pierre Tirilly , Ioan Marius Bilasco

We propose an online 3D semantic segmentation method that incrementally reconstructs a 3D semantic map from a stream of RGB-D frames. Unlike offline methods, ours is directly applicable to scenarios with real-time constraints, such as…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Silvan Weder , Francis Engelmann , Johannes L. Schönberger , Akihito Seki , Marc Pollefeys , Martin R. Oswald