English
Related papers

Related papers: Modeling Spatial-Temporal Clues in a Hybrid Deep L…

200 papers

We propose a soft attention based model for the task of action recognition in videos. We use multi-layered Recurrent Neural Networks (RNNs) with Long Short-Term Memory (LSTM) units which are deep both spatially and temporally. Our model…

Machine Learning · Computer Science 2016-02-16 Shikhar Sharma , Ryan Kiros , Ruslan Salakhutdinov

Automating the detection of anomalous events within long video sequences is challenging due to the ambiguity of how such events are defined. We approach the problem by learning generative models that can identify anomalies in videos using…

Computer Vision and Pattern Recognition · Computer Science 2016-12-16 Jefferson Ryan Medel , Andreas Savakis

The video-based person re-identification is to recognize a person under different cameras, which is a crucial task applied in visual surveillance system. Most previous methods mainly focused on the feature of full body in the frame. In this…

Computer Vision and Pattern Recognition · Computer Science 2018-07-04 Jie Liu , Cheng Sun , Xiang Xu , Baomin Xu , Shuangyuan Yu

Contextual information plays a core role for video semantic segmentation (VSS). This paper summarizes contexts for VSS in two-fold: local temporal contexts (LTC) which define the contexts from neighboring frames, and global temporal…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Guolei Sun , Yun Liu , Henghui Ding , Min Wu , Luc Van Gool

We present a simple and effective deep convolutional neural network (CNN) model for video deblurring. The proposed algorithm mainly consists of optical flow estimation from intermediate latent frames and latent frame restoration steps. It…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Jinshan Pan , Haoran Bai , Jinhui Tang

Text recognition in natural scene is a challenging problem due to the many factors affecting text appearance. In this paper, we presents a method that directly transcribes scene text images to text without needing of sophisticated character…

Computer Vision and Pattern Recognition · Computer Science 2016-01-07 Guo Qiang , Tu Dan , Li Guohui , Lei Jun

This paper introduces an online model for object detection in videos designed to run in real-time on low-powered mobile and embedded devices. Our approach combines fast single-image object detection with convolutional long short term memory…

Computer Vision and Pattern Recognition · Computer Science 2018-03-30 Mason Liu , Menglong Zhu

In this work, we propose an approach to the spatiotemporal localisation (detection) and classification of multiple concurrent actions within temporally untrimmed videos. Our framework is composed of three stages. In stage 1, appearance and…

Computer Vision and Pattern Recognition · Computer Science 2016-08-05 Suman Saha , Gurkirt Singh , Michael Sapienza , Philip H. S. Torr , Fabio Cuzzolin

The drastic variation of motion in spatial and temporal dimensions makes the video prediction task extremely challenging. Existing RNN models obtain higher performance by deepening or widening the model. They obtain the multi-scale features…

Computer Vision and Pattern Recognition · Computer Science 2024-02-19 Zhifeng Ma , Hao Zhang , Jie Liu

Human motion modeling is a classic problem in computer vision and graphics. Challenges in modeling human motion include high dimensional prediction as well as extremely complicated dynamics.We present a novel approach to human motion…

Computer Vision and Pattern Recognition · Computer Science 2018-05-03 Chen Li , Zhen Zhang , Wee Sun Lee , Gim Hee Lee

The standard way of training video models entails sampling at each iteration a single clip from a video and optimizing the clip prediction with respect to the video-level label. We argue that a single clip may not have enough temporal…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Xitong Yang , Haoqi Fan , Lorenzo Torresani , Larry Davis , Heng Wang

For deepfake detection, video-level detectors have not been explored as extensively as image-level detectors, which do not exploit temporal data. In this paper, we empirically show that existing approaches on image and sequence classifiers…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 Ipek Ganiyusufoglu , L. Minh Ngô , Nedko Savov , Sezer Karaoglu , Theo Gevers

This paper studies the joint learning of action recognition and temporal localization in long, untrimmed videos. We employ a multi-task learning framework that performs the three highly related steps of action proposal, action recognition,…

Computer Vision and Pattern Recognition · Computer Science 2017-04-05 Yi Zhu , Shawn Newsam

Action recognition has become a rapidly developing research field within the last decade. But with the increasing demand for large scale data, the need of hand annotated data for the training becomes more and more impractical. One way to…

Computer Vision and Pattern Recognition · Computer Science 2019-06-05 Hilde Kuehne , Alexander Richard , Juergen Gall

Tracking a target of interest in both sparse and crowded environments is a challenging problem, not yet successfully addressed in the literature. In this paper, we propose a new long-term visual tracking algorithm, learning discriminative…

Computer Vision and Pattern Recognition · Computer Science 2019-02-05 Nathanael L. Baisa , Deepayan Bhowmik , Andrew Wallace

This thesis explore different approaches using Convolutional and Recurrent Neural Networks to classify and temporally localize activities on videos, furthermore an implementation to achieve it has been proposed. As the first step, features…

Computer Vision and Pattern Recognition · Computer Science 2017-03-06 Alberto Montes , Amaia Salvador , Santiago Pascual , Xavier Giro-i-Nieto

Fine-grained action detection is an important task with numerous applications in robotics and human-computer interaction. Existing methods typically utilize a two-stage approach including extraction of local spatio-temporal features…

Computer Vision and Pattern Recognition · Computer Science 2019-11-11 Khoi-Nguyen C. Mac , Dhiraj Joshi , Raymond A. Yeh , Jinjun Xiong , Rogerio S. Feris , Minh N. Do

Recently, video classification attracts intensive research efforts. However, most existing works are based on framelevel visual features, which might fail to model the temporal information, e.g. characteristics accumulated along time. In…

Computer Vision and Pattern Recognition · Computer Science 2016-08-18 Haimin Zhang

Convolutional neural network (CNN) slides a kernel over the whole image to produce an output map. This kernel scheme reduces the number of parameters with respect to a fully connected neural network (NN). While CNN has proven to be an…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Ihsan Ullah , Alfredo Petrosino

Spatial and temporal stream model has gained great success in video action recognition. Most existing works pay more attention to designing effective features fusion methods, which train the two-stream model in a separate way. However, it's…

Computer Vision and Pattern Recognition · Computer Science 2019-08-28 Jingran Zhang , Fumin Shen , Xing Xu , Heng Tao Shen