English
Related papers

Related papers: Inception-inspired LSTM for Next-frame Video Predi…

200 papers

This paper introduces an unsupervised framework to extract semantically rich features for video representation. Inspired by how the human visual system groups objects based on motion cues, we propose a deep convolutional neural network that…

Computer Vision and Pattern Recognition · Computer Science 2017-07-18 Xunyu Lin , Victor Campos , Xavier Giro-i-Nieto , Jordi Torres , Cristian Canton Ferrer

Video prediction models based on convolutional networks, recurrent networks, and their combinations often result in blurry predictions. We identify an important contributing factor for imprecise predictions that has not been studied…

Computer Vision and Pattern Recognition · Computer Science 2018-09-11 Wonmin Byeon , Qin Wang , Rupesh Kumar Srivastava , Petros Koumoutsakos

Time series prediction with deep learning methods, especially long short-term memory neural networks (LSTMs), have scored significant achievements in recent years. Despite the fact that the LSTMs can help to capture long-term dependencies,…

Machine Learning · Computer Science 2018-11-12 Youru Li , Zhenfeng Zhu , Deqiang Kong , Hua Han , Yao Zhao

Inspired by recent advances in neural machine translation, that jointly align and translate using encoder-decoder networks equipped with attention, we propose an attentionbased LSTM model for human activity recognition. Our model jointly…

Computer Vision and Pattern Recognition · Computer Science 2017-09-01 Atousa Torabi , Leonid Sigal

Recently, with the advent of deep convolutional neural networks (DCNN), the improvements in visual saliency prediction research are impressive. One possible direction to approach the next improvement is to fully characterize the multi-scale…

Computer Vision and Pattern Recognition · Computer Science 2019-05-10 Sheng Yang , Guosheng Lin , Qiuping Jiang , Weisi Lin

Recent advances in AI and robotics have claimed many incredible results with deep learning, yet no work to date has applied deep learning to the problem of liquid perception and reasoning. In this paper, we apply fully-convolutional deep…

Computer Vision and Pattern Recognition · Computer Science 2016-06-21 Connor Schenck , Dieter Fox

A challenge in speech production research is to predict future tongue movements based on a short period of past tongue movements. This study tackles speaker-dependent tongue motion prediction problem in unlabeled ultrasound videos with…

Computer Vision and Pattern Recognition · Computer Science 2019-02-20 Chaojie Zhao , Peng Zhang , Jian Zhu , Chengrui Wu , Huaimin Wang , Kele Xu

In this paper, we propose a novel video depth estimation approach, FutureDepth, which enables the model to implicitly leverage multi-frame and motion cues to improve depth estimation by making it learn to predict the future at training.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Rajeev Yasarla , Manish Kumar Singh , Hong Cai , Yunxiao Shi , Jisoo Jeong , Yinhao Zhu , Shizhong Han , Risheek Garrepalli , Fatih Porikli

We propose a deep neural network for the prediction of future frames in natural video sequences. To effectively handle complex evolution of pixels in videos, we propose to decompose the motion and content, two key components generating…

Computer Vision and Pattern Recognition · Computer Science 2018-01-09 Ruben Villegas , Jimei Yang , Seunghoon Hong , Xunyu Lin , Honglak Lee

Dynamic link prediction is a research hot in complex networks area, especially for its wide applications in biology, social network, economy and industry. Compared with static link prediction, dynamic one is much more difficult since…

Social and Information Networks · Computer Science 2021-10-05 Jinyin Chen , Xueke Wang , Xuanheng Xu

In this paper, we present experimental results obtained from retraining the last layer of the Inception v3 model in classifying images of human faces into one of five basic face shapes. The accuracy of the retrained Inception v3 model was…

Computer Vision and Pattern Recognition · Computer Science 2019-11-20 Adonis Emmanuel Tio

Convolutional neural networks (CNNs) have been extensively applied for image recognition problems giving state-of-the-art results on recognition, detection, segmentation and retrieval. In this work we propose and evaluate several deep…

Computer Vision and Pattern Recognition · Computer Science 2015-04-14 Joe Yue-Hei Ng , Matthew Hausknecht , Sudheendra Vijayanarasimhan , Oriol Vinyals , Rajat Monga , George Toderici

Spatio-Temporal predictive Learning is a self-supervised learning paradigm that enables models to identify spatial and temporal patterns by predicting future frames based on past frames. Traditional methods, which use recurrent neural…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Andrea Alfarano , Alberto Alfarano , Linda Friso , Andrea Bacciu , Irene Amerini , Fabrizio Silvestri

Learned frame prediction is a current problem of interest in computer vision and video compression. Although several deep network architectures have been proposed for learned frame prediction, to the best of our knowledge, there is no work…

Computer Vision and Pattern Recognition · Computer Science 2021-05-28 M. Akın Yılmaz , A. Murat Tekalp

We consider the problem of next frame prediction from video input. A recurrent convolutional neural network is trained to predict depth from monocular video input, which, along with the current video image and the camera trajectory, can…

Machine Learning · Computer Science 2017-06-14 Reza Mahjourian , Martin Wicke , Anelia Angelova

In this paper, we develop a new approach of spatially supervised recurrent convolutional neural networks for visual object tracking. Our recurrent convolutional network exploits the history of locations as well as the distinctive visual…

Computer Vision and Pattern Recognition · Computer Science 2016-07-21 Guanghan Ning , Zhi Zhang , Chen Huang , Zhihai He , Xiaobo Ren , Haohong Wang

In this work, we propose a novel deep network for traffic sign classification that achieves outstanding performance on GTSRB surpassing all previous methods. Our deep network consists of spatial transformer layers and a modified version of…

Computer Vision and Pattern Recognition · Computer Science 2016-07-19 Mrinal Haloi

In this paper, we propose a new Transformer block for video future frames prediction based on an efficient local spatial-temporal separation attention mechanism. Based on this new Transformer block, a fully autoregressive video future…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Xi Ye , Guillaume-Alexandre Bilodeau

The framework of dominant learned video compression methods is usually composed of motion prediction modules as well as motion vector and residual image compression modules, suffering from its complex structure and error propagation…

Image and Video Processing · Electrical Eng. & Systems 2021-04-14 Zhenhong Sun , Zhiyu Tan , Xiuyu Sun , Fangyi Zhang , Dongyang Li , Yichen Qian , Hao Li

This paper introduces a novel method for self-supervised video representation learning via feature prediction. In contrast to the previous methods that focus on future feature prediction, we argue that a supervisory signal arising from…

Computer Vision and Pattern Recognition · Computer Science 2020-11-13 Nadine Behrmann , Juergen Gall , Mehdi Noroozi