English
Related papers

Related papers: Folded Recurrent Neural Networks for Future Video …

200 papers

The time-series forecasting (TSF) problem is a traditional problem in the field of artificial intelligence. Models such as Recurrent Neural Network (RNN), Long Short Term Memory (LSTM), and GRU (Gate Recurrent Units) have contributed to…

Machine Learning · Computer Science 2024-08-29 Sunghyun Sim , Dohee Kim , Hyerim Bae

In recent years, complex valued artificial neural networks have gained increasing interest as they allow neural networks to learn richer representations while potentially incorporating less parameters. Especially in the domain of computer…

Computer Vision and Pattern Recognition · Computer Science 2019-03-11 Niloofar Azizi , Nils Wandel , Sven Behnke

Graph processes exhibit a temporal structure determined by the sequence index and and a spatial structure determined by the graph support. To learn from graph processes, an information processing architecture must then be able to exploit…

Signal Processing · Electrical Eng. & Systems 2020-12-02 Luana Ruiz , Fernando Gama , Alejandro Ribeiro

While significant progress has been made in deep video denoising, it remains very challenging for exploiting historical and future frames. Bidirectional recurrent networks (BiRNN) have exhibited appealing performance in several video…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Junyi Li , Xiaohe Wu , Zhenxing Niu , Wangmeng Zuo

Event camera has offered promising alternative for visual perception, especially in high speed and high dynamic range scenes. Recently, many deep learning methods have shown great success in providing promising solutions to many event-based…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Ziluo Ding , Rui Zhao , Jiyuan Zhang , Tianxiao Gao , Ruiqin Xiong , Zhaofei Yu , Tiejun Huang

The paper evaluates three variants of the Gated Recurrent Unit (GRU) in recurrent neural networks (RNN) by reducing parameters in the update and reset gates. We evaluate the three variant GRU models on MNIST and IMDB datasets and show that…

Neural and Evolutionary Computing · Computer Science 2017-01-24 Rahul Dey , Fathi M. Salem

Semantic segmentation has recently witnessed major progress, where fully convolutional neural networks have shown to perform well. However, most of the previous work focused on improving single image segmentation. To our knowledge, no prior…

Computer Vision and Pattern Recognition · Computer Science 2016-11-23 Mennatullah Siam , Sepehr Valipour , Martin Jagersand , Nilanjan Ray

We propose an approach to learn spatio-temporal features in videos from intermediate visual representations we call "percepts" using Gated-Recurrent-Unit Recurrent Networks (GRUs).Our method relies on percepts that are extracted from all…

Computer Vision and Pattern Recognition · Computer Science 2016-03-02 Nicolas Ballas , Li Yao , Chris Pal , Aaron Courville

Stochastic video prediction models take in a sequence of image frames, and generate a sequence of consecutive future image frames. These models typically generate future frames in an autoregressive fashion, which is slow and requires the…

Computer Vision and Pattern Recognition · Computer Science 2019-04-23 Ananya Kumar , S. M. Ali Eslami , Danilo J. Rezende , Marta Garnelo , Fabio Viola , Edward Lockhart , Murray Shanahan

Recent advances in computed tomography (CT) imaging, especially with dual-robot systems, have introduced new challenges for scan trajectory optimization. This paper presents a novel approach using Gated Recurrent Units (GRUs) to optimize CT…

Computer Vision and Pattern Recognition · Computer Science 2024-05-16 Yuedong Yuan , Linda-Sophie Schneider , Andreas Maier

Predicting depth from a monocular video sequence is an important task for autonomous driving. Although it has advanced considerably in the past few years, recent methods based on convolutional neural networks (CNNs) discard temporal…

Computer Vision and Pattern Recognition · Computer Science 2019-09-17 Chanho Eom , Hyunjong Park , Bumsub Ham

Gated Recurrent Unit (GRU) is a recently-developed variation of the long short-term memory (LSTM) unit, both of which are types of recurrent neural network (RNN). Through empirical evidence, both models have been proven to be effective in a…

Neural and Evolutionary Computing · Computer Science 2019-02-08 Abien Fred Agarap

Sequence generative models with RNN variants, such as LSTM, GRU, show promising performance on abstractive document summarization. However, they still have some issues that limit their performance, especially while deal-ing with long…

Computation and Language · Computer Science 2018-09-19 Kamal Al-Sabahi , Zhang Zuping , Yang Kang

This paper presents the neural network model that was used by the author in the Weather4cast 2021 Challenge Stage 1, where the objective was to predict the time evolution of satellite-based weather data images. The network is based on an…

Machine Learning · Computer Science 2021-11-12 Jussi Leinonen

The increasing demand for continual learning in sequential data processing has led to progressively complex training methodologies and larger recurrent network architectures. Consequently, this has widened the knowledge gap between…

Machine Learning · Computer Science 2025-03-11 Abdullah M. Zyarah , Dhireesha Kudithipudi

Abnormal behavior detection, action recognition, fight and violence detection in videos is an area that has attracted a lot of interest in recent years. In this work, we propose an architecture that combines a Bidirectional Gated Recurrent…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Abdarahmane Traoré , Moulay A. Akhloufi

Multimodal learning faces a fundamental tension between deep, fine-grained fusion and computational scalability. While cross-attention models achieve strong performance through exhaustive pairwise fusion, their quadratic complexity is…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Yusuf Shihata

Recurrent Neural Networks (RNNs), which are a powerful scheme for modeling temporal and sequential data need to capture long-term dependencies on datasets and represent them in hidden layers with a powerful model to capture more information…

Machine Learning · Computer Science 2017-06-08 Andros Tjandra , Sakriani Sakti , Ruli Manurung , Mirna Adriani , Satoshi Nakamura

We present PredRNN++, an improved recurrent network for video predictive learning. In pursuit of a greater spatiotemporal modeling capability, our approach increases the transition depth between adjacent states by leveraging a novel…

Machine Learning · Computer Science 2018-11-20 Yunbo Wang , Zhifeng Gao , Mingsheng Long , Jianmin Wang , Philip S. Yu

Learning to predict future images from a video sequence involves the construction of an internal representation that models the image evolution accurately, and therefore, to some degree, its content and dynamics. This is why pixel-space…

Machine Learning · Computer Science 2016-03-01 Michael Mathieu , Camille Couprie , Yann LeCun