English
Related papers

Related papers: General Value Function Networks

200 papers

Recurrent neural networks (RNNs) have been extraordinarily successful for prediction with sequential data. To tackle highly variable and noisy real-world data, we introduce Particle Filter Recurrent Neural Networks (PF-RNNs), a new RNN…

Machine Learning · Computer Science 2019-12-03 Xiao Ma , Peter Karkus , David Hsu , Wee Sun Lee

Recurrent neural networks with a gating mechanism such as an LSTM or GRU are powerful tools to model sequential data. In the mechanism, a forget gate, which was introduced to control information flow in a hidden state in the RNN, has…

Machine Learning · Statistics 2021-11-08 Kentaro Ohno , Atsutoshi Kumagai

Our main contribution in this work is an empirical finding that random General Value Functions (GVFs), i.e., deep action-conditional predictions -- random both in what feature of observations they predict as well as in the sequence of…

Machine Learning · Computer Science 2021-11-09 Zeyu Zheng , Vivek Veeriah , Risto Vuorio , Richard Lewis , Satinder Singh

End-to-end trained Recurrent Neural Networks (RNNs) have been successfully applied to numerous problems that require processing sequences, such as image captioning, machine translation, and text recognition. However, RNNs often struggle to…

Computer Vision and Pattern Recognition · Computer Science 2018-07-24 Ankush Gupta , Andrea Vedaldi , Andrew Zisserman

Recent studies have greatly improved reinforcement learning, and an increased interest in real-world implementation has emerged. In many cases, the implementation is challenged by time-varying disturbances as it introduces hidden states,…

Machine Learning · Computer Science 2026-03-04 Saki Omi , Hyo-Sang Shin , Namhoon Cho , Antonios Tsourdos

In this work, we propose a novel recurrent neural network (RNN) architecture. The proposed RNN, gated-feedback RNN (GF-RNN), extends the existing approach of stacking multiple recurrent layers by allowing and controlling signals flowing…

Neural and Evolutionary Computing · Computer Science 2015-06-18 Junyoung Chung , Caglar Gulcehre , Kyunghyun Cho , Yoshua Bengio

History-dependent policies induced by recurrent neural networks (RNNs) rely on latent hidden state dynamics, making verification in partially observable reinforcement learning (RL) challenging. Existing RNN verification tools typically rely…

Artificial Intelligence · Computer Science 2026-05-15 Luca Marzari , Enrico Marchesini

A popular strategy to train recurrent neural networks (RNNs), known as ``teacher forcing'' takes the ground truth as input at each time step and makes the later predictions partly conditioned on those inputs. Such training strategy impairs…

Computation and Language · Computer Science 2021-03-23 Liping Yuan , Jiangtao Feng , Xiaoqing Zheng , Xuanjing Huang

Recurrent neural network (RNN) based reinforcement learning (RL) is used for learning context-dependent tasks and has also attracted attention as a method with remarkable learning performance in recent research. However, RNN-based RL has…

Machine Learning · Computer Science 2022-03-04 Toshitaka Matsuki

Recurrent Neural Networks (RNNs), which are a powerful scheme for modeling temporal and sequential data need to capture long-term dependencies on datasets and represent them in hidden layers with a powerful model to capture more information…

Machine Learning · Computer Science 2017-06-08 Andros Tjandra , Sakriani Sakti , Ruli Manurung , Mirna Adriani , Satoshi Nakamura

In many real world applications, data are characterized by a complex structure, that can be naturally encoded as a graph. In the last years, the popularity of deep learning techniques has renewed the interest in neural models able to…

Machine Learning · Computer Science 2020-04-20 Matteo Tiezzi , Giuseppe Marra , Stefano Melacci , Marco Maggini , Marco Gori

Recently, graph neural networks (GNNs) have proved to be suitable in tasks on unstructured data. Particularly in tasks as community detection, node classification, and link prediction. However, most GNN models still operate with static…

Machine Learning · Computer Science 2019-06-07 Darwin Saire Pilco , Adín Ramírez Rivera

Graph neural networks (GNNs) have achieved strong performance in various applications. In the real world, network data is usually formed in a streaming fashion. The distributions of patterns that refer to neighborhood information of nodes…

Machine Learning · Computer Science 2020-12-07 Junshan Wang , Guojie Song , Yi Wu , Liang Wang

Recurrent neural networks are a widely used class of neural architectures. They have, however, two shortcomings. First, it is difficult to understand what exactly they learn. Second, they tend to work poorly on sequences requiring long-term…

Machine Learning · Computer Science 2019-05-08 Cheng Wang , Mathias Niepert

Recurrent Neural Networks (RNNs) play a major role in the field of sequential learning, and have outperformed traditional algorithms on many benchmarks. Training deep RNNs still remains a challenge, and most of the state-of-the-art models…

Machine Learning · Statistics 2018-05-24 Ron Shoham , Haim Permuter

The design of recurrent neural networks (RNNs) to accurately process sequential inputs with long-time dependencies is very challenging on account of the exploding and vanishing gradient problem. To overcome this, we propose a novel RNN…

Machine Learning · Computer Science 2021-08-19 T. Konstantin Rusch , Siddhartha Mishra

In both mobile and web applications, speeding up user interface response times can often lead to significant improvements in user engagement. A common technique to improve responsiveness is to precompute data ahead of time for specific…

Machine Learning · Computer Science 2020-03-04 Hanson Wang , Zehui Wang , Yuanyuan Ma

Recurrent Neural Networks (RNNs) are among the most successful machine learning models for sequence modelling, but tend to suffer from an exponential increase in the number of parameters when dealing with large multidimensional data. To…

Machine Learning · Computer Science 2021-05-12 Yao Lei Xu , Danilo P. Mandic

Graph neural networks (GNNs) offer promising learning methods for graph-related tasks. However, GNNs are at risk of adversarial attacks. Two primary limitations of the current evasion attack methods are highlighted: (1) The current…

Machine Learning · Computer Science 2023-02-08 He Zhang , Xingliang Yuan , Chuan Zhou , Shirui Pan

Time series prediction is essential for human activities in diverse areas. A common approach to this task is to harness Recurrent Neural Networks (RNNs). However, while their predictions are quite accurate, their learning process is complex…

Quantum Physics · Physics 2025-05-30 Michał Siemaszko , Adam Buraczewski , Bertrand Le Saux , Magdalena Stobińska