English
Related papers

Related papers: General Value Function Networks

200 papers

Many reinforcement learning tasks can benefit from explicit planning based on an internal model of the environment. Previously, such planning components have been incorporated through a neural network that partially aligns with the…

Machine Learning · Computer Science 2020-09-29 Andreea Deac , Pierre-Luc Bacon , Jian Tang

In many environmental applications, recurrent neural networks (RNNs) are often used to model physical variables with long temporal dependencies. However, due to mini-batch training, temporal relationships between training segments within…

Recurrent neural networks (RNNs) are a widely used deep architecture for sequence modeling, generation, and prediction. Despite success in applications such as machine translation and voice recognition, these stateful models have several…

Computation and Language · Computer Science 2020-04-23 Ankur Mali , Alexander Ororbia , Daniel Kifer , Clyde Lee Giles

We consider the problem of learning generalized policies for classical planning domains using graph neural networks from small instances represented in lifted STRIPS. The problem has been considered before but the proposed neural…

Artificial Intelligence · Computer Science 2022-05-13 Simon Ståhlberg , Blai Bonet , Hector Geffner

Recurrent neural networks (RNNs) have been used extensively and with increasing success to model various types of sequential data. Much of this progress has been achieved through devising recurrent units and architectures with the…

Machine Learning · Statistics 2017-03-06 Yacine Jernite , Edouard Grave , Armand Joulin , Tomas Mikolov

Graph neural networks (GNNs) are shown to be successful in modeling applications with graph structures. However, training an accurate GNN model requires a large collection of labeled data and expressive features, which might be inaccessible…

Machine Learning · Computer Science 2019-06-03 Ziniu Hu , Changjun Fan , Ting Chen , Kai-Wei Chang , Yizhou Sun

Recurrent Neural Networks (RNNs) are popular models of brain function. The typical training strategy is to adjust their input-output behavior so that it matches that of the biological circuit of interest. Even though this strategy ensures…

Neurons and Cognition · Quantitative Biology 2020-11-09 Alessandro Salatiello , Martin A. Giese

Robotic navigation through crowds or herds requires the ability to both predict the future motion of nearby individuals and understand how these predictions might change in response to a robot's future action. State of the art trajectory…

Artificial Intelligence · Computer Science 2020-01-29 Stuart Eiffert , Salah Sukkarieh

We address the efficiency issue for the construction of a deep graph neural network (GNN). The approach exploits the idea of representing each input graph as a fixed point of a dynamical system (implemented through a recurrent neural…

Machine Learning · Computer Science 2019-11-21 Claudio Gallicchio , Alessio Micheli

Network robustness is critical for various societal and industrial networks again malicious attacks. In particular, connectivity robustness and controllability robustness reflect how well a networked system can maintain its connectedness…

Systems and Control · Electrical Eng. & Systems 2023-07-25 Yang Lou , Ruizi Wu , Junli Li , Lin Wang , Xiang Li , Guanrong Chen

The extension of deep learning towards temporal data processing is gaining an increasing research interest. In this paper we investigate the properties of state dynamics developed in successive levels of deep recurrent neural networks…

Machine Learning · Computer Science 2018-02-05 Claudio Gallicchio

We introduce Recurrent Predictive State Policy (RPSP) networks, a recurrent architecture that brings insights from predictive state representations to reinforcement learning in partially observable environments. Predictive state policy…

Machine Learning · Statistics 2018-03-06 Ahmed Hefny , Zita Marinho , Wen Sun , Siddhartha Srinivasa , Geoffrey Gordon

In computational reinforcement learning, a growing body of work seeks to construct an agent's perception of the world through predictions of future sensations; predictions about environment observations are used as additional input features…

Machine Learning · Computer Science 2022-06-15 Alexandra Kearney , Anna Koop , Johannes Günther , Patrick M. Pilarski

Recurrent Neural Networks (RNNs) are important tools for processing sequential data such as time-series or video. Interpretability is defined as the ability to be understood by a person and is different from explainability, which is the…

Machine Learning · Computer Science 2022-02-25 CJ Barberan , Sina Alemohammad , Naiming Liu , Randall Balestriero , Richard G. Baraniuk

RNN-based methods have faced challenges in the Long-term Time Series Forecasting (LTSF) domain when dealing with excessively long look-back windows and forecast horizons. Consequently, the dominance in this domain has shifted towards…

Machine Learning · Computer Science 2023-08-23 Shengsheng Lin , Weiwei Lin , Wentai Wu , Feiyu Zhao , Ruichao Mo , Haotong Zhang

Recurrent neural networks are often used for learning time-series data. Based on a few assumptions we model this learning task as a minimization problem of a nonlinear least-squares cost function. The special structure of the cost function…

Artificial Intelligence · Computer Science 2007-05-23 I. Szita , A. Lorincz

Recurrent neural networks (RNNs) have gained a great deal of attention in solving sequential learning problems. The learning of long-term dependencies, however, remains challenging due to the problem of a vanishing or exploding hidden…

Machine Learning · Computer Science 2020-03-17 Konstantin Rusch , John W. Pearson , Konstantinos C. Zygalakis

General value functions (GVFs) in the reinforcement learning (RL) literature are long-term predictive summaries of the outcomes of agents following specific policies in the environment. Affordances as perceived action possibilities with…

Artificial Intelligence · Computer Science 2021-05-11 Daniel Graves , Johannes Günther , Jun Luo

Recurrent neural networks (RNNs) are a class of neural networks used in sequential tasks. However, in general, RNNs have a large number of parameters and involve enormous computational costs by repeating the recurrent structures in many…

Machine Learning · Statistics 2024-03-25 Takashi Furuya , Kazuma Suetake , Koichi Taniguchi , Hiroyuki Kusumoto , Ryuji Saiin , Tomohiro Daimon

Reinforcement learning aims to learn optimal policies from interaction with environments whose dynamics are unknown. Many methods rely on the approximation of a value function to derive near-optimal policies. In partially observable…

Machine Learning · Computer Science 2022-09-13 Gaspard Lambrechts , Adrien Bolland , Damien Ernst