English
Related papers

Related papers: Real-Time Recurrent Learning using Trace Units in …

200 papers

Recurrent Networks are one of the most powerful and promising artificial neural network algorithms to processing the sequential data such as natural languages, sound, time series data. Unlike traditional feed-forward network, Recurrent…

Machine Learning · Computer Science 2018-07-11 Pushparaja Murugan

Streaming reinforcement learning has emerged as an online learning paradigm that conforms to the restrictions of natural learning agents that process data incrementally, i.e. with a batch size of 1 and no replay buffer. While streaming RL…

Machine Learning · Computer Science 2026-05-26 Noah Farr , Aryaman Reddi , Carlo D'Eramo , Jan Peters

Building and maintaining state to learn policies and value functions is critical for deploying reinforcement learning (RL) agents in the real world. Recurrent neural networks (RNNs) have become a key point of interest for the state-building…

Machine Learning · Computer Science 2026-05-19 Matthew Schlegel , Volodymyr Tkachuk , Adam White , Martha White

Reinforcement learning (RL) agents performing complex tasks must be able to remember observations and actions across sizable time intervals. This is especially true during the initial learning stages, when exploratory behaviour can increase…

Machine Learning · Computer Science 2018-05-15 Thomas Stepleton , Razvan Pascanu , Will Dabney , Siddhant M. Jayakumar , Hubert Soyer , Remi Munos

Recurrent neural network (RNN) based reinforcement learning (RL) is used for learning context-dependent tasks and has also attracted attention as a method with remarkable learning performance in recent research. However, RNN-based RL has…

Machine Learning · Computer Science 2022-03-04 Toshitaka Matsuki

Recurrent neural networks (RNNs) have represented for years the state of the art in neural machine translation. Recently, new architectures have been proposed, which can leverage parallel computation on GPUs better than classical RNNs.…

Computation and Language · Computer Science 2018-05-14 Mattia Antonino Di Gangi , Marcello Federico

Successful applications of reinforcement learning in real-world problems often require dealing with partially observable states. It is in general very challenging to construct and infer hidden states as they often depend on the agent's…

Machine Learning · Computer Science 2015-11-20 Xiujun Li , Lihong Li , Jianfeng Gao , Xiaodong He , Jianshu Chen , Li Deng , Ji He

Recurrent neural networks (RNN) as used in machine learning are commonly formulated in discrete time, i.e. as recursive maps. This brings a lot of advantages for training models on data, e.g. for the purpose of time series prediction or…

Dynamical Systems · Mathematics 2020-07-02 Zahra Monfared , Daniel Durstewitz

Recurrent Neural Network (RNN) has been successfully applied in many sequence learning problems. Such as handwriting recognition, image description, natural language processing and video motion analysis. After years of development,…

Machine Learning · Computer Science 2018-11-01 Guoqiang Zhong , Guohua Yue , Xiao Ling

Recurrent neural networks (RNNs) are a popular choice for modeling sequential data. Modern RNN architectures assume constant time-intervals between observations. However, in many datasets (e.g. medical records) observation times are…

Machine Learning · Computer Science 2022-07-27 Mona Schirmer , Mazin Eltayeb , Stefan Lessmann , Maja Rudolph

Knowledge tracing---where a machine models the knowledge of a student as they interact with coursework---is a well established problem in computer supported education. Though effectively modeling student knowledge would have high…

Artificial Intelligence · Computer Science 2015-06-22 Chris Piech , Jonathan Spencer , Jonathan Huang , Surya Ganguli , Mehran Sahami , Leonidas Guibas , Jascha Sohl-Dickstein

Recurrent Neural Networks (RNNs) with Long Short-Term Memory units (LSTM) are widely used because they are expressive and are easy to train. Our interest lies in empirically evaluating the expressiveness and the learnability of LSTMs in the…

Neural and Evolutionary Computing · Computer Science 2015-11-24 Wojciech Zaremba , Ilya Sutskever

This paper explores the performance of fitted neural Q iteration for reinforcement learning in several partially observable environments, using three recurrent neural network architectures: Long Short-Term Memory, Gated Recurrent Unit and…

Neural and Evolutionary Computing · Computer Science 2015-12-18 Denis Steckelmacher , Peter Vrancx

Recurrent Neural Network (RNN) has been widely applied for sequence modeling. In RNN, the hidden states at current step are full connected to those at previous step, thus the influence from less related features at previous step may…

Computation and Language · Computer Science 2017-05-04 Danhao Zhu , Si Shen , Xin-Yu Dai , Jiajun Chen

We explore the architecture of recurrent neural networks (RNNs) by studying the complexity of string sequences it is able to memorize. Symbolic sequences of different complexity are generated to simulate RNN training and study parameter…

Machine Learning · Computer Science 2023-11-17 Roberto Cahuantzi , Xinye Chen , Stefan Güttel

Random Recurrent Neural Networks (RRNN) are the simplest recurrent networks to model and extract features from sequential data. The simplicity however comes with a price; RRNN are known to be susceptible to diminishing/exploding gradient…

Machine Learning · Computer Science 2025-06-10 Yang Zheng , Eli Shlizerman

Real-world reinforcement learning tasks often involve some form of partial observability where the observations only give a partial or noisy view of the true state of the world. Such tasks typically require some form of memory, where the…

Machine Learning · Computer Science 2022-11-11 Kevin Esslinger , Robert Platt , Christopher Amato

Recurrent neural networks (RNNs) have shown excellent performance in processing sequence data. However, they are both complex and memory intensive due to their recursive nature. These limitations make RNNs difficult to embed on mobile…

Machine Learning · Computer Science 2019-01-28 Arash Ardakani , Zhengyun Ji , Sean C. Smithson , Brett H. Meyer , Warren J. Gross

Recurrent Neural Network (RNN) are a popular choice for modeling temporal and sequential tasks and achieve many state-of-the-art performance on various complex problems. However, most of the state-of-the-art RNNs have millions of parameters…

Machine Learning · Computer Science 2017-10-31 Andros Tjandra , Sakriani Sakti , Satoshi Nakamura

Recurrent Neural Networks (RNNs) are a class of machine learning algorithms used for applications with time-series and sequential data. Recently, there has been a strong interest in executing RNNs on embedded devices. However, difficulties…

Neural and Evolutionary Computing · Computer Science 2020-03-23 Nesma M. Rezk , Madhura Purnaprajna , Tomas Nordström , Zain Ul-Abdin