English
Related papers

Related papers: Efficient Real Time Recurrent Learning through com…

200 papers

Recurrent Neural Networks (RNNs) have become an integral part of modeling and forecasting frameworks in areas like natural language processing and high-dimensional dynamical systems such as turbulent fluid flows. To improve the accuracy of…

Machine Learning · Computer Science 2023-02-23 Pantelis R. Vlachas , Petros Koumoutsakos

While Truncated Back-Propagation through Time (BPTT) is the most popular approach to training Recurrent Neural Networks (RNNs), it suffers from being inherently sequential (making parallelization difficult) and from truncating gradient flow…

Computation and Language · Computer Science 2017-02-17 Sam Wiseman , Sumit Chopra , Marc'Aurelio Ranzato , Arthur Szlam , Ruoyu Sun , Soumith Chintala , Nicolas Vasilache

Recurrent Neural Networks (RNNs) are used to learn representations in partially observable environments. For agents that learn online and continually interact with the environment, it is desirable to train RNNs with real-time recurrent…

Machine Learning · Computer Science 2024-10-31 Esraa Elelimy , Adam White , Michael Bowling , Martha White

Recurrent Neural Networks (RNNs) are useful in temporal sequence tasks. However, training RNNs involves dense matrix multiplications which require hardware that can support a large number of arithmetic operations and memory accesses.…

Machine Learning · Computer Science 2023-12-18 Xi Chen , Chang Gao , Zuowen Wang , Longbiao Cheng , Sheng Zhou , Shih-Chii Liu , Tobi Delbruck

A major drawback of backpropagation through time (BPTT) is the difficulty of learning long-term dependencies, coming from having to propagate credit information backwards through every single step of the forward computation. This makes BPTT…

Artificial Intelligence · Computer Science 2017-11-08 Nan Rosemary Ke , Anirudh Goyal , Olexa Bilaniuk , Jonathan Binas , Laurent Charlin , Chris Pal , Yoshua Bengio

Recurrent Neural Networks (RNNs) are widely used for online regression due to their ability to generalize nonlinear temporal dependencies. As an RNN model, Long-Short-Term-Memory Networks (LSTMs) are commonly preferred in practice, as these…

Machine Learning · Computer Science 2021-06-01 N. Mert Vural , Fatih Ilhan , Selim F. Yilmaz , Salih Ergüt , Suleyman S. Kozat

Recurrent spiking neural networks (RSNNs) can be implemented very efficiently in neuromorphic systems. Nevertheless, training of these models with powerful gradient-based learning algorithms is mostly performed on standard digital hardware…

Neural and Evolutionary Computing · Computer Science 2025-06-18 Maximilian Baronig , Yeganeh Bahariasl , Ozan Özdenizci , Robert Legenstein

Spiking neural networks (SNNs) are promising brain-inspired energy-efficient models. Recent progress in training methods has enabled successful deep SNNs on large-scale tasks with low latency. Particularly, backpropagation through time…

Neural and Evolutionary Computing · Computer Science 2023-01-03 Mingqing Xiao , Qingyan Meng , Zongpeng Zhang , Di He , Zhouchen Lin

Recurrent neural networks (RNNs) provide state-of-the-art performance in processing sequential data but are memory intensive to train, limiting the flexibility of RNN models which can be trained. Reversible RNNs---RNNs for which the…

Machine Learning · Computer Science 2018-10-26 Matthew MacKay , Paul Vicol , Jimmy Ba , Roger Grosse

Real-time recurrent learning (RTRL) computes exact online gradients by propagating a Jacobian tensor forward through recurrent dynamics, but at O(n^4) cost per step. Prior work has sought structured approximations (rank-1 compression,…

Machine Learning · Computer Science 2026-03-30 Aur Shalev Merin

Learning long-term dependencies in extended temporal sequences requires credit assignment to events far back in the past. The most common method for training recurrent neural networks, back-propagation through time (BPTT), requires credit…

Machine Learning · Computer Science 2018-09-12 Nan Rosemary Ke , Anirudh Goyal , Olexa Bilaniuk , Jonathan Binas , Michael C. Mozer , Chris Pal , Yoshua Bengio

Training recurrent neural networks is predominantly achieved via backpropagation through time (BPTT). However, this algorithm is not an optimal solution from both a biological and computational perspective. A more efficient and biologically…

Machine Learning · Computer Science 2022-10-03 Michael Hoyer , Shahram Eivazi , Sebastian Otte

Recurrent Neural Networks (RNNs) are popular models of brain function. The typical training strategy is to adjust their input-output behavior so that it matches that of the biological circuit of interest. Even though this strategy ensures…

Neurons and Cognition · Quantitative Biology 2020-11-09 Alessandro Salatiello , Martin A. Giese

End-to-end training with full-depth backpropagation remains the dominant paradigm for optimizing deep neural networks, but its efficiency deteriorates as models grow deeper. Since every block must be executed and differentiated under a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Yuming Zhang , Peizhe Wang , Tianyang Han , Hengyu Shi , Junhao Su , Dongzhi Guan , Jiabin Liu , Jiaji Wang

Training recurrent neural networks (RNNs) with backpropagation through time (BPTT) has known drawbacks such as being difficult to capture longterm dependencies in sequences. Successful alternatives to BPTT have not yet been discovered.…

Machine Learning · Computer Science 2022-06-06 Fangxin Shang , Hao Zhang

Truncated Backpropagation Through Time (truncated BPTT) is a widespread method for learning recurrent computational graphs. Truncated BPTT keeps the computational benefits of Backpropagation Through Time (BPTT) while relieving the need for…

Neural and Evolutionary Computing · Computer Science 2017-05-24 Corentin Tallec , Yann Ollivier

Truncated backpropagation through time (TBPTT) is a popular method for learning in recurrent neural networks (RNNs) that saves computation and memory at the cost of bias by truncating backpropagation after a fixed number of lags. In…

Machine Learning · Computer Science 2019-07-03 Christopher Aicher , Nicholas J. Foti , Emily B. Fox

Despite all the impressive advances of recurrent neural networks, sequential data is still in need of better modelling. Truncated backpropagation through time (TBPTT), the learning algorithm most widely used in practice, suffers from the…

Machine Learning · Computer Science 2018-12-07 Asier Mujika , Florian Meier , Angelika Steger

One of the central goals of Recurrent Neural Networks (RNNs) is to learn long-term dependencies in sequential data. Nevertheless, the most popular training method, Truncated Backpropagation through Time (TBPTT), categorically forbids…

Machine Learning · Computer Science 2019-05-20 Frederik Benzing , Marcelo Matheus Gauy , Asier Mujika , Anders Martinsson , Angelika Steger

Biological neural networks are equipped with an inherent capability to continuously adapt through online learning. This aspect remains in stark contrast to learning with error backpropagation through time (BPTT) applied to recurrent neural…

Machine Learning · Computer Science 2020-10-09 Thomas Bohnstingl , Stanisław Woźniak , Wolfgang Maass , Angeliki Pantazi , Evangelos Eleftheriou