English
Related papers

Related papers: Learning Dynamics of RNNs in Closed-Loop Environme…

200 papers

Deep Reinforcement Learning has enabled the learning of policies for complex tasks in partially observable environments, without explicitly learning the underlying model of the tasks. While such model-free methods achieve considerable…

Machine Learning · Computer Science 2017-01-11 Tanmay Shankar , Santosha K. Dwivedy , Prithwijit Guha

We study the learning ability of linear recurrent neural networks with Gradient Descent. We prove the first theoretical guarantee on linear RNNs to learn any stable linear dynamic system using any a large type of loss functions. For an…

Machine Learning · Computer Science 2023-10-24 Lifu Wang , Tianyu Wang , Shengwei Yi , Bo Shen , Bo Hu , Xing Cao

In this study, we investigate the continuous time dynamics of Recurrent Neural Networks (RNNs), focusing on systems with nonlinear activation functions. The objective of this work is to identify conditions under which RNNs exhibit perpetual…

Machine Learning · Computer Science 2025-04-22 Michele Casoni , Tommaso Guidi , Alessandro Betti , Stefano Melacci , Marco Gori

Despite the phenomenal success of deep learning in recent years, there remains a gap in understanding the fundamental mechanics of neural nets. More research is focussed on handcrafting complex and larger networks, and the design decisions…

Machine Learning · Computer Science 2019-04-25 Saurav Basu , Koyel Mukherjee , Shrihari Vasudevan

Recent successes combine reinforcement learning algorithms and deep neural networks, despite reinforcement learning not being widely applied to robotics and real world scenarios. This can be attributed to the fact that current…

Machine Learning · Computer Science 2020-09-01 Vinicius G. Goecks

Understanding how animals learn is a central challenge in neuroscience, with growing relevance to the development of animal- or human-aligned artificial intelligence. However, existing approaches tend to assume fixed parametric forms for…

Machine Learning · Computer Science 2026-02-06 Yuhan Helena Liu , Victor Geadah , Jonathan Pillow

Recurrent meta reinforcement learning (meta-RL) agents are agents that employ a recurrent neural network (RNN) for the purpose of "learning a learning algorithm". After being trained on a pre-specified task distribution, the learned weights…

Machine Learning · Computer Science 2021-05-03 Safa Alver , Doina Precup

Recurrent neural networks (RNNs) are powerful constructs capable of modeling complex systems, up to and including Turing Machines. However, learning such complex models from finite training sets can be difficult. In this paper we…

Machine Learning · Statistics 2018-10-23 John Clemens

Neural network modules conditioned by known priors can be effectively trained and combined to represent systems with nonlinear dynamics. This work explores a novel formulation for data-efficient learning of deep control-oriented nonlinear…

Dynamical Systems · Mathematics 2021-01-07 Elliott Skomski , Soumya Vasisht , Colby Wight , Aaron Tuor , Jan Drgona , Draguna Vrabie

To be effective in sequential data processing, Recurrent Neural Networks (RNNs) are required to keep track of past events by creating memories. While the relation between memories and the network's hidden state dynamics was established over…

Machine Learning · Computer Science 2019-09-17 Doron Haviv , Alexander Rivkind , Omri Barak

Spiking activity of neurons engaged in learning and performing a task show complex spatiotemporal dynamics. While the output of recurrent network models can learn to perform various tasks, the possible range of recurrent dynamics that…

Neurons and Cognition · Quantitative Biology 2018-08-21 Christopher Kim , Carson Chow

It is widely accepted that the complex dynamics characteristic of recurrent neural circuits contributes in a fundamental manner to brain function. Progress has been slow in understanding and exploiting the computational power of recurrent…

Chaotic Dynamics · Physics 2013-07-18 Rodrigo Laje , Dean V. Buonomano

Despite their success in massive engineering applications, deep neural networks are vulnerable to various perturbations due to their black-box nature. Recent study has shown that a deep neural network can misclassify the data even if the…

Machine Learning · Computer Science 2021-04-29 Zhuotong Chen , Qianxiao Li , Zheng Zhang

Consider an unknown nonlinear dynamical system that is known to be dissipative. The objective of this paper is to learn a neural dynamical model that approximates this system, while preserving the dissipativity property in the model. In…

Machine Learning · Computer Science 2024-04-09 Yuezhu Xu , S. Sivaranjani

In this paper, we introduce a novel architecture to connecting adaptive learning and neural networks into an arbitrary machine's control system paradigm. Two consecutive Recurrent Neural Networks (RNNs) are used together to accurately model…

Machine Learning · Computer Science 2020-02-26 Srikanth Chandar , Harsha Sunder

Recurrent neural networks (RNNs) have yielded promising results for both recognizing objects in challenging conditions and modeling aspects of primate vision. However, the representational dynamics of recurrent computations remain poorly…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Sushrut Thorat , Adrien Doerig , Tim C. Kietzmann

The study of Deep Network (DN) training dynamics has largely focused on the evolution of the loss function, evaluated on or around train and test set data points. In fact, many DN phenomenon were first introduced in literature with that…

Machine Learning · Computer Science 2023-10-23 Ahmed Imtiaz Humayun , Randall Balestriero , Richard Baraniuk

Task-based modeling with recurrent neural networks (RNNs) has emerged as a popular way to infer the computational function of different brain regions. These models are quantitatively assessed by comparing the low-dimensional neural…

Neurons and Cognition · Quantitative Biology 2019-12-06 Niru Maheswaranathan , Alex H. Williams , Matthew D. Golub , Surya Ganguli , David Sussillo

Recurrent neural network-based reinforcement learning systems are capable of complex motor control tasks such as locomotion and manipulation, however, much of their underlying mechanisms still remain difficult to interpret. Our aim is to…

Robotics · Computer Science 2023-06-29 Eugene R. Rush , Christoffer Heckman , Kaushik Jayaram , J. Sean Humbert

Advancements in artificial intelligence call for a deeper understanding of the fundamental mechanisms underlying deep learning. In this work, we propose a theoretical framework to analyze learning dynamics through the lens of dynamical…

Machine Learning · Computer Science 2025-10-13 Yuchen Lin , Yong Zhang , Sihan Feng , Hong Zhao