English
Related papers

Related papers: Recurrent Control Nets for Deep Reinforcement Lear…

200 papers

Neuromorphic computing systems, where information is transmitted through action potentials in a bio-plausible fashion, is gaining increasing interest due to its promise of low-power event-driven computing. Application of neuromorphic…

Neural and Evolutionary Computing · Computer Science 2025-09-03 Zhuangyu Han , Abhronil Sengupta

This paper introduces a new generative deep learning network for human motion synthesis and control. Our key idea is to combine recurrent neural networks (RNNs) and adversarial training for human motion modeling. We first describe an…

Graphics · Computer Science 2018-06-25 Zhiyong Wang , Jinxiang Chai , Shihong Xia

Recurrent Neural Networks (RNNs) are popular models of brain function. The typical training strategy is to adjust their input-output behavior so that it matches that of the biological circuit of interest. Even though this strategy ensures…

Neurons and Cognition · Quantitative Biology 2020-11-09 Alessandro Salatiello , Martin A. Giese

Deep Reinforcement Learning has enabled the learning of policies for complex tasks in partially observable environments, without explicitly learning the underlying model of the tasks. While such model-free methods achieve considerable…

Machine Learning · Computer Science 2017-01-11 Tanmay Shankar , Santosha K. Dwivedy , Prithwijit Guha

It is widely accepted that the complex dynamics characteristic of recurrent neural circuits contributes in a fundamental manner to brain function. Progress has been slow in understanding and exploiting the computational power of recurrent…

Chaotic Dynamics · Physics 2013-07-18 Rodrigo Laje , Dean V. Buonomano

This paper introduces Graph Convolutional Recurrent Network (GCRN), a deep learning model able to predict structured sequences of data. Precisely, GCRN is a generalization of classical recurrent neural networks (RNN) to data structured by…

Machine Learning · Statistics 2016-12-23 Youngjoo Seo , Michaël Defferrard , Pierre Vandergheynst , Xavier Bresson

Inspired by biological motion generation, central pattern generators (CPGs) is frequently employed in legged robot locomotion control to produce natural gait pattern with low-dimensional control signals. However, the limited adaptability…

Robotics · Computer Science 2023-10-13 Qiyue Yang , Yue Gao , Shaoyuan Li

Owing to their superior modeling capabilities, gated Recurrent Neural Networks, such as Gated Recurrent Units (GRUs) and Long Short-Term Memory networks (LSTMs), have become popular tools for learning dynamical systems. This paper aims to…

Machine Learning · Computer Science 2022-03-18 Fabio Bonassi , Riccardo Scattolini

In this letter, we present a method for integrating central pattern generators (CPGs), i.e. systems of coupled oscillators, into the deep reinforcement learning (DRL) framework to produce robust and omnidirectional quadruped locomotion. The…

Robotics · Computer Science 2022-11-02 Guillaume Bellegarda , Auke Ijspeert

Animals possess a remarkable ability to navigate challenging terrains, achieved through the interplay of various pathways between the brain, central pattern generators (CPGs) in the spinal cord, and musculoskeletal system. Traditional…

Robotics · Computer Science 2024-04-30 Ge Sun , Milad Shafiee , Peizhuo Li , Guillaume Bellegarda , Auke Ijspeert , Guillaume Sartoretti

Neural circuits in the brain perform a variety of essential functions, including input classification, pattern completion, and the generation of rhythms and oscillations that support processes such as breathing and locomotion. There is also…

Neurons and Cognition · Quantitative Biology 2024-10-16 Juliana Londono Alvarez

Recurrent Neural Networks (RNNs) are among the most successful machine learning models for sequence modelling, but tend to suffer from an exponential increase in the number of parameters when dealing with large multidimensional data. To…

Machine Learning · Computer Science 2021-05-12 Yao Lei Xu , Danilo P. Mandic

Learning to walk -- i.e., learning locomotion under performance and energy constraints continues to be a challenge in legged robotics. Methods such as stochastic gradient, deep reinforcement learning (RL) have been explored for bipeds,…

Neural and Evolutionary Computing · Computer Science 2020-03-24 Ashwin Sanjay Lele , Yan Fang , Justin Ting , Arijit Raychowdhury

Temporal models based on recurrent neural networks have proven to be quite powerful in a wide variety of applications. However, training these models often relies on back-propagation through time, which entails unfolding the network over…

Neural and Evolutionary Computing · Computer Science 2019-08-13 Alexander Ororbia , Ankur Mali , C. Lee Giles , Daniel Kifer

The pharmaceutical industry has witnessed exponential growth in transforming operations towards continuous manufacturing to effectively achieve increased profitability, reduced waste, and extended product range. Model Predictive Control…

Systems and Control · Computer Science 2018-07-26 Wee Chin Wong , Jiali Li , Xiaonan Wang

Legged locomotion is a challenging task in the field of robotics but a rather simple one in nature. This motivates the use of biological methodologies as solutions to this problem. Central pattern generators are neural networks that are…

Neural and Evolutionary Computing · Computer Science 2020-03-18 Elie Aljalbout , Florian Walter , Florian Röhrbein , Alois Knoll

Central Pattern Generators (CPGs) in invertebrates are comprised of networks of neurons in which every neuron has reciprocal connections to other members of the CPG. This is a ``closed'' network topology. An ``open'' topology, where one or…

chao-dyn · Physics 2007-05-23 R. Huerta , P. Varona , M. I. Rabinovich , Henry D. I. Abarbanel

We propose a framework based on Recurrent Neural Networks (RNNs) to determine an optimal control strategy for a discrete-time system that is required to satisfy specifications given as Signal Temporal Logic (STL) formulae. RNNs can store…

Systems and Control · Electrical Eng. & Systems 2020-09-25 Wenliang Liu , Noushin Mehdipour , Calin Belta

Recurrent neural networks (RNNs) for reinforcement learning (RL) have shown distinct advantages, e.g., solving memory-dependent tasks and meta-learning. However, little effort has been spent on improving RNN architectures and on…

Machine Learning · Computer Science 2019-11-27 Dongqi Han , Kenji Doya , Jun Tani

We present a model of the central pattern generator (CPG) network that can control gait transitions in hexapod robots in a simple manner based on phase reduction. The CPG network consists of six weakly coupled limit-cycle oscillators, whose…

Adaptation and Self-Organizing Systems · Physics 2025-06-18 Norihisa Namura , Hiroya Nakao