English
Related papers

Related papers: CPG-RL: Learning Central Pattern Generators for Qu…

200 papers

Legged robots must adapt their gait to navigate unpredictable environments, a challenge that animals master with ease. However, most deep reinforcement learning (DRL) approaches to quadruped locomotion rely on a fixed gait, limiting…

Robotics · Computer Science 2025-06-24 Joseph Humphreys , Chengxu Zhou

Central pattern generators (CPGs) appear to have evolved multiple times throughout the animal kingdom, indicating that their design imparts a significant evolutionary advantage. Insight into how this design is achieved is hindered by the…

Biological Physics · Physics 2018-09-05 Eve Armstrong

We propose a deep reinforcement learning (DRL) methodology for the tracking, obstacle avoidance, and formation control of nonholonomic robots. By separating vision-based control into a perception module and a controller module, we can train…

Robotics · Computer Science 2019-11-19 Yanlin Zhou , Fan Lu , George Pu , Xiyao Ma , Runhan Sun , Hsi-Yuan Chen , Xiaolin Li , Dapeng Wu

We present a model of the central pattern generator (CPG) network that can control gait transitions in hexapod robots in a simple manner based on phase reduction. The CPG network consists of six weakly coupled limit-cycle oscillators, whose…

Adaptation and Self-Organizing Systems · Physics 2025-06-18 Norihisa Namura , Hiroya Nakao

Central Pattern Generators (CPGs) are biological neural circuits capable of producing coordinated rhythmic outputs in the absence of rhythmic input. As a result, they are responsible for most rhythmic motion in living organisms. This…

Machine Learning · Computer Science 2019-01-21 Vincent Liu , Ademi Adeniji , Nathaniel Lee , Jason Zhao , Mario Srouji

Recently reinforcement learning (RL) has emerged as a promising approach for quadrupedal locomotion, which can save the manual effort in conventional approaches such as designing skill-specific controllers. However, due to the complex…

Robotics · Computer Science 2021-09-17 Haojie Shi , Bo Zhou , Hongsheng Zeng , Fan Wang , Yueqiang Dong , Jiangyong Li , Kang Wang , Hao Tian , Max Q. -H. Meng

This study presents a novel reinforcement learning (RL)-based control framework aimed at enhancing the safety and robustness of the quadcopter, with a specific focus on resilience to in-flight one propeller failure. Addressing the critical…

Robotics · Computer Science 2025-09-10 Muzaffar Habib , Adnan Maqsood , Adnan Fayyaz ud Din

Modular robotics enables the development of versatile and adaptive robotic systems with autonomous reconfiguration. This paper presents a modular robotic system in which each module has independent actuation, battery power, and control,…

Robotics · Computer Science 2025-08-05 Jiayu Ding , Rohit Jakkula , Tom Xiao , Zhenyu Gan

Animal locomotion employs different periodic patterns known as animal gaits. In 1993 Collins and Stewart achieved the characterization in quadrupeds and bipeds by using permutation symmetries groups which impose constrains in the locomotion…

Adaptation and Self-Organizing Systems · Physics 2007-05-23 Horacio Castellini Hilda Cerdeira Lilia Romanelli

The gait generator, which is capable of producing rhythmic signals for coordinating multiple joints, is an essential component in the quadruped robot locomotion control framework. The biological counterpart of the gait generator is the…

Robotics · Computer Science 2024-06-21 Yide Liu , Xiyan Liu , Dongqi Wang , Wei Yang , shaoxing Qu

Spring-based actuators in legged locomotion provide energy-efficiency and improved performance, but increase the difficulty of controller design. While previous work has focused on extensive modeling and simulation to find optimal…

Robotics · Computer Science 2023-08-22 Antonin Raffin , Daniel Seidel , Jens Kober , Alin Albu-Schäffer , João Silvério , Freek Stulp

Intelligent control of soft robots is challenging due to the nonlinear and difficult-to-model dynamics. One promising model-free approach for soft robot control is reinforcement learning (RL). However, model-free RL methods tend to be…

Robotics · Computer Science 2023-07-11 Xuan Liu , Cagdas Onal , Jie Fu

The complexity of bipedal locomotion may be attributed to the difficulty in synchronizing joint movements while at the same time achieving high-level objectives such as walking in a particular direction. Artificial central pattern…

Neural and Evolutionary Computing · Computer Science 2019-09-15 Sayantan Auddy , Sven Magg , Stefan Wermter

Model-free reinforcement learning (RL) for legged locomotion commonly relies on a physics simulator that can accurately predict the behaviors of every degree of freedom of the robot. In contrast, approximate reduced-order models are…

Robotics · Computer Science 2022-02-17 Zhaoming Xie , Xingye Da , Buck Babich , Animesh Garg , Michiel van de Panne

This paper presents a bio-inspired central pattern generator (CPG)-type architecture for learning optimal maneuvering control of periodic locomotory gaits. The architecture is presented here with the aid of a snake robot model problem…

Systems and Control · Electrical Eng. & Systems 2019-10-08 Tixian Wang , Amirhossein Taghvaei , Prashant G. Mehta

State of the art quadrupedal locomotion approaches integrate Model Predictive Control (MPC) with Reinforcement Learning (RL), enabling complex motion capabilities with planning and terrain adaptive behaviors. However, they often face…

Robotics · Computer Science 2026-03-17 Prakrut Kotecha , Aditya Shirwatkar , Shishir Kolathaya

Learning human-like, robust bipedal walking remains difficult due to hybrid dynamics and terrain variability. We propose a lightweight framework that combines a gait generator network learned from human motion with Proximal Policy…

Robotics · Computer Science 2025-11-24 Yusuf Baran Ates , Omer Morgul

Reinforcement learning (RL) has become a promising approach to developing controllers for quadrupedal robots. Conventionally, an RL design for locomotion follows a position-based paradigm, wherein an RL policy outputs target joint positions…

Robotics · Computer Science 2023-03-14 Shuxiao Chen , Bike Zhang , Mark W. Mueller , Akshara Rai , Koushil Sreenath

Locomotion is a crucial challenge for legged robots that is addressed "effortlessly" by biological networks abundant in nature, named central pattern generators (CPG). The multitude of CPG network models that have so far become biomimetic…

Neural and Evolutionary Computing · Computer Science 2020-06-09 Ioannis Polykretis , Konstantinos P. Michmizos

This paper aims to present a stability control strategy for quadruped robot under lateral impact with the help of lateral trot. We firstly propose five necessary conditions for keeping balance. The classical four-neuron Central Pattern…

Robotics · Computer Science 2017-11-22 Qingsheng Luo , Chenyang Zhou , Yan Jia , Jianfeng Gao , Fangzheng Liu