English
Related papers

Related papers: Terrain-adaptive Central Pattern Generators with R…

200 papers

Deep reinforcement learning (DRL) has shown remarkable success in simulation domains, yet its application in designing robot controllers remains limited, due to its single-task orientation and insufficient adaptability to environmental…

Robotics · Computer Science 2024-09-20 Yu Tang Liu , Nilaksh Singh , Aamir Ahmad

Enabling bipedal walking robots to learn how to maneuver over highly uneven, dynamically changing terrains is challenging due to the complexity of robot dynamics and interacted environments. Recent advancements in learning from…

Robotics · Computer Science 2023-09-29 Feiyang Wu , Zhaoyuan Gu , Hanran Wu , Anqi Wu , Ye Zhao

This work introduces a hierarchical strategy for terrain-aware bipedal locomotion that integrates reduced-dimensional perceptual representations to enhance reinforcement learning (RL)-based high-level (HL) policies for real-time gait…

Robotics · Computer Science 2025-12-16 Guillermo A. Castillo , Himanshu Lodha , Ayonga Hereid

Humanoid robots have demonstrated robust locomotion capabilities using Reinforcement Learning (RL)-based approaches. Further, to obtain human-like behaviors, existing methods integrate human motion-tracking or motion prior in the RL…

Robotics · Computer Science 2025-06-13 Dewei Wang , Xinmiao Wang , Xinzhe Liu , Jiyuan Shi , Yingnan Zhao , Chenjia Bai , Xuelong Li

Developing robust locomotion controllers for bipedal robots with closed kinematic chains presents unique challenges, particularly since most reinforcement learning (RL) approaches simplify these parallel mechanisms into serial models during…

Robot navigation using deep reinforcement learning (DRL) has shown great potential in improving the performance of mobile robots. Nevertheless, most existing DRL-based navigation methods primarily focus on training a policy that directly…

Robotics · Computer Science 2023-10-23 Wenhao Yu , Jie Peng , Quecheng Qiu , Hanyu Wang , Lu Zhang , Jianmin Ji

Collapsing terrains, often present in search and rescue missions or planetary exploration, pose significant challenges for quadruped robots. This paper introduces a robust locomotion framework for safe navigation over unstable surfaces by…

In recent years, reinforcement learning (RL) based quadrupedal locomotion control has emerged as an extensively researched field, driven by the potential advantages of autonomous learning and adaptation compared to traditional control…

Robotics · Computer Science 2024-10-15 Maurya Gurram , Prakash Kumar Uttam , Shantipal S. Ohol

Curriculum learning allows complex tasks to be mastered via incremental progression over `stepping stone' goals towards a final desired behaviour. Typical implementations learn locomotion policies for challenging environments through…

Neural and Evolutionary Computing · Computer Science 2022-03-30 David Howard , Josh Kannemeyer , Davide Dolcetti , Humphrey Munn , Nicole Robinson

Unknown dynamic load carrying is one important practical application for quadruped robots. Such a problem is non-trivial, posing three major challenges in quadruped locomotion control. First, how to model or represent the dynamics of the…

Robotics · Computer Science 2025-07-11 Leixin Chang , Yuxuan Nai , Hua Chen , Liangjing Yang

Deep reinforcement learning is a promising approach to learning policies in uncontrolled environments that do not require domain knowledge. Unfortunately, due to sample inefficiency, deep RL applications have primarily focused on simulated…

Robotics · Computer Science 2022-08-17 Laura Smith , Ilya Kostrikov , Sergey Levine

Optimizing gait stability for legged robots is a difficult problem. Even on level surfaces, effectively traversing across different textures (e.g., carpet) rests on dynamically tuning parameters in multidimensional space. Inspired by…

Robotics · Computer Science 2022-03-31 Jack Vice , Gita Sukthankar , Pamela K. Douglas

Rhythmic gait patterns in animal locomotion are widely believed to be produced by a central pattern generator (CPG), a network of neurons that drives the muscle groups. In previous papers we have discussed how phase-synchronous signals can…

Dynamical Systems · Mathematics 2025-06-16 Ian Stewart , David Wood

Legged robots are popular candidates for missions in challenging terrains due to the wide variety of locomotion strategies they can employ. Terrain classification is a key enabling technology for autonomous legged robots, as it allows the…

Robotics · Computer Science 2020-11-25 Ahmadreza Ahmadi , Tønnes Nygaard , Navinda Kottege , David Howard , Nicolas Hudson

Data-driven learning based methods have recently been particularly successful at learning robust locomotion controllers for a variety of unstructured terrains. Prior work has shown that incorporating good locomotion priors in the form of…

Neural and Evolutionary Computing · Computer Science 2023-06-23 Shikha Surana , Bryan Lim , Antoine Cully

Biped robots have plenty of benefits over wheeled, quadruped, or hexapod robots due to their ability to behave like human beings in tough and non-flat environments. Deformable terrain is another challenge for biped robots as it has to deal…

Robotics · Computer Science 2023-06-16 Gaurav Bhardwaj , Soham Dasgupta , N. Sukavanam , R. Balasubramanian

This study presents a novel reinforcement learning (RL)-based control framework aimed at enhancing the safety and robustness of the quadcopter, with a specific focus on resilience to in-flight one propeller failure. Addressing the critical…

Robotics · Computer Science 2025-09-10 Muzaffar Habib , Adnan Maqsood , Adnan Fayyaz ud Din

We present a framework for learning a single policy capable of producing all quadruped gaits and transitions. The framework consists of a policy trained with deep reinforcement learning (DRL) to modulate the parameters of a system of…

Robotics · Computer Science 2024-11-08 Guillaume Bellegarda , Milad Shafiee , Auke Ijspeert

Central Pattern Generators (CPGs) models have been long used to investigate both the neural mechanisms that underlie animal locomotion as well as a tool for robotic research. In this work we propose a spiking CPG neural network and its…

This work reports on developing a deep inverse reinforcement learning method for legged robots terrain traversability modeling that incorporates both exteroceptive and proprioceptive sensory data. Existing works use robot-agnostic…

Robotics · Computer Science 2022-07-08 Lu Gan , Jessy W. Grizzle , Ryan M. Eustice , Maani Ghaffari