English
Related papers

Related papers: Reinforcement Learning Meets Hybrid Zero Dynamics:…

200 papers

This paper presents a novel model-free reinforcement learning (RL) framework to design feedback control policies for 3D bipedal walking. Existing RL algorithms are often trained in an end-to-end manner or rely on prior knowledge of some…

Robotics · Computer Science 2019-10-07 Guillermo A. Castillo , Bowen Weng , Wei Zhang , Ayonga Hereid

In this paper, a hierarchical and robust framework for learning bipedal locomotion is presented and successfully implemented on the 3D biped robot Digit built by Agility Robotics. We propose a cascade-structure controller that combines the…

Robotics · Computer Science 2021-03-30 Guillermo A. Castillo , Bowen Weng , Wei Zhang , Ayonga Hereid

Recent advances in deep reinforcement learning (RL) based techniques combined with training in simulation have offered a new approach to developing robust controllers for legged robots. However, the application of such approaches to real…

Robotics · Computer Science 2023-08-08 Rohan Pratap Singh , Zhaoming Xie , Pierre Gergondet , Fumio Kanehiro

For the deployment of legged robots in real-world environments, it is essential to develop robust locomotion control methods for challenging terrains that may exhibit unexpected deformability and irregularity. In this paper, we explore the…

Robotics · Computer Science 2025-04-21 Rohan P. Singh , Mitsuharu Morisawa , Mehdi Benallegue , Zhaoming Xie , Fumio Kanehiro

This paper presents a comprehensive study on using deep reinforcement learning (RL) to create dynamic locomotion controllers for bipedal robots. Going beyond focusing on a single locomotion skill, we develop a general control solution that…

Robotics · Computer Science 2024-08-27 Zhongyu Li , Xue Bin Peng , Pieter Abbeel , Sergey Levine , Glen Berseth , Koushil Sreenath

Deep reinforcement learning (RL) based controllers for legged robots have demonstrated impressive robustness for walking in different environments for several robot platforms. To enable the application of RL policies for humanoid robots in…

Robotics · Computer Science 2022-11-01 Rohan Pratap Singh , Mehdi Benallegue , Mitsuharu Morisawa , Rafael Cisneros , Fumio Kanehiro

Control of wheeled humanoid locomotion is a challenging problem due to the nonlinear dynamics and under-actuated characteristics of these robots. Traditionally, feedback controllers have been utilized for stabilization and locomotion.…

Robotics · Computer Science 2022-04-08 Donghoon Baek , Amartya Purushottam , Joao Ramos

Motion mimicking, i.e., encouraging the control policy to mimic human motion, facilitates the learning of complex tasks via reinforcement learning (RL) for humanoid robots. Although standard RL frameworks demonstrate impressive locomotion…

Robotics · Computer Science 2026-03-10 Ludwig Chee-Ying Tay , I-Chia Chang , Yan Gu

Humans excel at robust bipedal walking in complex natural environments. In each step, they adequately tune the interaction of biomechanical muscle dynamics and neuronal signals to be robust against uncertainties in ground conditions.…

In recent years, reinforcement learning (RL) based quadrupedal locomotion control has emerged as an extensively researched field, driven by the potential advantages of autonomous learning and adaptation compared to traditional control…

Robotics · Computer Science 2024-10-15 Maurya Gurram , Prakash Kumar Uttam , Shantipal S. Ohol

Controlling a non-statically bipedal robot is challenging due to the complex dynamics and multi-criterion optimization involved. Recent works have demonstrated the effectiveness of deep reinforcement learning (DRL) for simulation and…

Robotics · Computer Science 2021-12-23 Changxin Huang , Guangrun Wang , Zhibo Zhou , Ronghui Zhang , Liang Lin

Knee-less bipedal robots like SLIDER have the advantage of ultra-lightweight legs and improved walking energy efficiency compared to traditional humanoid robots. In this paper, we firstly introduce an improved hardware design of the SLIDER…

Robotics · Computer Science 2025-06-16 Rui Zong , Martin Liang , Yuntian Fang , Ke Wang , Xiaoshuai Chen , Wei Chen , Petar Kormushev

The hybrid zero dynamics (HZD) approach has become a powerful tool for the gait planning and control of bipedal robots. This paper aims to extend the HZD methods to address walking, ambling and trotting behaviors on a quadrupedal robot. We…

Robotics · Computer Science 2019-09-19 Wen-Loong Ma , Kaveh Akbari Hamed , Aaron D. Ames

Bipedal locomotion skills are challenging to develop. Control strategies often use local linearization of the dynamics in conjunction with reduced-order abstractions to yield tractable solutions. In these model-based control strategies, the…

Robotics · Computer Science 2018-07-30 Zhaoming Xie , Glen Berseth , Patrick Clary , Jonathan Hurst , Michiel van de Panne

Recently reinforcement learning (RL) has emerged as a promising approach for quadrupedal locomotion, which can save the manual effort in conventional approaches such as designing skill-specific controllers. However, due to the complex…

Robotics · Computer Science 2021-09-17 Haojie Shi , Bo Zhou , Hongsheng Zeng , Fan Wang , Yueqiang Dong , Jiangyong Li , Kang Wang , Hao Tian , Max Q. -H. Meng

This paper presents a framework that leverages both control theory and machine learning to obtain stable and robust bipedal locomotion without the need for manual parameter tuning. Traditionally, gaits are generated through trajectory…

Robotics · Computer Science 2021-03-31 Maegan Tucker , Noel Csomay-Shanklin , Wen-Loong Ma , Aaron D. Ames

Developing robust locomotion controllers for bipedal robots with closed kinematic chains presents unique challenges, particularly since most reinforcement learning (RL) approaches simplify these parallel mechanisms into serial models during…

Reinforcement learning (RL) controllers have made impressive progress in humanoid locomotion and light-weight object manipulation. However, achieving robust and precise motion control with intense force interaction remains a significant…

Robotics · Computer Science 2026-02-02 Chenhui Dong , Haozhe Xu , Wenhao Feng , Zhipeng Wang , Yanmin Zhou , Yifei Zhao , Bin He

Reinforcement Learning (RL) has witnessed great strides for quadruped locomotion, with continued progress in the reliable sim-to-real transfer of policies. However, it remains a challenge to reuse a policy on another robot, which could save…

Robotics · Computer Science 2022-09-29 He Li , Tingnan Zhang , Wenhao Yu , Patrick M. Wensing

Bipedal walking is one of the most difficult but exciting challenges in robotics. The difficulties arise from the complexity of high-dimensional dynamics, sensing and actuation limitations combined with real-time and computational…

Robotics · Computer Science 2021-06-02 Diego Rodriguez , Sven Behnke
‹ Prev 1 2 3 10 Next ›