English
Related papers

Related papers: Robust Dynamic Locomotion via Reinforcement Learni…

200 papers

Humans can balance very well during walking, even when perturbed. But it seems difficult to achieve robust walking for bipedal robots. Here we describe the simplest balance controller that leads to robust walking for a linear inverted…

Robotics · Computer Science 2022-11-14 Linqi Ye , Xueqian Wang , Houde Liu , Bin Liang

Humanoid robots, capable of assuming human roles in various workplaces, have become essential to embodied intelligence. However, as robots with complex physical structures, learning a control model that can operate robustly across diverse…

Robotics · Computer Science 2025-05-20 Sixu Lin , Guanren Qiao , Yunxin Tai , Ang Li , Kui Jia , Guiliang Liu

This paper presents a control framework that combines model-based optimal control and reinforcement learning (RL) to achieve versatile and robust legged locomotion. Our approach enhances the RL training process by incorporating on-demand…

Robotics · Computer Science 2024-10-01 Dongho Kang , Jin Cheng , Miguel Zamora , Fatemeh Zargarbashi , Stelian Coros

Autonomous wheeled-legged robots have the potential to transform logistics systems, improving operational efficiency and adaptability in urban environments. Navigating urban environments, however, poses unique challenges for robots,…

Robotics · Computer Science 2024-05-06 Joonho Lee , Marko Bjelonic , Alexander Reske , Lorenz Wellhausen , Takahiro Miki , Marco Hutter

Deep reinforcement learning (deep RL) holds the promise of automating the acquisition of complex controllers that can map sensory inputs directly to low-level actions. In the domain of robotic locomotion, deep RL could enable learning…

Machine Learning · Computer Science 2019-06-20 Tuomas Haarnoja , Sehoon Ha , Aurick Zhou , Jie Tan , George Tucker , Sergey Levine

Humans possess delicate dynamic balance mechanisms that enable them to maintain stability across diverse terrains and under extreme conditions. However, despite significant advances recently, existing locomotion algorithms for humanoid…

Robotics · Computer Science 2025-03-03 Weiji Xie , Chenjia Bai , Jiyuan Shi , Junkai Yang , Yunfei Ge , Weinan Zhang , Xuelong Li

In this paper, a hierarchical and robust framework for learning bipedal locomotion is presented and successfully implemented on the 3D biped robot Digit built by Agility Robotics. We propose a cascade-structure controller that combines the…

Robotics · Computer Science 2021-03-30 Guillermo A. Castillo , Bowen Weng , Wei Zhang , Ayonga Hereid

This work presents a hierarchical framework for bipedal locomotion that combines a Reinforcement Learning (RL)-based high-level (HL) planner policy for the online generation of task space commands with a model-based low-level (LL)…

Robotics · Computer Science 2023-09-28 Guillermo A. Castillo , Bowen Weng , Shunpeng Yang , Wei Zhang , Ayonga Hereid

In this letter, we formulate a novel Markov Decision Process (MDP) for safe and data-efficient learning for humanoid locomotion aided by a dynamic balancing model. In our previous studies of biped locomotion, we relied on a low-dimensional…

Robotics · Computer Science 2020-04-29 Junhyeok Ahn , Jaemin Lee , Luis Sentis

This article presents a motion planning and control framework for flexible robotic manipulators, integrating deep reinforcement learning (DRL) with a nonlinear partial differential equation (PDE) controller. Unlike conventional approaches…

Robotics · Computer Science 2025-06-11 Amir Hossein Barjini , Seyed Adel Alizadeh Kolagar , Sadeq Yaqubi , Jouni Mattila

Developing robust walking controllers for bipedal robots is a challenging endeavor. Traditional model-based locomotion controllers require simplifying assumptions and careful modelling; any small errors can result in unstable control. To…

Robotics · Computer Science 2021-03-29 Zhongyu Li , Xuxin Cheng , Xue Bin Peng , Pieter Abbeel , Sergey Levine , Glen Berseth , Koushil Sreenath

Bipedal walking is one of the most important hallmarks of human that robots have been trying to mimic for many decades. Although previous control methodologies have achieved robot walking on some terrains, there is a need for a framework…

Robotics · Computer Science 2025-12-01 Chrysostomos Karakasis , Ioannis Poulakakis , Panagiotis Artemiadis

Humanoid robots offer significant versatility for performing a wide range of tasks, yet their basic ability to walk and run, especially at high velocities, remains a challenge. This letter presents a novel method that combines deep…

Robotics · Computer Science 2024-10-22 Xinming Zhang , Xianghui Wang , Lerong Zhang , Guodong Guo , Xiaoyu Shen , Wei Zhang

In recent years, reinforcement learning (RL) based quadrupedal locomotion control has emerged as an extensively researched field, driven by the potential advantages of autonomous learning and adaptation compared to traditional control…

Robotics · Computer Science 2024-10-15 Maurya Gurram , Prakash Kumar Uttam , Shantipal S. Ohol

Whole-body humanoid locomotion is challenging due to high-dimensional control, morphological instability, and the need for real-time adaptation to various terrains using onboard perception. Directly applying reinforcement learning (RL) with…

Learning locomotion skills is a challenging problem. To generate realistic and smooth locomotion, existing methods use motion capture, finite state machines or morphology-specific knowledge to guide the motion generation algorithms. Deep…

Machine Learning · Computer Science 2018-05-15 Wenhao Yu , Greg Turk , C. Karen Liu

Control policy learning for modular robot locomotion has previously been limited to proprioceptive feedback and flat terrain. This paper develops policies for modular systems with vision traversing more challenging environments. These…

Robotics · Computer Science 2023-05-02 Julian Whitman , Howie Choset

Humanoid robots that can autonomously operate in diverse environments have the potential to help address labour shortages in factories, assist elderly at homes, and colonize new planets. While classical controllers for humanoid robots have…

Robotics · Computer Science 2023-12-15 Ilija Radosavovic , Tete Xiao , Bike Zhang , Trevor Darrell , Jitendra Malik , Koushil Sreenath

Deep Reinforcement Learning (RL) has emerged as a promising method to develop humanoid robot locomotion controllers. Despite the robust and stable locomotion demonstrated by previous RL controllers, their behavior often lacks the natural…

Robotics · Computer Science 2025-02-06 Qiyuan Zhang , Chenfan Weng , Guanwu Li , Fulai He , Yusheng Cai

A significant challenge for the control of a robotic lower extremity rehabilitation exoskeleton is to ensure stability and robustness during programmed tasks or motions, which is crucial for the safety of the mobility-impaired user. Due to…

Robotics · Computer Science 2021-05-11 S. Luo , G. Androwis , S. Adamovich , H. Su , X. Zhou