English
Related papers

Related papers: Multi-Gait Learning for Humanoid Robots Using Rein…

200 papers

In reinforcement learning for legged robot locomotion, crafting effective reward strategies is crucial. Pre-defined gait patterns and complex reward systems are widely used to stabilize policy training. Drawing from the natural locomotion…

In recent years, there has been growing interest in developing robots and autonomous systems that can interact with human in a more natural and intuitive way. One of the key challenges in achieving this goal is to enable these systems to…

Robotics · Computer Science 2025-10-29 Ziqi Ma , Changda Tian , Yue Gao

Whole-body humanoid motion represents a fundamental challenge in robotics, requiring balance, coordination, and adaptability to enable human-like behaviors. However, existing methods typically require multiple training samples per motion,…

For the deployment of legged robots in real-world environments, it is essential to develop robust locomotion control methods for challenging terrains that may exhibit unexpected deformability and irregularity. In this paper, we explore the…

Robotics · Computer Science 2025-04-21 Rohan P. Singh , Mitsuharu Morisawa , Mehdi Benallegue , Zhaoming Xie , Fumio Kanehiro

Robot gait optimization is the task of generating an optimal control trajectory under various internal and external constraints. Given the high dimensions of control space, this problem is particularly challenging for multi-legged robots…

Robotics · Computer Science 2020-12-25 Min Jiang , Guokun Chi , Geqiang Pan , Shihui Guo , Kay Chen Tan

Deep generative models have recently shown great promise in imitation learning for motor control. Given enough data, even supervised approaches can do one-shot imitation learning; however, they are vulnerable to cascading failures when the…

Machine Learning · Computer Science 2017-07-17 Ziyu Wang , Josh Merel , Scott Reed , Greg Wayne , Nando de Freitas , Nicolas Heess

High-speed and high-acceleration movements are inherently hard to control. Applying learning to the control of such motions on anthropomorphic robot arms can improve the accuracy of the control but might damage the system. The inherent…

Robotics · Computer Science 2019-04-09 Dieter Büchler , Roberto Calandra , Jan Peters

This paper presents a curriculum-based reinforcement learning framework for training precise and high-performance jumping policies for the robot `Olympus'. Separate policies are developed for vertical and horizontal jumps, leveraging a…

Robotics · Computer Science 2025-10-29 Jørgen Anker Olsen , Lars Rønhaug Pettersen , Kostas Alexis

Humans naturally swing their arms during locomotion to regulate whole-body dynamics, reduce angular momentum, and help maintain balance. Inspired by this principle, we present a limb-level multi-agent reinforcement learning (RL) framework…

Robotics · Computer Science 2025-07-08 Ho Jae Lee , Se Hwan Jeon , Sangbae Kim

This paper presents a hierarchical framework for Deep Reinforcement Learning that acquires motor skills for a variety of push recovery and balancing behaviors, i.e., ankle, hip, foot tilting, and stepping strategies. The policy is trained…

Robotics · Computer Science 2020-02-11 Chuanyu Yang , Kai Yuan , Wolfgang Merkt , Taku Komura , Sethu Vijayakumar , Zhibin Li

Humans and animals are believed to use a very minimal set of trajectories to perform a wide variety of tasks including walking. Our main objective in this paper is two fold 1) Obtain an effective tool to realize these basic motion patterns…

As humanoid robots enter real-world environments, ensuring robust locomotion across diverse environments is crucial. This paper presents a computationally efficient hierarchical control framework for humanoid robot locomotion based on…

Robotics · Computer Science 2025-09-08 Adrian B. Ghansah , Sergio A. Esteban , Aaron D. Ames

Humanoid robots require both robust lower-body locomotion and precise upper-body manipulation. While recent Reinforcement Learning (RL) approaches provide whole-body loco-manipulation policies, they lack precise manipulation with high DoF…

Robotics · Computer Science 2025-03-11 Chenhao Lu , Xuxin Cheng , Jialong Li , Shiqi Yang , Mazeyu Ji , Chengjing Yuan , Ge Yang , Sha Yi , Xiaolong Wang

Stable gait generation is a crucial problem for legged robot locomotion as this impacts other critical performance factors such as, e.g. mobility over an uneven terrain and power consumption. Gait generation stability results from the…

Robotics · Computer Science 2023-07-18 Vyacheslav Kovalev , Anna Shkromada , Henni Ouerdane , Pavel Osinenko

While quadruped robots usually have good stability and load capacity, bipedal robots offer a higher level of flexibility / adaptability to different tasks and environments. A multi-modal legged robot can take the best of both worlds. In…

Robotics · Computer Science 2022-02-25 Chen Yu , Andre Rosendo

For legged robots to match the athletic capabilities of humans and animals, they must not only produce robust periodic walking and running, but also seamlessly switch between nominal locomotion gaits and more specialized transient…

Robotics · Computer Science 2022-07-19 Fangzhou Yu , Ryan Batke , Jeremy Dao , Jonathan Hurst , Kevin Green , Alan Fern

In contrast to quadruped robots that can navigate diverse terrains using a "blind" policy, humanoid robots require accurate perception for stable locomotion due to their high degrees of freedom and inherently unstable morphology. However,…

Robotics · Computer Science 2024-11-22 Junfeng Long , Junli Ren , Moji Shi , Zirui Wang , Tao Huang , Ping Luo , Jiangmiao Pang

This paper introduces a new approach to enhance the robustness of humanoid walking under strong perturbations, such as substantial pushes. Effective recovery from external disturbances requires bipedal robots to dynamically adjust their…

Robotics · Computer Science 2024-11-05 Tobias Egle , Yashuai Yan , Dongheui Lee , Christian Ott

Learning is the basis of both biological and artificial systems when it comes to mimicking intelligent behaviors. From the classical PPO (Proximal Policy Optimization), there is a series of deep reinforcement learning algorithms which are…

Robotics · Computer Science 2025-12-16 Wanru Gong , Xinyi Zheng , Yuan Hui , Zhongjun Li , Weiqiang Wang , Xiaoqing Zhu

Humanoid locomotion has advanced rapidly with deep reinforcement learning (DRL), enabling robust feet-based traversal over uneven terrain. Yet platforms beyond leg length remain largely out of reach because current RL training paradigms…

Robotics · Computer Science 2026-03-09 Yikai Wang , Tingxuan Leng , Changyi Lin , Shiqi Liu , Shir Simon , Bingqing Chen , Jonathan Francis , Ding Zhao