English
Related papers

Related papers: Dynamic Bipedal Maneuvers through Sim-to-Real Rein…

200 papers

Generating dynamic motions for legged robots remains a challenging problem. While reinforcement learning has achieved notable success in various legged locomotion tasks, producing highly dynamic behaviors often requires extensive reward…

Robotics · Computer Science 2026-01-01 Dongyun Kang , Min-Gyu Kim , Tae-Gyu Song , Hajun Kim , Sehoon Ha , Hae-Won Park

Teaching an anthropomorphic robot from human example offers the opportunity to impart humanlike qualities on its movement. In this work we present a reinforcement learning based method for teaching a real world bipedal robot to perform…

Learning controllers that reproduce legged locomotion in nature has been a long-time goal in robotics and computer graphics. While yielding promising results, recent approaches are not yet flexible enough to be applicable to legged systems…

Robotics · Computer Science 2022-07-26 Daniel Ordonez-Apraez , Antonio Agudo , Francesc Moreno-Noguer , Mario Martin

Typically, learned robot controllers are trained via relatively unsystematic regimens and evaluated with coarse-grained outcome measures such as average cumulative reward. The typical approach is useful to compare learning algorithms but…

Robotics · Computer Science 2025-07-10 Devin Crowley , Whitney G. Cole , Christina M. Hospodar , Ruiting Shen , Karen E. Adolph , Alan Fern

Multi-legged robots offer enhanced stability in complex terrains, yet autonomously learning natural and robust motions in such environments remains challenging. Drawing inspiration from animals' progressive learning patterns, from simple to…

Robotics · Computer Science 2024-01-24 Yinghui Li , Jinze Wu , Xin Liu , Weizhong Guo , Yufei Xue

Enabling bipedal walking robots to learn how to maneuver over highly uneven, dynamically changing terrains is challenging due to the complexity of robot dynamics and interacted environments. Recent advancements in learning from…

Robotics · Computer Science 2023-09-29 Feiyang Wu , Zhaoyuan Gu , Hanran Wu , Anqi Wu , Ye Zhao

Loco-manipulation of quadrupedal robots has broadened robotic applications, but using legs as manipulators often compromises locomotion, while mounting arms complicates the system. To mitigate this issue, we introduce bipedalism for…

Robotics · Computer Science 2025-07-29 Yuyou Zhang , Radu Corcodel , Ding Zhao

Bipedal walking is one of the most difficult but exciting challenges in robotics. The difficulties arise from the complexity of high-dimensional dynamics, sensing and actuation limitations combined with real-time and computational…

Robotics · Computer Science 2021-06-02 Diego Rodriguez , Sven Behnke

Multi-legged robots offer enhanced stability to navigate complex terrains with their multiple legs interacting with the environment. However, how to effectively coordinate the multiple legs in a larger action exploration space to generate…

Robotics · Computer Science 2025-11-06 Xin Liu , Jinze Wu , Yinghui Li , Chenkun Qi , Yufei Xue , Feng Gao

Recent work on sim-to-real learning for bipedal locomotion has demonstrated new levels of robustness and agility over a variety of terrains. However, that work, and most prior bipedal locomotion work, have not considered locomotion under a…

Robotics · Computer Science 2022-04-12 Jeremy Dao , Kevin Green , Helei Duan , Alan Fern , Jonathan Hurst

Reproducing the diverse and agile locomotion skills of animals has been a longstanding challenge in robotics. While manually-designed controllers have been able to emulate many complex behaviors, building such controllers involves a…

Robotics · Computer Science 2020-07-22 Xue Bin Peng , Erwin Coumans , Tingnan Zhang , Tsang-Wei Lee , Jie Tan , Sergey Levine

In this work, we demonstrate robust walking in the bipedal robot Digit on uneven terrains by just learning a single linear policy. In particular, we propose a new control pipeline, wherein the high-level trajectory modulator shapes the…

This paper presents a novel model-free reinforcement learning (RL) framework to design feedback control policies for 3D bipedal walking. Existing RL algorithms are often trained in an end-to-end manner or rely on prior knowledge of some…

Robotics · Computer Science 2019-10-07 Guillermo A. Castillo , Bowen Weng , Wei Zhang , Ayonga Hereid

This paper presents a curriculum-based reinforcement learning framework for training precise and high-performance jumping policies for the robot `Olympus'. Separate policies are developed for vertical and horizontal jumps, leveraging a…

Robotics · Computer Science 2025-10-29 Jørgen Anker Olsen , Lars Rønhaug Pettersen , Kostas Alexis

Designing control policies for legged locomotion is complex due to the under-actuated and non-continuous robot dynamics. Model-free reinforcement learning provides promising tools to tackle this challenge. However, a major bottleneck of…

Robotics · Computer Science 2022-03-08 Tsung-Yen Yang , Tingnan Zhang , Linda Luu , Sehoon Ha , Jie Tan , Wenhao Yu

Learning highly dynamic behaviors for robots has been a longstanding challenge. Traditional approaches have demonstrated robust locomotion, but the exhibited behaviors lack diversity and agility. They employ approximate models, which lead…

Robotics · Computer Science 2024-02-22 Chong Zhang , Jiapeng Sheng , Tingguang Li , He Zhang , Cheng Zhou , Qingxu Zhu , Rui Zhao , Yizheng Zhang , Lei Han

Humans excel at robust bipedal walking in complex natural environments. In each step, they adequately tune the interaction of biomechanical muscle dynamics and neuronal signals to be robust against uncertainties in ground conditions.…

Legged robots are physically capable of traversing a wide range of challenging environments, but designing controllers that are sufficiently robust to handle this diversity has been a long-standing challenge in robotics. Reinforcement…

Robotics · Computer Science 2021-10-12 Laura Smith , J. Chase Kew , Xue Bin Peng , Sehoon Ha , Jie Tan , Sergey Levine

The ability to recover from an unexpected external perturbation is a fundamental motor skill in bipedal locomotion. An effective response includes the ability to not just recover balance and maintain stability but also to fall in a safe…

Robotics · Computer Science 2022-01-06 Visak Kumar

Legged robots have the potential to become vital in maintenance, home support, and exploration scenarios. In order to interact with and manipulate their environments, most legged robots are equipped with a dedicated robot arm, which means…

Robotics · Computer Science 2024-02-19 Philip Arm , Mayank Mittal , Hendrik Kolvenbach , Marco Hutter