English
Related papers

Related papers: BeamDojo: Learning Agile Humanoid Locomotion on Sp…

200 papers

Reinforcement learning (RL)-based motion imitation methods trained on demonstration data can effectively learn natural and expressive motions with minimal reward engineering but often struggle to generalize to novel environments. We address…

Robotics · Computer Science 2025-09-01 Zewei Zhang , Chenhao Li , Takahiro Miki , Marco Hutter

Humanoids operating in real-world workspaces must frequently execute task-driven, short-range movements to SE(2) target poses. To be practical, these transitions must be fast, robust, and energy efficient. While learning-based locomotion…

Robotics · Computer Science 2026-04-23 Pranay Dugar , Mohitvishnu S. Gadde , Jonah Siekmann , Yesh Godse , Aayam Shrestha , Alan Fern

Effective bipedal locomotion in dynamic environments, such as cluttered indoor spaces or uneven terrain, requires agile and adaptive movement in all directions. This necessitates omnidirectional terrain sensing and a controller capable of…

Robotics · Computer Science 2026-03-18 Mohitvishnu S. Gadde , Pranay Dugar , Ashish Malik , Alan Fern

In reinforcement learning (RL), sparse rewards are a natural way to specify the task to be learned. However, most RL algorithms struggle to learn in this setting since the learning signal is mostly zeros. In contrast, humans are good at…

Hybrid locomotion of wheeled-legged robots has recently attracted increasing attention due to their advantages of combining the agility of legged locomotion and the efficiency of wheeled motion. But along with expanded performance, the…

Robotics · Computer Science 2025-10-14 Jingyuan Sun , Hongyu Ji , Zihan Qu , Chaoran Wang , Mingyu Zhang

Simulation-based reinforcement learning (RL) has significantly advanced humanoid locomotion tasks, yet direct real-world RL from scratch or adapting from pretrained policies remains rare, limiting the full potential of humanoid robots.…

Robotics · Computer Science 2025-08-27 Kaizhe Hu , Haochen Shi , Yao He , Weizhuo Wang , C. Karen Liu , Shuran Song

Reinforcement learning (RL) has shown great potential in enabling quadruped robots to perform agile locomotion. However, directly training policies to simultaneously handle dual extreme challenges, i.e., extreme underactuation and extreme…

Robotics · Computer Science 2025-07-03 Ziang Zheng , Guojian Zhan , Shiqi Liu , Yao Lyu , Tao Zhang , Shengbo Eben Li

This work introduces a model-free reinforcement learning framework that enables various modes of motion (quadruped, tripod, or biped) and diverse tasks for legged robot locomotion. We employ a motion-style reward based on a relaxed…

Robotics · Computer Science 2025-05-12 Gijeong Kim , Yong-Hoon Lee , Hae-Won Park

Safe and real-time navigation is fundamental for humanoid robot applications. However, existing bipedal robot navigation frameworks often struggle to balance computational efficiency with the precision required for stable locomotion. We…

Robotics · Computer Science 2025-06-04 Chengyang Peng , Zhihao Zhang , Shiting Gong , Sankalp Agrawal , Keith A. Redmill , Ayonga Hereid

We present a unified model-based and data-driven approach for quadrupedal planning and control to achieve dynamic locomotion over uneven terrain. We utilize on-board proprioceptive and exteroceptive feedback to map sensory information and…

Robotics · Computer Science 2022-05-13 Siddhant Gangapurwala , Mathieu Geisert , Romeo Orsolino , Maurice Fallon , Ioannis Havoutis

Humanoid robots promise transformative capabilities for industrial and service applications. While recent advances in Reinforcement Learning (RL) yield impressive results in locomotion, manipulation, and navigation, the proposed methods…

Robotics · Computer Science 2025-08-12 Feiyang Wu , Xavier Nal , Jaehwi Jang , Wei Zhu , Zhaoyuan Gu , Anqi Wu , Ye Zhao

Humanoid robots can, in principle, use their legs to go almost anywhere. Developing controllers capable of traversing diverse terrains, however, remains a considerable challenge. Classical controllers are hard to generalize broadly while…

Robotics · Computer Science 2024-10-07 Ilija Radosavovic , Sarthak Kamat , Trevor Darrell , Jitendra Malik

This paper presents a new learning framework that leverages the knowledge from imitation learning, deep reinforcement learning, and control theories to achieve human-style locomotion that is natural, dynamic, and robust for humanoids. We…

Robotics · Computer Science 2021-02-15 Chuanyu Yang , Kai Yuan , Shuai Heng , Taku Komura , Zhibin Li

Jumping constitutes an essential component of quadruped robots' locomotion capabilities, which includes dynamic take-off and adaptive landing. Existing quadrupedal jumping studies mainly focused on the stance and flight phase by assuming a…

Robotics · Computer Science 2025-09-17 Renjie Wang , Shangke Lyu , Xin Lang , Wei Xiao , Donglin Wang

Bipedal robots are gaining global recognition due to their potential applications and advancements in artificial intelligence, particularly through Deep Reinforcement Learning (DRL). While DRL has significantly advanced bipedal locomotion,…

Robotics · Computer Science 2026-01-09 Lingfan Bao , Joseph Humphreys , Tianhu Peng , Chengxu Zhou

Reliable and stable locomotion has been one of the most fundamental challenges for legged robots. Deep reinforcement learning (deep RL) has emerged as a promising method for developing such control policies autonomously. In this paper, we…

Robotics · Computer Science 2020-11-04 Sehoon Ha , Peng Xu , Zhenyu Tan , Sergey Levine , Jie Tan

In this paper, we present a framework rooted in control and planning that enables quadrupedal robots to traverse challenging terrains with discrete footholds using visual feedback. Navigating discrete terrain is challenging for quadrupeds…

Robotics · Computer Science 2022-03-07 Ayush Agrawal , Shuxiao Chen , Akshara Rai , Koushil Sreenath

We tackle the problem of perceptive locomotion in dynamic environments. In this problem, a quadrupedal robot must exhibit robust and agile walking behaviors in response to environmental clutter and moving obstacles. We present a…

Robotics · Computer Science 2023-02-21 Mingyo Seo , Ryan Gupta , Yifeng Zhu , Alexy Skoutnev , Luis Sentis , Yuke Zhu

In this paper, we present a general learning framework for controlling a quadruped robot that can mimic the behavior of real animals and traverse challenging terrains. Our method consists of two steps: an imitation learning step to learn…

Robotics · Computer Science 2023-08-08 Tingguang Li , Yizheng Zhang , Chong Zhang , Qingxu Zhu , Jiapeng sheng , Wanchao Chi , Cheng Zhou , Lei Han

Parkour poses a significant challenge for legged robots, requiring navigation through complex environments with agility and precision based on limited sensory inputs. In this work, we introduce a novel method for training end-to-end visual…

Robotics · Computer Science 2024-09-23 Elliot Chane-Sane , Joseph Amigo , Thomas Flayols , Ludovic Righetti , Nicolas Mansard