English
Related papers

Related papers: APEX: Learning Adaptive High-Platform Traversal fo…

200 papers

Reinforcement learning (RL) has made significant strides in legged robot control, enabling locomotion across diverse terrains and complex loco-manipulation capabilities. However, the commonly used position or velocity tracking-based…

Robotics · Computer Science 2025-05-20 Botian Xu , Haoyang Weng , Qingzhou Lu , Yang Gao , Huazhe Xu

This work presents a hierarchical framework for bipedal locomotion that combines a Reinforcement Learning (RL)-based high-level (HL) planner policy for the online generation of task space commands with a model-based low-level (LL)…

Robotics · Computer Science 2023-09-28 Guillermo A. Castillo , Bowen Weng , Shunpeng Yang , Wei Zhang , Ayonga Hereid

Realizing bipedal locomotion on humanoid robots with point feet is especially challenging due to their highly underactuated nature, high degrees of freedom, and hybrid dynamics resulting from impacts. With the goal of addressing this…

Robotics · Computer Science 2024-06-21 Adrian B. Ghansah , Jeeseop Kim , Kejun Li , Aaron D. Ames

Learning controllers that reproduce legged locomotion in nature has been a long-time goal in robotics and computer graphics. While yielding promising results, recent approaches are not yet flexible enough to be applicable to legged systems…

Robotics · Computer Science 2022-07-26 Daniel Ordonez-Apraez , Antonio Agudo , Francesc Moreno-Noguer , Mario Martin

Traversing risky terrains with sparse footholds presents significant challenges for legged robots, requiring precise foot placement in safe areas. To acquire comprehensive exteroceptive information, prior studies have employed motion…

Robotics · Computer Science 2025-03-04 Ruiqi Yu , Qianshi Wang , Yizhen Wang , Zhicheng Wang , Jun Wu , Qiuguo Zhu

Bipedal locomotion makes humanoid robots inherently prone to falls, causing catastrophic damage to the expensive sensors, actuators, and structural components of full-scale robots. To address this critical barrier to real-world deployment,…

Robotics · Computer Science 2025-11-25 Ziyu Meng , Tengyu Liu , Le Ma , Yingying Wu , Ran Song , Wei Zhang , Siyuan Huang

Simulation-based reinforcement learning (RL) has significantly advanced humanoid locomotion tasks, yet direct real-world RL from scratch or adapting from pretrained policies remains rare, limiting the full potential of humanoid robots.…

Robotics · Computer Science 2025-08-27 Kaizhe Hu , Haochen Shi , Yao He , Weizhuo Wang , C. Karen Liu , Shuran Song

Legged robots navigating crowded scenes and complex terrains in the real world are required to execute dynamic leg movements while processing visual input for obstacle avoidance and path planning. We show that a quadruped robot can acquire…

Robotics · Computer Science 2020-12-01 Deepali Jain , Atil Iscen , Ken Caluwaerts

Humanoid robots can, in principle, use their legs to go almost anywhere. Developing controllers capable of traversing diverse terrains, however, remains a considerable challenge. Classical controllers are hard to generalize broadly while…

Robotics · Computer Science 2024-10-07 Ilija Radosavovic , Sarthak Kamat , Trevor Darrell , Jitendra Malik

Legged robots are becoming increasingly powerful and popular in recent years for their potential to bring the mobility of autonomous agents to the next level. This work presents a deep reinforcement learning approach that learns a robust…

Robotics · Computer Science 2021-09-10 Zhaocheng Liu , Fernando Acero , Zhibin Li

Optimal Control for legged robots has gone through a paradigm shift from position-based to torque-based control, owing to the latter's compliant and robust nature. In parallel to this shift, the community has also turned to Deep…

Robotics · Computer Science 2024-09-04 Shivam Sood , Ge Sun , Peizhuo Li , Guillaume Sartoretti

Legged robots have shown remarkable advantages in navigating uneven terrain. However, realizing effective locomotion and manipulation tasks on quadruped robots is still challenging. In addition, object and terrain parameters are generally…

Robotics · Computer Science 2023-03-14 Mohsen Sombolestan , Quan Nguyen

In this paper, with a view toward deployment of light-weight control frameworks for bipedal walking robots, we realize end-foot trajectories that are shaped by a single linear feedback policy. We learn this policy via a model-free and a…

Developing agile behaviors for legged robots remains a challenging problem. While deep reinforcement learning is a promising approach, learning truly agile behaviors typically requires tedious reward shaping and careful curriculum design.…

Robotics · Computer Science 2020-11-12 Atil Iscen , George Yu , Alejandro Escontrela , Deepali Jain , Jie Tan , Ken Caluwaerts

We present a method for training reference-guided, perceptive reinforcement learning locomotion policies for humanoid robots in which reference trajectories are modulated in training to be consistent with terrain geometry. Aiming to deploy…

Robotics · Computer Science 2026-05-18 William D. Compton , Zachary Olkin , Aaron D. Ames

Bipedal humanoid robots must precisely coordinate balance, timing, and contact decisions when locomoting on constrained footholds such as stepping stones, beams, and planks -- even minor errors can lead to catastrophic failure. Classical…

Robotics · Computer Science 2026-01-13 Min Dai , William D. Compton , Junheng Li , Lizhi Yang , Aaron D. Ames

As humanoid robots enter real-world environments, ensuring robust locomotion across diverse environments is crucial. This paper presents a computationally efficient hierarchical control framework for humanoid robot locomotion based on…

Robotics · Computer Science 2025-09-08 Adrian B. Ghansah , Sergio A. Esteban , Aaron D. Ames

Reliable and stable locomotion has been one of the most fundamental challenges for legged robots. Deep reinforcement learning (deep RL) has emerged as a promising method for developing such control policies autonomously. In this paper, we…

Robotics · Computer Science 2020-11-04 Sehoon Ha , Peng Xu , Zhenyu Tan , Sergey Levine , Jie Tan

Recent advancements in whole-body control through deep reinforcement learning have enabled humanoid robots to achieve remarkable progress in real-world chal lenging locomotion skills. However, existing approaches often struggle with…

Robotics · Computer Science 2026-04-17 Yuen-Fui Lau , Qihan Zhao , Yinhuai Wang , Runyi Yu , Hok Wai Tsui , Qifeng Chen , Ping Tan

Wheeled-legged robots combine the energy efficiency of wheeled locomotion with the terrain adaptability of legged systems, making them promising platforms for agile mobility in complex and dynamic environments. However, enabling…

Robotics · Computer Science 2026-04-28 Yongen Zhao , Zihao Xu , Wenzhi Lu , Zhen Chu , Ce Hao