English
Related papers

Related papers: Learning Terrain Aware Bipedal Locomotion via Redu…

200 papers

We present a method for training reference-guided, perceptive reinforcement learning locomotion policies for humanoid robots in which reference trajectories are modulated in training to be consistent with terrain geometry. Aiming to deploy…

Robotics · Computer Science 2026-05-18 William D. Compton , Zachary Olkin , Aaron D. Ames

Representation learning and unsupervised skill discovery can allow robots to acquire diverse and reusable behaviors without the need for task-specific rewards. In this work, we use unsupervised reinforcement learning to learn a latent…

Legged robots are well-suited for navigating terrains inaccessible to wheeled robots, making them ideal for applications in search and rescue or space exploration. However, current control methods often struggle to generalize across…

Robotics · Computer Science 2025-05-19 Nikita Rudin , Junzhe He , Joshua Aurand , Marco Hutter

Humans excel at robust bipedal walking in complex natural environments. In each step, they adequately tune the interaction of biomechanical muscle dynamics and neuronal signals to be robust against uncertainties in ground conditions.…

The robustness of legged locomotion is crucial for quadrupedal robots in challenging terrains. Recently, Reinforcement Learning (RL) has shown promising results in legged locomotion and various methods try to integrate privileged…

Robotics · Computer Science 2023-09-04 Jiyuan Shi , Chenjia Bai , Haoran He , Lei Han , Dong Wang , Bin Zhao , Mingguo Zhao , Xiu Li , Xuelong Li

Legged robots can outperform wheeled machines for most navigation tasks across unknown and rough terrains. For such tasks, visual feedback is a fundamental asset to provide robots with terrain-awareness. However, robust dynamic locomotion…

In recent years, humanoid robots have garnered significant attention from both academia and industry due to their high adaptability to environments and human-like characteristics. With the rapid advancement of reinforcement learning,…

Robotics · Computer Science 2025-03-12 Qiang Zhang , Gang Han , Jingkai Sun , Wen Zhao , Chenghao Sun , Jiahang Cao , Jiaxu Wang , Yijie Guo , Renjing Xu

This paper presents a novel model-free reinforcement learning (RL) framework to design feedback control policies for 3D bipedal walking. Existing RL algorithms are often trained in an end-to-end manner or rely on prior knowledge of some…

Robotics · Computer Science 2019-10-07 Guillermo A. Castillo , Bowen Weng , Wei Zhang , Ayonga Hereid

Data-efficient learning remains a central challenge in autonomous driving due to the high cost and safety risks of large-scale real-world interaction. Although world-model-based reinforcement learning enables policy optimization through…

Robotics · Computer Science 2026-03-10 Jiazhuo Li , Linjiang Cao , Qi Liu , Xi Xiong

Deep reinforcement learning (deep RL) holds the promise of automating the acquisition of complex controllers that can map sensory inputs directly to low-level actions. In the domain of robotic locomotion, deep RL could enable learning…

Machine Learning · Computer Science 2019-06-20 Tuomas Haarnoja , Sehoon Ha , Aurick Zhou , Jie Tan , George Tucker , Sergey Levine

Recently, reinforcement learning has become a promising and polular solution for robot legged locomotion. Compared to model-based control, reinforcement learning based controllers can achieve better robustness against uncertainties of…

Robotics · Computer Science 2023-10-09 Yikai Wang , Zheyuan Jiang , Jianyu Chen

Developing robust vision-guided controllers for quadrupedal robots in complex environments, with various obstacles, dynamical surroundings and uneven terrains, is very challenging. While Reinforcement Learning (RL) provides a promising…

The enhanced mobility brought by legged locomotion empowers quadrupedal robots to navigate through complex and unstructured environments. However, optimizing agile locomotion while accounting for the varying energy costs of traversing…

Although haptic sensing has recently been used for legged robot localization in extreme environments where a camera or LiDAR might fail, the problem of efficiently representing the haptic signatures in a learned prior map is still open.…

Robotics · Computer Science 2023-05-30 Damian Sójka , Michał R. Nowicki , Piotr Skrzypczyński

We propose a new class of deep reinforcement learning (RL) algorithms that model latent representations in hyperbolic space. Sequential decision-making requires reasoning about the possible future consequences of current behavior.…

Machine Learning · Computer Science 2022-10-05 Edoardo Cetin , Benjamin Chamberlain , Michael Bronstein , Jonathan J Hunt

Driving in a dynamic, multi-agent, and complex urban environment is a difficult task requiring a complex decision-making policy. The learning of such a policy requires a state representation that can encode the entire environment. Mid-level…

Machine Learning · Computer Science 2021-12-23 Eshagh Kargar , Ville Kyrki

Wheeled-legged robots combine the efficiency of wheels with the obstacle negotiation of legs, yet many state-of-the-art systems rely on costly actuators and sensors, and fall-recovery is seldom integrated, especially for wheeled-legged…

Robotics · Computer Science 2025-10-29 Jans Solano , Diego Quiroz

Recent advances of locomotion controllers utilizing deep reinforcement learning (RL) have yielded impressive results in terms of achieving rapid and robust locomotion across challenging terrain, such as rugged rocks, non-rigid ground, and…

Robotics · Computer Science 2024-03-07 Zifan Xu , Amir Hossain Raj , Xuesu Xiao , Peter Stone

For full-size humanoid robots, even with recent advances in reinforcement learning-based control, achieving reliable locomotion on complex terrains, such as long staircases, remains challenging. In such settings, limited perception,…

Robotics · Computer Science 2025-12-09 Haolin Song , Hongbo Zhu , Tao Yu , Yan Liu , Mingqi Yuan , Wengang Zhou , Hua Chen , Houqiang Li

Legged robots must adapt their gait to navigate unpredictable environments, a challenge that animals master with ease. However, most deep reinforcement learning (DRL) approaches to quadruped locomotion rely on a fixed gait, limiting…

Robotics · Computer Science 2025-06-24 Joseph Humphreys , Chengxu Zhou