English
Related papers

Related papers: SoloParkour: Constrained Reinforcement Learning fo…

200 papers

Safe reinforcement learning (RL) aims to learn policies that satisfy certain constraints before deploying them to safety-critical applications. Previous primal-dual style approaches suffer from instability issues and lack optimality…

Machine Learning · Computer Science 2022-06-20 Zuxin Liu , Zhepeng Cen , Vladislav Isenbaev , Wei Liu , Zhiwei Steven Wu , Bo Li , Ding Zhao

This work explores the potential of using differentiable simulation for learning quadruped locomotion. Differentiable simulation promises fast convergence and stable training by computing low-variance first-order gradients using robot…

Robotics · Computer Science 2024-10-16 Yunlong Song , Sangbae Kim , Davide Scaramuzza

Stable locomotion in precipitous environments is an essential task for quadruped robots, requiring the ability to resist various external disturbances. Recent neural policies enhance robustness against disturbances by learning to resist…

Robotics · Computer Science 2024-06-13 Junfeng Long , Wenye Yu , Quanyi Li , Zirui Wang , Dahua Lin , Jiangmiao Pang

Model-free reinforcement learning is a promising approach for autonomously solving challenging robotics control problems, but faces exploration difficulty without information of the robot's kinematics and dynamics morphology. The…

In recent years, the growing demand for more intelligent service robots is pushing the development of mobile robot navigation algorithms to allow safe and efficient operation in a dense crowd. Reinforcement learning (RL) approaches have…

Robotics · Computer Science 2024-10-28 Keyu Li , Ye Lu , Max Q. -H. Meng

Traversing risky terrains with sparse footholds poses a significant challenge for humanoid robots, requiring precise foot placements and stable locomotion. Existing learning-based approaches often struggle on such complex terrains due to…

Robotics · Computer Science 2025-04-29 Huayi Wang , Zirui Wang , Junli Ren , Qingwei Ben , Tao Huang , Weinan Zhang , Jiangmiao Pang

Traversing 3-D complex environments has always been a significant challenge for legged locomotion. Existing methods typically rely on external sensors such as vision and lidar to preemptively react to obstacles by acquiring environmental…

Robotics · Computer Science 2024-07-16 Yi Cheng , Hang Liu , Guoping Pan , Linqi Ye , Houde Liu , Bin Liang

Recent work has shown results on learning navigation policies for idealized cylinder agents in simulation and transferring them to real wheeled robots. Deploying such navigation policies on legged robots can be challenging due to their…

Robotics · Computer Science 2021-09-14 Joanne Truong , Denis Yarats , Tianyu Li , Franziska Meier , Sonia Chernova , Dhruv Batra , Akshara Rai

Learning locomotion skills is a challenging problem. To generate realistic and smooth locomotion, existing methods use motion capture, finite state machines or morphology-specific knowledge to guide the motion generation algorithms. Deep…

Machine Learning · Computer Science 2018-05-15 Wenhao Yu , Greg Turk , C. Karen Liu

Recent advancements in legged locomotion research have made legged robots a preferred choice for navigating challenging terrains when compared to their wheeled counterparts. This paper presents a novel locomotion policy, trained using Deep…

Robotics · Computer Science 2023-05-04 Lokesh Kumar , Sarvesh Sortee , Titas Bera , Ranjan Dasgupta

Controlling Wheeled-legged robots is challenging especially on slippery surfaces due to their dependence on continuous ground contact. Unlike quadrupeds or bipeds, which can leverage multiple fixed contact points for recovery,…

Robotics · Computer Science 2025-08-05 Bo Peng , Donghoon Baek , Qijie Wang , Joao Ramos

The efficacy of reinforcement learning for robot control relies on the tailored integration of task-specific priors and heuristics for effective exploration, which challenges their straightforward application to complex tasks and…

Robotics · Computer Science 2024-09-20 Lokesh Krishna , Nikhil Sobanbabu , Quan Nguyen

Quadruped robots must exhibit robust walking capabilities in practical applications. In this work, we propose a novel approach that enables quadruped robots to pass various small obstacles, or "tiny traps". Existing methods often rely on…

Robotics · Computer Science 2024-09-13 Shaoting Zhu , Runhan Huang , Linzhan Mou , Hang Zhao

Jumping poses a significant challenge for quadruped robots, despite being crucial for many operational scenarios. While optimisation methods exist for controlling such motions, they are often time-consuming and demand extensive knowledge of…

Robotics · Computer Science 2026-05-19 Riccardo Bussola , Michele Focchi , Giulio Turrisi , Claudio Semini , Luigi Palopoli

This paper addresses the challenge of active perception within autonomous navigation in complex, unknown environments. Revisiting the foundational principles of active perception, we introduce an end-to-end reinforcement learning framework…

Robotics · Computer Science 2026-02-03 Grzegorz Malczyk , Mihir Kulkarni , Kostas Alexis

Humanoid robots promise transformative capabilities for industrial and service applications. While recent advances in Reinforcement Learning (RL) yield impressive results in locomotion, manipulation, and navigation, the proposed methods…

Robotics · Computer Science 2025-08-12 Feiyang Wu , Xavier Nal , Jaehwi Jang , Wei Zhu , Zhaoyuan Gu , Anqi Wu , Ye Zhao

Teaching robots to learn diverse locomotion skills under complex three-dimensional environmental settings via Reinforcement Learning (RL) is still challenging. It has been shown that training agents in simple settings before moving them on…

Robotics · Computer Science 2022-06-15 Fangqin Zhou , Joaquin Vanschoren

Wheeled-legged robots combine the efficiency of wheels with the obstacle negotiation of legs, yet many state-of-the-art systems rely on costly actuators and sensors, and fall-recovery is seldom integrated, especially for wheeled-legged…

Robotics · Computer Science 2025-10-29 Jans Solano , Diego Quiroz

Although Reinforcement Learning (RL) algorithms have found tremendous success in simulated domains, they often cannot directly be applied to physical systems, especially in cases where there are hard constraints to satisfy (e.g. on safety…

Machine Learning · Computer Science 2020-08-28 Harsh Satija , Philip Amortila , Joelle Pineau

As mobile robots become useful performing everyday tasks in complex real-world environments, they must be able to traverse a range of difficult terrain types such as stairs, stepping stones, gaps, jumps and narrow passages. This work…

Robotics · Computer Science 2023-03-06 Brendan Tidd