English
Related papers

Related papers: Traversing Narrow Paths: A Two-Stage Reinforcement…

200 papers

Robot navigation is a task where reinforcement learning approaches are still unable to compete with traditional path planning. State-of-the-art methods differ in small ways, and do not all provide reproducible, openly available…

Robotics · Computer Science 2020-12-09 Daniel Dugas , Juan Nieto , Roland Siegwart , Jen Jen Chung

Bipedal robots demonstrate potential in navigating challenging terrains through dynamic ground contact. However, current frameworks often depend solely on proprioception or use manually designed visual pipelines, which are fragile in…

Robotics · Computer Science 2025-08-12 Minku Kim , Brian Acosta , Pratik Chaudhari , Michael Posa

During learning trials, systems are exposed to different failure conditions which may break robotic parts before a safe behavior is discovered. Humans contour this problem by grounding their learning to a safer structure/control first and…

Robotics · Computer Science 2021-04-06 Keyan Zhai , Chu'an Li , Andre Rosendo

Navigating fluently around pedestrians is a necessary capability for mobile robots deployed in human environments, such as buildings and homes. While research on social navigation has focused mainly on the scalability with the number of…

Humanoid robots, with their human-like skeletal structure, are especially suited for tasks in human-centric environments. However, this structure is accompanied by additional challenges in locomotion controller design, especially in complex…

Robotics · Computer Science 2024-08-27 Xinyang Gu , Yen-Jen Wang , Xiang Zhu , Chengming Shi , Yanjiang Guo , Yichen Liu , Jianyu Chen

Dynamic bipedal walking on discrete terrain, like stepping stones, is a challenging problem requiring feedback controllers to enforce safety-critical constraints. To enforce such constraints in real-world experiments, fast and accurate…

Robotics · Computer Science 2017-12-05 Avinash Siravuru , Allan Wang , Quan Nguyen , Koushil Sreenath

Humanoid robots are made to resemble humans but their locomotion abilities are far from ours in terms of agility and versatility. When humans walk on complex terrains, or face external disturbances, they combine a set of strategies,…

Robotics · Computer Science 2021-10-28 Mohammadreza Kasaei , Miguel Abreu , Nuno Lau , Artur Pereira , Luis Paulo Reis

Pedipulation leverages the feet of legged robots for mobile manipulation, eliminating the need for dedicated robotic arms. While previous works have showcased blind and task-specific pedipulation skills, they fail to account for static and…

Robotics · Computer Science 2024-11-05 Jonas Stolle , Philip Arm , Mayank Mittal , Marco Hutter

Recent advances of locomotion controllers utilizing deep reinforcement learning (RL) have yielded impressive results in terms of achieving rapid and robust locomotion across challenging terrain, such as rugged rocks, non-rigid ground, and…

Robotics · Computer Science 2024-03-07 Zifan Xu , Amir Hossain Raj , Xuesu Xiao , Peter Stone

The ability for robots to transfer their learned knowledge to new tasks -- where data is scarce -- is a fundamental challenge for successful robot learning. While fine-tuning has been well-studied as a simple but effective transfer approach…

Robotics · Computer Science 2021-08-10 Zhangjie Cao , Minae Kwon , Dorsa Sadigh

Bipedal walking is one of the most important hallmarks of human that robots have been trying to mimic for many decades. Although previous control methodologies have achieved robot walking on some terrains, there is a need for a framework…

Robotics · Computer Science 2025-12-01 Chrysostomos Karakasis , Ioannis Poulakakis , Panagiotis Artemiadis

This work aims to push the limits of agility for bipedal robots by enabling a torque-controlled bipedal robot to perform robust and versatile dynamic jumps in the real world. We present a reinforcement learning framework for training a…

Robotics · Computer Science 2023-06-02 Zhongyu Li , Xue Bin Peng , Pieter Abbeel , Sergey Levine , Glen Berseth , Koushil Sreenath

Robotics would gain by replicating the remarkable agility of arthropods in navigating complex environments. Here we consider the control of multi-legged systems which have 6 or more legs. Current multi-legged control strategies in robots…

Robotics · Computer Science 2026-03-11 Zhuoyang Chen , Xinyuan Wang , Shai Revzen

Achieving robust locomotion on complex terrains remains a challenge due to high dimensional control and environmental uncertainties. This paper introduces a teacher prior framework based on the teacher student paradigm, integrating…

Robotics · Computer Science 2025-06-26 Fangcheng Jin , Yuqi Wang , Peixin Ma , Guodong Yang , Pan Zhao , En Li , Zhengtao Zhang

Deep reinforcement learning (deep RL) holds the promise of automating the acquisition of complex controllers that can map sensory inputs directly to low-level actions. In the domain of robotic locomotion, deep RL could enable learning…

Machine Learning · Computer Science 2019-06-20 Tuomas Haarnoja , Sehoon Ha , Aurick Zhou , Jie Tan , George Tucker , Sergey Levine

There are several challenges in developing a model for multi-tasking humanoid control. Reinforcement learning and imitation learning approaches are quite popular in this domain. However, there is a trade-off between the two. Reinforcement…

Robotics · Computer Science 2024-06-18 Siddharth Padmanabhan , Kazuki Miyazawa , Takato Horii , Takayuki Nagai

Developing robust walking controllers for bipedal robots is a challenging endeavor. Traditional model-based locomotion controllers require simplifying assumptions and careful modelling; any small errors can result in unstable control. To…

Robotics · Computer Science 2021-03-29 Zhongyu Li , Xuxin Cheng , Xue Bin Peng , Pieter Abbeel , Sergey Levine , Glen Berseth , Koushil Sreenath

Reinforcement learning (RL) is effective in many robotic applications, but it requires extensive exploration of the state-action space, during which behaviors can be unsafe. This significantly limits its applicability to large robots with…

Robotics · Computer Science 2026-01-05 Mehdi Heydari Shahna , Pauli Mustalahti , Jouni Mattila

We present a method for humanoid robot walking on partial footholds such as small stepping stones and rocks with sharp surfaces. Our algorithm does not rely on prior knowledge of the foothold, but information about an expected foothold can…

Reinforcement learning has been widely applied to robotic control, but effective policy learning under partial observability remains a major challenge, especially in high-dimensional tasks like humanoid locomotion. To date, no prior work…

Artificial Intelligence · Computer Science 2025-07-28 Wuhao Wang , Zhiyong Chen