English
Related papers

Related papers: Learning to walk in confined spaces using 3D repre…

200 papers

In this work, we develop an automated method to generate 3D human walking motion in simulation which is comparable to real-world human motion. At the core, our work leverages the ability of deep reinforcement learning methods to learn…

Robotics · Computer Science 2021-03-16 Visak Kumar

Developing robust walking controllers for bipedal robots is a challenging endeavor. Traditional model-based locomotion controllers require simplifying assumptions and careful modelling; any small errors can result in unstable control. To…

Robotics · Computer Science 2021-03-29 Zhongyu Li , Xuxin Cheng , Xue Bin Peng , Pieter Abbeel , Sergey Levine , Glen Berseth , Koushil Sreenath

This work introduces a hierarchical strategy for terrain-aware bipedal locomotion that integrates reduced-dimensional perceptual representations to enhance reinforcement learning (RL)-based high-level (HL) policies for real-time gait…

Robotics · Computer Science 2025-12-16 Guillermo A. Castillo , Himanshu Lodha , Ayonga Hereid

Legged robots leverage ground contacts and the reaction forces they provide to achieve agile locomotion. However, uncertainty coupled with contact discontinuities can lead to failure, especially in real-world environments with unexpected…

Robotics · Computer Science 2023-09-11 Yanhao Yang , Joseph Norby , Justin K. Yim , Aaron M. Johnson

Quadrupedal robots have played a crucial role in various environments, from structured environments to complex harsh terrains, thanks to their agile locomotion ability. However, these robots can easily lose their locomotion functionality if…

Robotics · Computer Science 2024-03-04 Mincheol Kim , Ukcheol Shin , Jung-Yup Kim

Wheeled-legged robots have the potential for highly agile and versatile locomotion. The combination of legs and wheels might be a solution for any real-world application requiring rapid, and long-distance mobility skills on challenging…

Robotics · Computer Science 2020-02-07 Marko Bjelonic , Prajish K. Sankar , C. Dario Bellicoso , Heike Vallery , Marco Hutter

Planetary exploration missions require robots capable of navigating extreme and unknown environments. While wheeled rovers have dominated past missions, their mobility is limited to traversable surfaces. Legged robots, especially…

There has been an increasing interest in 3D indoor navigation, where a robot in an environment moves to a target according to an instruction. To deploy a robot for navigation in the physical world, lots of training data is required to learn…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Fengda Zhu , Linchao Zhu , Yi Yang

Moving in dynamic pedestrian environments is one of the important requirements for autonomous mobile robots. We present a model-based reinforcement learning approach for robots to navigate through crowded environments. The navigation policy…

Robotics · Computer Science 2020-11-10 Yuxiang Cui , Haodong Zhang , Yue Wang , Rong Xiong

We present a model-based framework for robot locomotion that achieves walking based on only 4.5 minutes (45,000 control steps) of data collected on a quadruped robot. To accurately model the robot's dynamics over a long horizon, we…

Machine Learning · Computer Science 2019-10-08 Yuxiang Yang , Ken Caluwaerts , Atil Iscen , Tingnan Zhang , Jie Tan , Vikas Sindhwani

Legged locomotion enables robotic systems to traverse extremely challenging terrains. In many real-world scenarios, the terrain is not that difficult and these mixed terrain types introduce the need for flexible use of different walking…

Quadruped robots face limitations in long-range navigation efficiency due to their reliance on legs. To ameliorate the limitations, we introduce a Reinforcement Learning-based Active Transporter Riding method (\textit{RL-ATR}), inspired by…

Robotics · Computer Science 2026-02-10 Minsung Yoon , Sung-Eui Yoon

Legged machines are becoming increasingly agile and adaptive but they have so far lacked the morphological diversity of legged animals, which have been rearranged and reshaped to fill millions of niches. Unlike their biological…

Robotics · Computer Science 2026-03-02 Chen Yu , David Matthews , Jingxian Wang , Jing Gu , Douglas Blackiston , Michael Rubenstein , Sam Kriegman

Bipedal locomotion is a key challenge in robotics, particularly for robots like Bolt, which have a point-foot design. This study explores the control of such underactuated robots using constrained reinforcement learning, addressing their…

Dynamic locomotion of legged robots is a critical yet challenging topic in expanding the operational range of mobile robots. It requires precise planning when possible footholds are sparse, robustness against uncertainties and disturbances,…

Robotics · Computer Science 2025-06-12 Junzhe He , Chong Zhang , Fabian Jenelten , Ruben Grandia , Moritz BÄcher , Marco Hutter

Teaching robots to learn diverse locomotion skills under complex three-dimensional environmental settings via Reinforcement Learning (RL) is still challenging. It has been shown that training agents in simple settings before moving them on…

Robotics · Computer Science 2022-06-15 Fangqin Zhou , Joaquin Vanschoren

Developing agile behaviors for legged robots remains a challenging problem. While deep reinforcement learning is a promising approach, learning truly agile behaviors typically requires tedious reward shaping and careful curriculum design.…

Robotics · Computer Science 2020-11-12 Atil Iscen , George Yu , Alejandro Escontrela , Deepali Jain , Jie Tan , Ken Caluwaerts

Legged robots have shown remarkable advantages in navigating uneven terrain. However, realizing effective locomotion and manipulation tasks on quadruped robots is still challenging. In addition, object and terrain parameters are generally…

Robotics · Computer Science 2023-03-14 Mohsen Sombolestan , Quan Nguyen

Previous studies have successfully demonstrated agile and robust locomotion in challenging terrains for quadrupedal robots. However, the bipedal locomotion mode for quadruped robots remains unverified. This paper explores the adaptation of…

Deep Reinforcement Learning (DRL) controllers for quadrupedal locomotion have demonstrated impressive performance on challenging terrains, allowing robots to execute complex skills such as climbing, running, and jumping. However, existing…

Robotics · Computer Science 2025-09-30 Yinzhao Dong , Ji Ma , Liu Zhao , Wanyue Li , Peng Lu