English
Related papers

Related papers: Learning Vision-Guided Dynamic Locomotion Over Cha…

200 papers

Reinforcement learning (RL) has emerged as a powerful method to learn robust control policies for bipedal locomotion. Yet, it can be difficult to tune desired robot behaviors due to unintuitive and complex reward design. In comparison,…

Robotics · Computer Science 2026-03-11 Neil Janwani , Varun Madabushi , Maegan Tucker

For legged robots to match the athletic capabilities of humans and animals, they must not only produce robust periodic walking and running, but also seamlessly switch between nominal locomotion gaits and more specialized transient…

Robotics · Computer Science 2022-07-19 Fangzhou Yu , Ryan Batke , Jeremy Dao , Jonathan Hurst , Kevin Green , Alan Fern

Deep reinforcement learning (RL) based controllers for legged robots have demonstrated impressive robustness for walking in different environments for several robot platforms. To enable the application of RL policies for humanoid robots in…

Robotics · Computer Science 2022-11-01 Rohan Pratap Singh , Mehdi Benallegue , Mitsuharu Morisawa , Rafael Cisneros , Fumio Kanehiro

Despite the progress in legged robotic locomotion, autonomous navigation in unknown environments remains an open problem. Ideally, the navigation system utilizes the full potential of the robots' locomotion capabilities while operating…

Robotics · Computer Science 2023-02-15 Jonas Frey , David Hoeller , Shehryar Khattak , Marco Hutter

Developing agile behaviors for legged robots remains a challenging problem. While deep reinforcement learning is a promising approach, learning truly agile behaviors typically requires tedious reward shaping and careful curriculum design.…

Robotics · Computer Science 2020-11-12 Atil Iscen , George Yu , Alejandro Escontrela , Deepali Jain , Jie Tan , Ken Caluwaerts

Robotic systems are nowadays capable of solving complex navigation tasks. However, their capabilities are limited to the knowledge of the designer and consequently lack generalizability to initially unconsidered situations. This makes deep…

Robotics · Computer Science 2022-05-24 Christopher Gebauer , Nils Dengler , Maren Bennewitz

In the current level of evolution of Soccer 3D, motion control is a key factor in team's performance. Recent works takes advantages of model-free approaches based on Machine Learning to exploit robot dynamics in order to obtain faster…

Robotics · Computer Science 2019-10-24 Luckeciano C. Melo , Marcos R. O. A. Maximo

We study the problem of learning a navigation policy for a robot to actively search for an object of interest in an indoor environment solely from its visual inputs. While scene-driven visual navigation has been widely studied, prior…

Artificial Intelligence · Computer Science 2018-07-31 Xin Ye , Zhe Lin , Haoxiang Li , Shibin Zheng , Yezhou Yang

Recent advances in legged locomotion learning are still dominated by the utilization of geometric representations of the environment, limiting the robot's capability to respond to higher-level semantics such as human instructions. To…

Robotics · Computer Science 2026-02-12 I Made Aswin Nahrendra , Seunghyun Lee , Dongkyu Lee , Hyun Myung

In this work we present Deep Reinforcement Learning (DRL) training of directional locomotion for low-cost quadrupedal robots in the real world. In particular, we exploit randomization of heading that the robot must follow to foster…

Robotics · Computer Science 2025-03-17 Peter Böhm , Archie C. Chapman , Pauline Pounds

Legged robot locomotion on a dynamic rigid surface (i.e., a rigid surface moving in the inertial frame) involves complex full-order dynamics that is high-dimensional, nonlinear, and time-varying. Towards deriving an analytically tractable…

Robotics · Computer Science 2022-02-02 Amir Iqbal , Sushant Veer , Yan Gu

Policy gradient methods are an appealing approach in reinforcement learning because they directly optimize the cumulative reward and can straightforwardly be used with nonlinear function approximators such as neural networks. The two main…

Machine Learning · Computer Science 2018-10-23 John Schulman , Philipp Moritz , Sergey Levine , Michael Jordan , Pieter Abbeel

Learning-based grasping can afford real-time grasp motion planning of multi-fingered robotics hands thanks to its high computational efficiency. However, learning-based methods are required to explore large search spaces during the learning…

Robotics · Computer Science 2023-07-25 Yunsik Jung , Lingfeng Tao , Michael Bowman , Jiucai Zhang , Xiaoli Zhang

Autonomous navigation is an essential capability of smart mobility for mobile robots. Traditional methods must have the environment map to plan a collision-free path in workspace. Deep reinforcement learning (DRL) is a promising technique…

Robotics · Computer Science 2019-04-23 Liulong Ma , Yanjie Liu , Jiao Chen , Dong Jin

State estimation for legged locomotion over a dynamic rigid surface (DRS), which is a rigid surface moving in the world frame (e.g., ships, aircraft, and trains), remains an under-explored problem. This paper introduces an invariant…

Robotics · Computer Science 2022-05-17 Yuan Gao , Chengzhi Yuan , Yan Gu

Deep Reinforcement Learning (DRL) is hugely successful due to the availability of realistic simulated environments. However, performance degradation during simulation to real-world transfer still remains a challenging problem for the…

Robotics · Computer Science 2022-05-20 Kasun Weerakoon , Adarsh Jagan Sathyamoorthy , Dinesh Manocha

Humanoid robots have demonstrated robust locomotion capabilities using Reinforcement Learning (RL)-based approaches. Further, to obtain human-like behaviors, existing methods integrate human motion-tracking or motion prior in the RL…

Robotics · Computer Science 2025-06-13 Dewei Wang , Xinmiao Wang , Xinzhe Liu , Jiyuan Shi , Yingnan Zhao , Chenjia Bai , Xuelong Li

We exploit the complementary strengths of vision and proprioception to develop a point-goal navigation system for legged robots, called VP-Nav. Legged systems are capable of traversing more complex terrain than wheeled robots, but to fully…

Robotics · Computer Science 2022-07-26 Zipeng Fu , Ashish Kumar , Ananye Agarwal , Haozhi Qi , Jitendra Malik , Deepak Pathak

Although deep reinforcement learning (DRL) has shown promising results for autonomous navigation in interactive traffic scenarios, existing work typically adopts a fixed behavior policy to control social vehicles in the training…

Robotics · Computer Science 2023-07-20 Kanghoon Lee , Jiachen Li , David Isele , Jinkyoo Park , Kikuo Fujimura , Mykel J. Kochenderfer

Learning locomotion skills is a challenging problem. To generate realistic and smooth locomotion, existing methods use motion capture, finite state machines or morphology-specific knowledge to guide the motion generation algorithms. Deep…

Machine Learning · Computer Science 2018-05-15 Wenhao Yu , Greg Turk , C. Karen Liu