English
Related papers

Related papers: RPL: Learning Robust Humanoid Perceptive Locomotio…

200 papers

In recent years, reinforcement learning (RL) based quadrupedal locomotion control has emerged as an extensively researched field, driven by the potential advantages of autonomous learning and adaptation compared to traditional control…

Robotics · Computer Science 2024-10-15 Maurya Gurram , Prakash Kumar Uttam , Shantipal S. Ohol

Online reinforcement learning (RL) methods are often data-inefficient or unreliable, making them difficult to train on real robotic hardware, especially quadruped robots. Learning robotic tasks from pre-collected data is a promising…

Robotics · Computer Science 2024-10-28 Hongyin Zhang , Shuyu Yang , Donglin Wang

Multi-legged robots offer enhanced stability to navigate complex terrains with their multiple legs interacting with the environment. However, how to effectively coordinate the multiple legs in a larger action exploration space to generate…

Robotics · Computer Science 2025-11-06 Xin Liu , Jinze Wu , Yinghui Li , Chenkun Qi , Yufei Xue , Feng Gao

Humanoid robots, with their human-like morphology, hold great potential for industrial applications. However, existing loco-manipulation methods primarily focus on dexterous manipulation, falling short of the combined requirements for…

Robotics · Computer Science 2025-11-27 Kaiyan Xiao , Zihan Xu , Cheng Zhe , Chengju Liu , Qijun Chen

We present a novel method for reliable robot navigation in uneven outdoor terrains. Our approach employs a novel fully-trained Deep Reinforcement Learning (DRL) network that uses elevation maps of the environment, robot pose, and goal as…

Robotics · Computer Science 2022-03-07 Kasun Weerakoon , Adarsh Jagan Sathyamoorthy , Utsav Patel , Dinesh Manocha

In recent years, research on humanoid robots has garnered significant attention, particularly in reinforcement learning based control algorithms, which have achieved major breakthroughs. Compared to traditional model-based control…

Robotics · Computer Science 2025-03-12 Qiang Zhang , Gang Han , Jingkai Sun , Wen Zhao , Jiahang Cao , Jiaxu Wang , Hao Cheng , Lingfeng Zhang , Yijie Guo , Renjing Xu

Reinforcement learning (RL) has enabled robust quadruped locomotion over complex terrain, but most learned controllers are trained offline with backpropagation in massively parallel simulation and deployed as fixed policies, limiting…

Neural and Evolutionary Computing · Computer Science 2026-05-12 Zhuangyu Han , Abhronil Sengupta

Prompt learning as a parameter-efficient method that has been widely adopted to adapt Vision-Language Models (VLMs) to downstream tasks. While hard-prompt design requires domain expertise and iterative optimization, soft-prompt methods rely…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Zherui Zhang , Jiaxin Wu , Changwei Wang , Rongtao Xu , Longzhao Huang , Wenhao Xu , Wenbo Xu , Li Guo , Shibiao Xu

Deep reinforcement learning has seen successful implementations on humanoid robots to achieve dynamic walking. However, these implementations have been so far successful in simple environments void of obstacles. In this paper, we aim to…

Robotics · Computer Science 2024-10-14 Marwan Hamze , Mitsuharu Morisawa , Eiichi Yoshida

Optimal Control for legged robots has gone through a paradigm shift from position-based to torque-based control, owing to the latter's compliant and robust nature. In parallel to this shift, the community has also turned to Deep…

Robotics · Computer Science 2024-09-04 Shivam Sood , Ge Sun , Peizhuo Li , Guillaume Sartoretti

As mobile robots become useful performing everyday tasks in complex real-world environments, they must be able to traverse a range of difficult terrain types such as stairs, stepping stones, gaps, jumps and narrow passages. This work…

Robotics · Computer Science 2023-03-06 Brendan Tidd

Developing robot controllers capable of achieving dexterous nonprehensile manipulation, such as pushing an object on a table, is challenging. The underactuated and hybrid-dynamics nature of the problem, further complicated by the…

Robotics · Computer Science 2023-08-07 Juan Del Aguila Ferrandis , João Moura , Sethu Vijayakumar

Humanoid robots deployed in industrial environments are required to perform load-carrying transportation tasks that tightly couple locomotion and manipulation. However, achieving stable and robust locomotion under varying payloads and…

Robotics · Computer Science 2026-03-17 Lequn Fu , Yijun Zhong , Xiao Li , Yibin Liu , Zhiyuan Xu , Jian Tang , Shiqi Li

This paper proposes a modular framework to generate robust biped locomotion using a tight coupling between an analytical walking approach and deep reinforcement learning. This framework is composed of six main modules which are…

Robotics · Computer Science 2021-12-23 Mohammadreza Kasaei , Miguel Abreu , Nuno Lau , Artur Pereira , Luis Paulo Reis

We present a novel Deep Reinforcement Learning (DRL) based policy to compute dynamically feasible and spatially aware velocities for a robot navigating among mobile obstacles. Our approach combines the benefits of the Dynamic Window…

Robotics · Computer Science 2020-11-30 Utsav Patel , Nithish Kumar , Adarsh Jagan Sathyamoorthy , Dinesh Manocha

Perceptive deep reinforcement learning (DRL) has lead to many recent breakthroughs for complex AI systems leveraging image-based input data. Applications of these results range from super-human level video game agents to dexterous,…

Robotics · Computer Science 2023-10-04 Lev Grossman , Brian Plancher

The quality of the visual feedback can vary significantly on a legged robot that is meant to traverse unknown and unstructured terrains. The map of the environment, acquired with online state-of-the-art algorithms, often degrades after a…

Deep reinforcement learning (RL) has been shown to be effective in producing approximate solutions to some vehicle routing problems (VRPs), especially when using policies generated by encoder-decoder attention mechanisms. While these…

Machine Learning · Computer Science 2024-12-19 Joshua Levin , Randall Correll , Takanori Ide , Takafumi Suzuki , Takaho Saito , Alan Arai

We present a novel control strategy for dynamic legged locomotion in complex scenarios, that considers information about the morphology of the terrain in contexts when only on-board mapping and computation are available. The strategy is…

Parkour is a grand challenge for legged locomotion that requires robots to overcome various obstacles rapidly in complex environments. Existing methods can generate either diverse but blind locomotion skills or vision-based but specialized…