English
Related papers

Related papers: Experience-Learning Inspired Two-Step Reward Metho…

200 papers

Robust closed-loop locomotion remains challenging for soft quadruped robots due to high-dimensional dynamics, actuator hysteresis, and difficult-to-model contact interactions, while conventional proprioception provides limited information…

Robotics · Computer Science 2026-02-16 Storm de Kam , Ebrahim Shahabi , Cosimo Della Santina

Learning to locomote to arbitrary goals on hardware remains a challenging problem for reinforcement learning. In this paper, we present a hierarchical learning framework that improves sample-efficiency and generalizability of locomotion…

Robotics · Computer Science 2019-09-30 Tianyu Li , Nathan Lambert , Roberto Calandra , Franziska Meier , Akshara Rai

Recent advancements in legged locomotion research have made legged robots a preferred choice for navigating challenging terrains when compared to their wheeled counterparts. This paper presents a novel locomotion policy, trained using Deep…

Robotics · Computer Science 2023-05-04 Lokesh Kumar , Sarvesh Sortee , Titas Bera , Ranjan Dasgupta

With the research into development of quadruped robots picking up pace, learning based techniques are being explored for developing locomotion controllers for such robots. A key problem is to generate leg trajectories for continuously…

Despite recent remarkable achievements in quadruped control, it remains challenging to ensure robust and compliant locomotion in the presence of unforeseen external disturbances. Existing methods prioritize locomotion robustness over…

Robotics · Computer Science 2025-07-04 Xiang Zhou , Xinyu Zhang , Qingrui Zhang

The agility of animals, particularly in complex activities such as running, turning, jumping, and backflipping, stands as an exemplar for robotic system design. Transferring this suite of behaviors to legged robotic systems introduces…

Robotics · Computer Science 2025-05-06 Ruihan Yang , Zhuoqun Chen , Jianhan Ma , Chongyi Zheng , Yiyu Chen , Quan Nguyen , Xiaolong Wang

As both legged robots and embedded compute have become more capable, researchers have started to focus on field deployment of these robots. Robust autonomy in unstructured environments requires perception of the world around the robot in…

Robotics · Computer Science 2022-09-22 Hersh Sanghvi

Humans excel at robust bipedal walking in complex natural environments. In each step, they adequately tune the interaction of biomechanical muscle dynamics and neuronal signals to be robust against uncertainties in ground conditions.…

Learning highly dynamic behaviors for robots has been a longstanding challenge. Traditional approaches have demonstrated robust locomotion, but the exhibited behaviors lack diversity and agility. They employ approximate models, which lead…

Robotics · Computer Science 2024-02-22 Chong Zhang , Jiapeng Sheng , Tingguang Li , He Zhang , Cheng Zhou , Qingxu Zhu , Rui Zhao , Yizheng Zhang , Lei Han

Space exploration missions have seen use of increasingly sophisticated robotic systems with ever more autonomy. Deep learning promises to take this even a step further, and has applications for high-level tasks, like path planning, as well…

Machine Learning · Computer Science 2019-09-16 Tamir Blum , William Jones , Kazuya Yoshida

The robustness of legged locomotion is crucial for quadrupedal robots in challenging terrains. Recently, Reinforcement Learning (RL) has shown promising results in legged locomotion and various methods try to integrate privileged…

Robotics · Computer Science 2023-09-04 Jiyuan Shi , Chenjia Bai , Haoran He , Lei Han , Dong Wang , Bin Zhao , Mingguo Zhao , Xiu Li , Xuelong Li

Traversing risky terrains with sparse footholds poses a significant challenge for humanoid robots, requiring precise foot placements and stable locomotion. Existing learning-based approaches often struggle on such complex terrains due to…

Robotics · Computer Science 2025-04-29 Huayi Wang , Zirui Wang , Junli Ren , Qingwei Ben , Tao Huang , Weinan Zhang , Jiangmiao Pang

Sim-to-real reinforcement learning (RL) for humanoid robots with high-gear ratio actuators remains challenging due to complex actuator dynamics and the absence of torque sensors. To address this, we propose a novel RL framework leveraging…

Robotics · Computer Science 2025-04-14 Sotaro Katayama , Yuta Koda , Norio Nagatsuka , Masaya Kinoshita

Legged robots have the potential to traverse complex terrain and access confined spaces beyond the reach of traditional platforms thanks to their ability to carefully select footholds and flexibly adapt their body posture while walking.…

Robotics · Computer Science 2024-03-04 Takahiro Miki , Joonho Lee , Lorenz Wellhausen , Marco Hutter

Reliable and stable locomotion has been one of the most fundamental challenges for legged robots. Deep reinforcement learning (deep RL) has emerged as a promising method for developing such control policies autonomously. In this paper, we…

Robotics · Computer Science 2020-11-04 Sehoon Ha , Peng Xu , Zhenyu Tan , Sergey Levine , Jie Tan

Robotics would gain by replicating the remarkable agility of arthropods in navigating complex environments. Here we consider the control of multi-legged systems which have 6 or more legs. Current multi-legged control strategies in robots…

Robotics · Computer Science 2026-03-11 Zhuoyang Chen , Xinyuan Wang , Shai Revzen

To dynamically traverse challenging terrain, legged robots need to continually perceive and reason about upcoming features, adjust the locations and timings of future footfalls and leverage momentum strategically. We present a pipeline that…

Robotics · Computer Science 2021-04-20 Oliwier Melon , Romeo Orsolino , David Surovik , Mathieu Geisert , Ioannis Havoutis , Maurice Fallon

Some of the most challenging environments on our planet are accessible to quadrupedal animals but remain out of reach for autonomous machines. Legged locomotion can dramatically expand the operational domains of robotics. However,…

Robotics · Computer Science 2020-10-23 Joonho Lee , Jemin Hwangbo , Lorenz Wellhausen , Vladlen Koltun , Marco Hutter

The heavy-load legged robot has strong load carrying capacity and can adapt to various unstructured terrains. But the large weight results in higher requirements for motion stability and environmental perception ability. In order to utilize…

Robotics · Computer Science 2025-07-31 Ze Fu , Yinghui Li , Weizhong Guo

State-of-the-art reinforcement learning is now able to learn versatile locomotion, balancing and push-recovery capabilities for bipedal robots in simulation. Yet, the reality gap has mostly been overlooked and the simulated results hardly…

Robotics · Computer Science 2023-01-02 Alexis Duburcq , Fabian Schramm , Guilhem Boéris , Nicolas Bredeche , Yann Chevaleyre