English
Related papers

Related papers: RLOC: Terrain-Aware Legged Locomotion using Reinfo…

200 papers

Dynamic locomotion in rough terrain requires accurate foot placement, collision avoidance, and planning of the underactuated dynamics of the system. Reliably optimizing for such motions and interactions in the presence of imperfect and…

Robotics · Computer Science 2022-08-18 Ruben Grandia , Fabian Jenelten , Shaohui Yang , Farbod Farshidian , Marco Hutter

A reinforcement learning (RL) based methodology is proposed and implemented for online fine-tuning of PID controller gains, thus, improving quadrotor effective and accurate trajectory tracking. The RL agent is first trained offline on a…

Systems and Control · Electrical Eng. & Systems 2025-02-10 Serhat Sönmez , Luca Montecchio , Simone Martini , Matthew J. Rutherford , Alessandro Rizzo , Margareta Stefanovic , Kimon P. Valavanis

Effective bipedal locomotion in dynamic environments, such as cluttered indoor spaces or uneven terrain, requires agile and adaptive movement in all directions. This necessitates omnidirectional terrain sensing and a controller capable of…

Robotics · Computer Science 2026-03-18 Mohitvishnu S. Gadde , Pranay Dugar , Ashish Malik , Alan Fern

Reliable and stable locomotion has been one of the most fundamental challenges for legged robots. Deep reinforcement learning (deep RL) has emerged as a promising method for developing such control policies autonomously. In this paper, we…

Robotics · Computer Science 2020-11-04 Sehoon Ha , Peng Xu , Zhenyu Tan , Sergey Levine , Jie Tan

We present a legged motion planning approach for quadrupedal locomotion over challenging terrain. We decompose the problem into body action planning and footstep planning. We use a lattice representation together with a set of defined body…

Unknown dynamic load carrying is one important practical application for quadruped robots. Such a problem is non-trivial, posing three major challenges in quadruped locomotion control. First, how to model or represent the dynamics of the…

Robotics · Computer Science 2025-07-11 Leixin Chang , Yuxuan Nai , Hua Chen , Liangjing Yang

Navigating fluently around pedestrians is a necessary capability for mobile robots deployed in human environments, such as buildings and homes. While research on social navigation has focused mainly on the scalability with the number of…

In this paper, we propose a novel framework for synthesizing a single multimodal control policy capable of generating diverse behaviors (or modes) and emergent inherent transition maneuvers for bipedal locomotion. In our method, we first…

Robotics · Computer Science 2023-08-15 Lokesh Krishna , Quan Nguyen

We present ZSL-RPPO, an improved zero-shot learning architecture that overcomes the limitations of teacher-student neural networks and enables generating robust, reliable, and versatile locomotion for quadrupedal robots in challenging…

Robotics · Computer Science 2024-03-05 Yao Zhao , Tao Wu , Yijie Zhu , Xiang Lu , Jun Wang , Haitham Bou-Ammar , Xinyu Zhang , Peng Du

Deep Reinforcement Learning (DRL) controllers for quadrupedal locomotion have demonstrated impressive performance on challenging terrains, allowing robots to execute complex skills such as climbing, running, and jumping. However, existing…

Robotics · Computer Science 2025-09-30 Yinzhao Dong , Ji Ma , Liu Zhao , Wanyue Li , Peng Lu

Autonomous wheeled-legged robots have the potential to transform logistics systems, improving operational efficiency and adaptability in urban environments. Navigating urban environments, however, poses unique challenges for robots,…

Robotics · Computer Science 2024-05-06 Joonho Lee , Marko Bjelonic , Alexander Reske , Lorenz Wellhausen , Takahiro Miki , Marco Hutter

Quadrupedal loco-manipulation is commonly built on visual perception and proprioception. Yet reliable contact-rich manipulation remains difficult: vision and proprioception alone cannot resolve uncertain, evolving interactions with the…

Recent advances in deep reinforcement learning (RL) based techniques combined with training in simulation have offered a new approach to developing robust controllers for legged robots. However, the application of such approaches to real…

Robotics · Computer Science 2023-08-08 Rohan Pratap Singh , Zhaoming Xie , Pierre Gergondet , Fumio Kanehiro

Motion planning under uncertainty is one of the main challenges in developing autonomous driving vehicles. In this work, we focus on the uncertainty in sensing and perception, resulted from a limited field of view, occlusions, and sensing…

Robotics · Computer Science 2021-10-05 Kasra Rezaee , Peyman Yadmellat , Simon Chamorro

We present a model-based framework for robot locomotion that achieves walking based on only 4.5 minutes (45,000 control steps) of data collected on a quadruped robot. To accurately model the robot's dynamics over a long horizon, we…

Machine Learning · Computer Science 2019-10-08 Yuxiang Yang , Ken Caluwaerts , Atil Iscen , Tingnan Zhang , Jie Tan , Vikas Sindhwani

Generating dynamic motions for legged robots remains a challenging problem. While reinforcement learning has achieved notable success in various legged locomotion tasks, producing highly dynamic behaviors often requires extensive reward…

Robotics · Computer Science 2026-01-01 Dongyun Kang , Min-Gyu Kim , Tae-Gyu Song , Hajun Kim , Sehoon Ha , Hae-Won Park

Reinforcement learning (RL) often necessitates a meticulous Markov Decision Process (MDP) design tailored to each task. This work aims to address this challenge by proposing a systematic approach to behavior synthesis and control for…

Robotics · Computer Science 2024-10-18 Jean-Pierre Sleiman , Mayank Mittal , Marco Hutter

Developing robust vision-guided controllers for quadrupedal robots in complex environments, with various obstacles, dynamical surroundings and uneven terrains, is very challenging. While Reinforcement Learning (RL) provides a promising…

Humans possess delicate dynamic balance mechanisms that enable them to maintain stability across diverse terrains and under extreme conditions. However, despite significant advances recently, existing locomotion algorithms for humanoid…

Robotics · Computer Science 2025-03-03 Weiji Xie , Chenjia Bai , Jiyuan Shi , Junkai Yang , Yunfei Ge , Weinan Zhang , Xuelong Li

Legged robots navigating crowded scenes and complex terrains in the real world are required to execute dynamic leg movements while processing visual input for obstacle avoidance and path planning. We show that a quadruped robot can acquire…

Robotics · Computer Science 2020-12-01 Deepali Jain , Atil Iscen , Ken Caluwaerts