English
Related papers

Related papers: Learning Coordinated Terrain-Adaptive Locomotion b…

200 papers

Bipedal locomotion skills are challenging to develop. Control strategies often use local linearization of the dynamics in conjunction with reduced-order abstractions to yield tractable solutions. In these model-based control strategies, the…

Robotics · Computer Science 2018-07-30 Zhaoming Xie , Glen Berseth , Patrick Clary , Jonathan Hurst , Michiel van de Panne

Deep reinforcement learning has recently achieved strong results in quadrupedal locomotion, yet policies trained in simulation often fail to transfer when the environment changes. Evolutionary reinforcement learning aims to address this…

Robotics · Computer Science 2026-04-09 Brian McAteer , Karl Mason

Real-world autonomous decision-making systems, from robots to recommendation engines, must operate in environments that change over time. While deep reinforcement learning (RL) has shown an impressive ability to learn optimal policies in…

Machine Learning · Computer Science 2025-05-16 Jonathan Clifford Balloch

Precise trajectory tracking for legged robots can be challenging due to their high degrees of freedom, unmodeled nonlinear dynamics, or random disturbances from the environment. A commonly adopted solution to overcome these challenges is to…

Robotics · Computer Science 2025-09-01 Jing Cheng , Yasser G. Alqaham , Amit K. Sanyal , Zhenyu Gan

Urban search and rescue missions require rapid first response to minimize loss of life and damage. Often, such efforts are assisted by humanitarian robots which need to handle dynamic operational conditions such as uneven and rough…

Robotics · Computer Science 2024-01-09 Nishaant Shah , Kshitij Tiwari , Aniket Bera

Designing agile locomotion for quadruped robots often requires extensive expertise and tedious manual tuning. In this paper, we present a system to automate this process by leveraging deep reinforcement learning techniques. Our system can…

Humanoid robots are engineered to navigate terrains akin to those encountered by humans, which necessitates human-like locomotion and perceptual abilities. Currently, the most reliable controllers for humanoid motion rely exclusively on…

Robotics · Computer Science 2025-04-03 Wandong Sun , Baoshi Cao , Long Chen , Yongbo Su , Yang Liu , Zongwu Xie , Hong Liu

Legged robots have the potential to traverse complex terrain and access confined spaces beyond the reach of traditional platforms thanks to their ability to carefully select footholds and flexibly adapt their body posture while walking.…

Robotics · Computer Science 2024-03-04 Takahiro Miki , Joonho Lee , Lorenz Wellhausen , Marco Hutter

A reinforcement learning (RL) control policy could fail in a new/perturbed environment that is different from the training environment, due to the presence of dynamic variations. For controlling systems with continuous state and action…

Robotics · Computer Science 2022-08-31 Y. Cheng , P. Zhao , F. Wang , D. J. Block , N. Hovakimyan

Agile-legged robots have proven to be highly effective in navigating and performing tasks in complex and challenging environments, including disaster zones and industrial settings. However, these applications normally require the capability…

Robotics · Computer Science 2024-04-09 Mohsen Sombolestan , Quan Nguyen

Controlling contact forces during interactions is critical for locomotion and manipulation tasks. While sim-to-real reinforcement learning (RL) has succeeded in many contact-rich problems, current RL methods achieve forceful interactions…

Robotics · Computer Science 2024-05-21 Tifanny Portela , Gabriel B. Margolis , Yandong Ji , Pulkit Agrawal

Locomotion mechanics of legged robots are suitable when pacing through difficult terrains. Recognising terrains for such robots are important to fully yoke the versatility of their movements. Consequently, robotic terrain classification…

Robotics · Computer Science 2024-03-21 Shakti Deo Kumar , Sudhanshu Tripathi , Krishna Ujjwal , Sarvada Sakshi Jha , Suddhasil De

Stable gait generation is a crucial problem for legged robot locomotion as this impacts other critical performance factors such as, e.g. mobility over an uneven terrain and power consumption. Gait generation stability results from the…

Robotics · Computer Science 2023-07-18 Vyacheslav Kovalev , Anna Shkromada , Henni Ouerdane , Pavel Osinenko

In this paper, we propose a robust controller that achieves natural and stably fast locomotion on a real blind quadruped robot. With only proprioceptive information, the quadruped robot can move at a maximum speed of 10 times its body…

Robotics · Computer Science 2022-07-05 Xu Chang , Zhitong Zhang , Honglei An , Hongxu Ma , Qing Wei

Many robotic path planning problems are continuous, stochastic, and high-dimensional. The ability of a mobile manipulator to coordinate its base and manipulator in order to control its whole-body online is particularly challenging when self…

Robotics · Computer Science 2021-10-06 Denis Hadjivelichkov , Kostas Vlachos , Dimitrios Kanoulas

In this paper, we describe an approach to achieve dynamic legged locomotion on physical robots which combines existing methods for control with reinforcement learning. Specifically, our goal is a control hierarchy in which highest-level…

Robotics · Computer Science 2021-03-15 Kevin Green , Yesh Godse , Jeremy Dao , Ross L. Hatton , Alan Fern , Jonathan Hurst

Safe reinforcement learning (RL) seeks to mitigate unsafe behaviors that arise from exploration during training by reducing constraint violations while maintaining task performance. Existing approaches typically rely on a single policy to…

Robotics · Computer Science 2026-05-12 Murad Dawood , Usama Ahmed Siddiquie , Shahram Khorshidi , Maren Bennewitz

Model-free reinforcement learning (RL) has enabled adaptable and agile quadruped locomotion; however, policies often converge to a single gait, leading to suboptimal performance. Traditionally, Model Predictive Control (MPC) has been…

Robotics · Computer Science 2025-10-27 Prakrut Kotecha , Ganga Nair B , Shishir Kolathaya

Legged robots navigating crowded scenes and complex terrains in the real world are required to execute dynamic leg movements while processing visual input for obstacle avoidance and path planning. We show that a quadruped robot can acquire…

Robotics · Computer Science 2020-12-01 Deepali Jain , Atil Iscen , Ken Caluwaerts

This study introduces TRANS: Terrain-aware Reinforcement learning for Agile Navigation under Social interactions, a deep reinforcement learning (DRL) framework for quadrupedal social navigation over unstructured terrains. Conventional…

Robotics · Computer Science 2026-04-01 Wei Zhu , Irfan Tito Kurniawan , Ye Zhao , Mitsuhiro Hayashibe