English
Related papers

Related papers: Sim-to-Real Learning for Bipedal Locomotion Under …

200 papers

Developing bipedal football robots in dynamiccombat environments presents challenges related to motionstability and deep coupling of multiple tasks, as well ascontrol switching issues between different states such as up-right walking and…

Robotics · Computer Science 2026-04-22 Yulai Zhang , Yinrong Zhang , Ting Wu , Linqi Ye

Deep Reinforcement Learning (RL) has been explored and verified to be effective in solving decision-making tasks in various domains, such as robotics, transportation, recommender systems, etc. It learns from the interaction with…

Machine Learning · Computer Science 2025-03-11 Longchao Da , Justin Turnau , Thirulogasankar Pranav Kutralingam , Alvaro Velasquez , Paulo Shakarian , Hua Wei

Reinforcement learning (RL) is a promising solution for autonomous vehicles to deal with complex and uncertain traffic environments. The RL training process is however expensive, unsafe, and time consuming. Algorithms are often developed…

Robotics · Computer Science 2022-11-29 Kevin Voogd , Jean Pierre Allamaa , Javier Alonso-Mora , Tong Duy Son

Transportation is the backbone of the economy and urban development. Improving the efficiency, sustainability, resilience, and intelligence of transportation systems is critical and also challenging. The constantly changing traffic…

Machine Learning · Computer Science 2022-10-27 Can Li , Lei Bai , Lina Yao , S. Travis Waller , Wei Liu

In search of a simple baseline for Deep Reinforcement Learning in locomotion tasks, we propose a model-free open-loop strategy. By leveraging prior knowledge and the elegance of simple oscillators to generate periodic joint motions, it…

Robotics · Computer Science 2024-03-05 Antonin Raffin , Olivier Sigaud , Jens Kober , Alin Albu-Schäffer , João Silvério , Freek Stulp

Equipping quadruped robots with manipulators provides unique loco-manipulation capabilities, enabling diverse practical applications. This integration creates a more complex system that has increased difficulties in modeling and control.…

Robotics · Computer Science 2025-07-08 Dianyong Hou , Chengrui Zhu , Zhen Zhang , Zhibin Li , Chuang Guo , Yong Liu

Legged robots navigating crowded scenes and complex terrains in the real world are required to execute dynamic leg movements while processing visual input for obstacle avoidance and path planning. We show that a quadruped robot can acquire…

Robotics · Computer Science 2020-12-01 Deepali Jain , Atil Iscen , Ken Caluwaerts

Not until recently, robust robot locomotion has been achieved by deep reinforcement learning (DRL). However, for efficient learning of parametrized bipedal walking, developed references are usually required, limiting the performance to that…

Robotics · Computer Science 2021-12-14 Chong Zhang , Qi Wu , Liqian Ma , Hongyuan Su

Training deep reinforcement learning (DRL) locomotion policies often require massive amounts of data to converge to the desired behaviour. In this regard, simulators provide a cheap and abundant source. For successful sim-to-real transfer,…

Robotics · Computer Science 2023-03-08 Luigi Campanaro , Siddhant Gangapurwala , Wolfgang Merkt , Ioannis Havoutis

In this paper we propose a novel bipedal locomotion controller that uses noisy exteroception to traverse a wide variety of terrains. Building on the cutting-edge advancements in attention based belief encoding for quadrupedal locomotion,…

Robotics · Computer Science 2023-04-17 Bart van Marum , Matthia Sabatelli , Hamidreza Kasaei

Animals have remarkable abilities to adapt locomotion to different terrains and tasks. However, robots trained by means of reinforcement learning are typically able to solve only a single task and a transferred policy is usually inferior to…

Robotics · Computer Science 2021-07-09 Arsen Kuzhamuratov , Dmitry Sorokin , Alexander Ulanov , A. I. Lvovsky

While reinforcement learning (RL) has the potential to enable robots to autonomously acquire a wide range of skills, in practice, RL usually requires manual, per-task engineering of reward functions, especially in real world settings where…

Robotics · Computer Science 2019-02-15 Tianhe Yu , Gleb Shevchuk , Dorsa Sadigh , Chelsea Finn

Locomotion on unknown terrains is essential for bipedal robots to handle novel real-world challenges, thus expanding their utility in disaster response and exploration. In this work, we introduce a lightweight framework that learns a single…

Robotics · Computer Science 2024-07-09 GVS Mothish , Manan Tayal , Shishir Kolathaya

Various pipes are extensively used in both industrial settings and daily life, but the pipe inspection especially those with narrow sizes are still very challenging with tremendous time and manufacturing consumed. Quadrupedal robots,…

Robotics · Computer Science 2024-12-19 Jing Guo , Ziwei Wang , Weibang Bai

Recent advancements in legged locomotion research have made legged robots a preferred choice for navigating challenging terrains when compared to their wheeled counterparts. This paper presents a novel locomotion policy, trained using Deep…

Robotics · Computer Science 2023-05-04 Lokesh Kumar , Sarvesh Sortee , Titas Bera , Ranjan Dasgupta

In this work, we introduce a control framework that combines model-based footstep planning with Reinforcement Learning (RL), leveraging desired footstep patterns derived from the Linear Inverted Pendulum (LIP) dynamics. Utilizing the LIP…

Robotics · Computer Science 2024-08-06 Ho Jae Lee , Seungwoo Hong , Sangbae Kim

As mobile robots become useful performing everyday tasks in complex real-world environments, they must be able to traverse a range of difficult terrain types such as stairs, stepping stones, gaps, jumps and narrow passages. This work…

Robotics · Computer Science 2023-03-06 Brendan Tidd

Robots which make use of soft or compliant inter- actions often leverage tendon-driven actuation which enables actuators to be placed more flexibly, and compliance to be maintained. However, controlling complex tendon systems is…

Robotics · Computer Science 2026-03-05 Valentin Yuryev , Josie Hughes

Reinforcement learning has shown strong promise for quadrupedal agile locomotion, even with proprioception-only sensing. In practice, however, sim-to-real gap and reward overfitting in complex terrains can produce policies that fail to…

Robotics · Computer Science 2026-05-12 Tianyang Wu , Hanwei Guo , Yuhang Wang , Junshu Yang , Xinyang Sui , Jiayi Xie , Xingyu Chen , Zeyang Liu , Xuguang Lan

With the growing employment of learning algorithms in robotic applications, research on reinforcement learning for bipedal locomotion has become a central topic for humanoid robotics. While recently published contributions achieve high…

Robotics · Computer Science 2026-03-05 Hokyun Lee , Woo-Jeong Baek , Junhyeok Cha , Jaeheung Park