English
Related papers

Related papers: Sim-to-Real: Learning Agile Locomotion For Quadrup…

200 papers

Robots are increasingly integrated across industries, particularly in healthcare. However, many valuable applications for quadrupedal robots remain overlooked. This research explores the effectiveness of three reinforcement learning…

Robotics · Computer Science 2025-07-18 Emma M. A. Harrison

This chapter addresses the critical challenge of simulation-to-reality (sim-to-real) transfer for deep reinforcement learning (DRL) in bipedal locomotion. After contextualizing the problem within various control architectures, we dissect…

Robotics · Computer Science 2025-11-11 Lingfan Bao , Tianhu Peng , Chengxu Zhou

Deep reinforcement learning (RL) based controllers for legged robots have demonstrated impressive robustness for walking in different environments for several robot platforms. To enable the application of RL policies for humanoid robots in…

Robotics · Computer Science 2022-11-01 Rohan Pratap Singh , Mehdi Benallegue , Mitsuharu Morisawa , Rafael Cisneros , Fumio Kanehiro

Recently, work on reinforcement learning (RL) for bipedal robots has successfully learned controllers for a variety of dynamic gaits with robust sim-to-real demonstrations. In order to maintain balance, the learned controllers have full…

Robotics · Computer Science 2022-05-05 Helei Duan , Ashish Malik , Jeremy Dao , Aseem Saxena , Kevin Green , Jonah Siekmann , Alan Fern , Jonathan Hurst

Recent work has demonstrated the ability of deep reinforcement learning (RL) algorithms to learn complex robotic behaviours in simulation, including in the domain of multi-fingered manipulation. However, such models can be challenging to…

Quadrupedal robots show great potential for valuable real-world applications such as fire rescue and industrial inspection. Such applications often require urgency and the ability to navigate agilely, which in turn demands the capability to…

Robotics · Computer Science 2026-03-16 Zunzhi You , Haolan Guo , Yunke Wang , Chang Xu

Spring-based actuators in legged locomotion provide energy-efficiency and improved performance, but increase the difficulty of controller design. While previous work has focused on extensive modeling and simulation to find optimal…

Robotics · Computer Science 2023-08-22 Antonin Raffin , Daniel Seidel , Jens Kober , Alin Albu-Schäffer , João Silvério , Freek Stulp

Learning highly dynamic behaviors for robots has been a longstanding challenge. Traditional approaches have demonstrated robust locomotion, but the exhibited behaviors lack diversity and agility. They employ approximate models, which lead…

Robotics · Computer Science 2024-02-22 Chong Zhang , Jiapeng Sheng , Tingguang Li , He Zhang , Cheng Zhou , Qingxu Zhu , Rui Zhao , Yizheng Zhang , Lei Han

Previous studies have successfully demonstrated agile and robust locomotion in challenging terrains for quadrupedal robots. However, the bipedal locomotion mode for quadruped robots remains unverified. This paper explores the adaptation of…

Quadrupedal robots resemble the physical ability of legged animals to walk through unstructured terrains. However, designing a controller for quadrupedal robots poses a significant challenge due to their functional complexity and requires…

Robotics · Computer Science 2023-03-06 I Made Aswin Nahrendra , Byeongho Yu , Hyun Myung

Developing controllers for agile locomotion is a long-standing challenge for legged robots. Reinforcement learning (RL) and Evolution Strategy (ES) hold the promise of automating the design process of such controllers. However, dedicated…

Robotics · Computer Science 2020-08-04 Yujin Tang , Jie Tan , Tatsuya Harada

Parkour is a grand challenge for legged locomotion that requires robots to overcome various obstacles rapidly in complex environments. Existing methods can generate either diverse but blind locomotion skills or vision-based but specialized…

Bipedal walking is one of the most difficult but exciting challenges in robotics. The difficulties arise from the complexity of high-dimensional dynamics, sensing and actuation limitations combined with real-time and computational…

Robotics · Computer Science 2021-06-02 Diego Rodriguez , Sven Behnke

Deep reinforcement learning has seen successful implementations on humanoid robots to achieve dynamic walking. However, these implementations have been so far successful in simple environments void of obstacles. In this paper, we aim to…

Robotics · Computer Science 2024-10-14 Marwan Hamze , Mitsuharu Morisawa , Eiichi Yoshida

Reinforcement learning (RL) for bipedal locomotion has recently demonstrated robust gaits over moderate terrains using only proprioceptive sensing. However, such blind controllers will fail in environments where robots must anticipate and…

Robotics · Computer Science 2024-07-10 Helei Duan , Bikram Pandit , Mohitvishnu S. Gadde , Bart van Marum , Jeremy Dao , Chanho Kim , Alan Fern

Reinforcement learning has emerged as a promising methodology for training robot controllers. However, most results have been limited to simulation due to the need for a large number of samples and the lack of automated-yet-safe data…

Robotics · Computer Science 2018-03-29 Kendall Lowrey , Svetoslav Kolev , Jeremy Dao , Aravind Rajeswaran , Emanuel Todorov

Recent trends in robot arm control have seen a shift towards end-to-end solutions, using deep reinforcement learning to learn a controller directly from raw sensor data, rather than relying on a hand-crafted, modular pipeline. However, the…

Robotics · Computer Science 2016-12-14 Stephen James , Edward Johns

Whole-body loco-manipulation for quadruped robots with arms remains a challenging problem, particularly in achieving multi-task control. To address this, we propose MLM, a reinforcement learning framework driven by both real-world and…

This paper presents a Sim2Real (Simulation to Reality) approach to bridge the gap between a trained agent in a simulated environment and its real-world implementation in navigating a robot in a similar setting. Specifically, we focus on…

Robotics · Computer Science 2025-01-07 Murad Mehrab Abrar , Souryadeep Mondal , Michelle Hickner

Can a quadrupedal robot perform bipedal motions like humans? Although developing human-like behaviors is more often studied on costly bipedal robot platforms, we present a solution over a lightweight quadrupedal robot that unlocks the…

Robotics · Computer Science 2024-03-05 Yunfei Li , Jinhan Li , Wei Fu , Yi Wu