English
Related papers

Related papers: Learning to Walk in Minutes Using Massively Parall…

200 papers

We present a footstep planning policy for quadrupedal locomotion that is able to directly take into consideration a-priori safety information in its decisions. At its core, a learning process analyzes terrain patches, classifying each…

Robotics · Computer Science 2025-01-30 Shafeef Omar , Lorenzo Amatucci , Victor Barasuol , Giulio Turrisi , Claudio Semini

Not until recently, robust robot locomotion has been achieved by deep reinforcement learning (DRL). However, for efficient learning of parametrized bipedal walking, developed references are usually required, limiting the performance to that…

Robotics · Computer Science 2021-12-14 Chong Zhang , Qi Wu , Liqian Ma , Hongyuan Su

The ability to walk in new scenarios is a key milestone on the path toward real-world applications of legged robots. In this work, we introduce Meta Strategy Optimization, a meta-learning algorithm for training policies with latent variable…

Robotics · Computer Science 2020-02-18 Wenhao Yu , Jie Tan , Yunfei Bai , Erwin Coumans , Sehoon Ha

Solving inverse problems and achieving statistical rigour in landscape evolution models requires running many model realizations. Parallel computation is necessary to achieve this in a reasonable time. However, no previous algorithm is…

Computational Engineering, Finance, and Science · Computer Science 2019-01-23 Richard Barnes

In this work, we propose a learning approach for 3D dynamic bipedal walking when footsteps are constrained to stepping stones. While recent work has shown progress on this problem, real-world demonstrations have been limited to relatively…

Robotics · Computer Science 2022-05-05 Helei Duan , Ashish Malik , Mohitvishnu S. Gadde , Jeremy Dao , Alan Fern , Jonathan Hurst

Learning to locomote to arbitrary goals on hardware remains a challenging problem for reinforcement learning. In this paper, we present a hierarchical learning framework that improves sample-efficiency and generalizability of locomotion…

Robotics · Computer Science 2019-09-30 Tianyu Li , Nathan Lambert , Roberto Calandra , Franziska Meier , Akshara Rai

Humanoid robots are made to resemble humans but their locomotion abilities are far from ours in terms of agility and versatility. When humans walk on complex terrains, or face external disturbances, they combine a set of strategies,…

Robotics · Computer Science 2021-10-28 Mohammadreza Kasaei , Miguel Abreu , Nuno Lau , Artur Pereira , Luis Paulo Reis

Robot navigation using deep reinforcement learning (DRL) has shown great potential in improving the performance of mobile robots. Nevertheless, most existing DRL-based navigation methods primarily focus on training a policy that directly…

Robotics · Computer Science 2023-10-23 Wenhao Yu , Jie Peng , Quecheng Qiu , Hanyu Wang , Lu Zhang , Jianmin Ji

This work presents a hierarchical framework for bipedal locomotion that combines a Reinforcement Learning (RL)-based high-level (HL) planner policy for the online generation of task space commands with a model-based low-level (LL)…

Robotics · Computer Science 2023-09-28 Guillermo A. Castillo , Bowen Weng , Shunpeng Yang , Wei Zhang , Ayonga Hereid

To solve tasks in complex environments, robots need to learn from experience. Deep reinforcement learning is a common approach to robot learning but requires a large amount of trial and error to learn, limiting its deployment in the…

Robotics · Computer Science 2022-06-29 Philipp Wu , Alejandro Escontrela , Danijar Hafner , Ken Goldberg , Pieter Abbeel

Gaits and transitions are key components in legged locomotion. For legged robots, describing and reproducing gaits as well as transitions remain longstanding challenges. Reinforcement learning has become a powerful tool to formulate…

Robotics · Computer Science 2022-01-04 Yecheng Shao , Yongbin Jin , Xianwei Liu , Weiyan He , Hongtao Wang , Wei Yang

In recent years, research on humanoid robots has garnered significant attention, particularly in reinforcement learning based control algorithms, which have achieved major breakthroughs. Compared to traditional model-based control…

Robotics · Computer Science 2025-03-12 Qiang Zhang , Gang Han , Jingkai Sun , Wen Zhao , Jiahang Cao , Jiaxu Wang , Hao Cheng , Lingfeng Zhang , Yijie Guo , Renjing Xu

In this paper, we present a general learning framework for controlling a quadruped robot that can mimic the behavior of real animals and traverse challenging terrains. Our method consists of two steps: an imitation learning step to learn…

Robotics · Computer Science 2023-08-08 Tingguang Li , Yizheng Zhang , Chong Zhang , Qingxu Zhu , Jiapeng sheng , Wanchao Chi , Cheng Zhou , Lei Han

Quadruped robots excel in traversing complex, unstructured environments where wheeled robots often fail. However, enabling efficient and adaptable locomotion remains challenging due to the quadrupeds' nonlinear dynamics, high degrees of…

Robotics · Computer Science 2025-05-14 Anudeep Sajja , Shahram Khorshidi , Sebastian Houben , Maren Bennewitz

Learning-based methods have shown promising performance for accelerating motion planning, but mostly in the setting of static environments. For the more challenging problem of planning in dynamic environments, such as multi-arm assembly…

Robotics · Computer Science 2025-06-13 Ruipeng Zhang , Chenning Yu , Jingkai Chen , Chuchu Fan , Sicun Gao

This work presents a meta-reinforcement learning approach to develop a universal locomotion control policy capable of zero-shot generalization across diverse quadrupedal platforms. The proposed method trains an RL agent equipped with a…

Robotics · Computer Science 2024-11-05 Fatemeh Zargarbashi , Fabrizio Di Giuro , Jin Cheng , Dongho Kang , Bhavya Sukhija , Stelian Coros

Developing agile behaviors for legged robots remains a challenging problem. While deep reinforcement learning is a promising approach, learning truly agile behaviors typically requires tedious reward shaping and careful curriculum design.…

Robotics · Computer Science 2020-11-12 Atil Iscen , George Yu , Alejandro Escontrela , Deepali Jain , Jie Tan , Ken Caluwaerts

Dynamic walking on bipedal robots has evolved from an idea in science fiction to a practical reality. This is due to continued progress in three key areas: a mathematical understanding of locomotion, the computational ability to encode this…

Robotics · Computer Science 2020-10-16 Jenna Reher , Aaron D. Ames

Deep Reinforcement Learning has been successfully applied in various computer games [8]. However, it is still rarely used in real-world applications, especially for the navigation and continuous control of real mobile robots [13]. Previous…

The U.S. Defense Advanced Research Projects Agency (DARPA) Subterranean Challenge requires teams of robots to traverse difficult and diverse underground environments. Traversing small gaps is one of the challenging scenarios that robots…

Robotics · Computer Science 2021-11-03 Brendan Tidd , Akansel Cosgun , Jurgen Leitner , Nicolas Hudson