English
Related papers

Related papers: Learning to Walk in Minutes Using Massively Parall…

200 papers

Deep reinforcement learning is a promising approach to learning policies in uncontrolled environments that do not require domain knowledge. Unfortunately, due to sample inefficiency, deep RL applications have primarily focused on simulated…

Robotics · Computer Science 2022-08-17 Laura Smith , Ilya Kostrikov , Sergey Levine

Deep reinforcement learning (deep RL) holds the promise of automating the acquisition of complex controllers that can map sensory inputs directly to low-level actions. In the domain of robotic locomotion, deep RL could enable learning…

Machine Learning · Computer Science 2019-06-20 Tuomas Haarnoja , Sehoon Ha , Aurick Zhou , Jie Tan , George Tucker , Sergey Levine

Deep reinforcement learning (RL) based controllers for legged robots have demonstrated impressive robustness for walking in different environments for several robot platforms. To enable the application of RL policies for humanoid robots in…

Robotics · Computer Science 2022-11-01 Rohan Pratap Singh , Mehdi Benallegue , Mitsuharu Morisawa , Rafael Cisneros , Fumio Kanehiro

In this work, we propose a computationally efficient algorithm for visual policy learning that leverages differentiable simulation and first-order analytical policy gradients. Our approach decouple the rendering process from the computation…

Machine Learning · Computer Science 2025-11-12 Haoxiang You , Yilang Liu , Ian Abraham

Reliable and stable locomotion has been one of the most fundamental challenges for legged robots. Deep reinforcement learning (deep RL) has emerged as a promising method for developing such control policies autonomously. In this paper, we…

Robotics · Computer Science 2020-11-04 Sehoon Ha , Peng Xu , Zhenyu Tan , Sergey Levine , Jie Tan

Legged robots pose one of the greatest challenges in robotics. Dynamic and agile maneuvers of animals cannot be imitated by existing methods that are crafted by humans. A compelling alternative is reinforcement learning, which requires…

Deep reinforcement learning has emerged as a popular and powerful way to develop locomotion controllers for quadruped robots. Common approaches have largely focused on learning actions directly in joint space, or learning to modify and…

Robotics · Computer Science 2023-03-16 Guillaume Bellegarda , Yiyu Chen , Zhuochen Liu , Quan Nguyen

We present a novel reinforcement learning method to train the quadruped robot in a simulated environment. The idea of controlling quadruped robots in a dynamic environment is quite challenging and my method presents the optimum policy and…

Robotics · Computer Science 2025-02-25 Nabeel Ahmad Khan Jadoon , Mongkol Ekpanyapong

This work explores the potential of using differentiable simulation for learning quadruped locomotion. Differentiable simulation promises fast convergence and stable training by computing low-variance first-order gradients using robot…

Robotics · Computer Science 2024-10-16 Yunlong Song , Sangbae Kim , Davide Scaramuzza

For the deployment of legged robots in real-world environments, it is essential to develop robust locomotion control methods for challenging terrains that may exhibit unexpected deformability and irregularity. In this paper, we explore the…

Robotics · Computer Science 2025-04-21 Rohan P. Singh , Mitsuharu Morisawa , Mehdi Benallegue , Zhaoming Xie , Fumio Kanehiro

We present a model-based framework for robot locomotion that achieves walking based on only 4.5 minutes (45,000 control steps) of data collected on a quadruped robot. To accurately model the robot's dynamics over a long horizon, we…

Machine Learning · Computer Science 2019-10-08 Yuxiang Yang , Ken Caluwaerts , Atil Iscen , Tingnan Zhang , Jie Tan , Vikas Sindhwani

Quadruped robots have shown remarkable mobility on various terrains through reinforcement learning. Yet, in the presence of sparse footholds and risky terrains such as stepping stones and balance beams, which require precise foot placement…

Robotics · Computer Science 2024-08-12 Chong Zhang , Nikita Rudin , David Hoeller , Marco Hutter

Performing agile navigation with four-legged robots is a challenging task due to the highly dynamic motions, contacts with various parts of the robot, and the limited field of view of the perception sensors. In this paper, we propose a…

Robotics · Computer Science 2023-06-27 David Hoeller , Nikita Rudin , Dhionis Sako , Marco Hutter

Massively parallel simulation has reduced reinforcement learning (RL) training time for robots from days to minutes. However, achieving fast and reliable sim-to-real RL for humanoid control remains difficult due to the challenges introduced…

Robotics · Computer Science 2025-12-02 Younggyo Seo , Carmelo Sferrazza , Juyue Chen , Guanya Shi , Rocky Duan , Pieter Abbeel

This paper presents a curriculum-based reinforcement learning framework for training precise and high-performance jumping policies for the robot `Olympus'. Separate policies are developed for vertical and horizontal jumps, leveraging a…

Robotics · Computer Science 2025-10-29 Jørgen Anker Olsen , Lars Rønhaug Pettersen , Kostas Alexis

Reliable bipedal walking over complex terrain is a challenging problem, using a curriculum can help learning. Curriculum learning is the idea of starting with an achievable version of a task and increasing the difficulty as a success…

Robotics · Computer Science 2021-02-03 Brendan Tidd , Nicolas Hudson , Akansel Cosgun

Machine learning algorithms have found several applications in the field of robotics and control systems. The control systems community has started to show interest towards several machine learning algorithms from the sub-domains such as…

Robotics · Computer Science 2018-07-18 Arun Kumar , Navneet Paul , S N Omkar

Deep reinforcement learning (RL) has achieved many recent successes, yet experiment turn-around time remains a key bottleneck in research and in practice. We investigate how to optimize existing deep RL algorithms for modern computers,…

Machine Learning · Computer Science 2019-01-14 Adam Stooke , Pieter Abbeel

Most Deep Reinforcement Learning (Deep RL) algorithms require a prohibitively large number of training samples for learning complex tasks. Many recent works on speeding up Deep RL have focused on distributed training and simulation. While…

Robotics · Computer Science 2018-10-25 Jacky Liang , Viktor Makoviychuk , Ankur Handa , Nuttapong Chentanez , Miles Macklin , Dieter Fox

Learning various motor skills for quadrupedal robots is a challenging problem that requires careful design of task-specific mathematical models or reward descriptions. In this work, we propose to learn a single capable policy using deep…

Robotics · Computer Science 2023-03-28 Arnaud Klipfel , Nitish Sontakke , Ren Liu , Sehoon Ha
‹ Prev 1 2 3 10 Next ›