English
Related papers

Related papers: Learning agile and dynamic motor skills for legged…

200 papers

Learned Neural Network based policies have shown promising results for robot navigation. However, most of these approaches fall short of being used on a real robot due to the extensive simulated training they require. These simulations lack…

Robotics · Computer Science 2019-08-30 Ayzaan Wahid , Alexander Toshev , Marek Fiser , Tsang-Wei Edward Lee

This paper addresses the challenge of terrain-adaptive dynamic locomotion in humanoid robots, a problem traditionally tackled by optimization-based methods or reinforcement learning (RL). Optimization-based methods, such as model-predictive…

Robotics · Computer Science 2024-07-30 Shangqun Yu , Nisal Perera , Daniel Marew , Donghyun Kim

Animals have remarkable abilities to adapt locomotion to different terrains and tasks. However, robots trained by means of reinforcement learning are typically able to solve only a single task and a transferred policy is usually inferior to…

Robotics · Computer Science 2021-07-09 Arsen Kuzhamuratov , Dmitry Sorokin , Alexander Ulanov , A. I. Lvovsky

Quadrotors are highly nonlinear dynamical systems that require carefully tuned controllers to be pushed to their physical limits. Recently, learning-based control policies have been proposed for quadrotors, as they would potentially allow…

Robotics · Computer Science 2022-02-23 Elia Kaufmann , Leonard Bauersfeld , Davide Scaramuzza

The agility of animals, particularly in complex activities such as running, turning, jumping, and backflipping, stands as an exemplar for robotic system design. Transferring this suite of behaviors to legged robotic systems introduces…

Robotics · Computer Science 2025-05-06 Ruihan Yang , Zhuoqun Chen , Jianhan Ma , Chongyi Zheng , Yiyu Chen , Quan Nguyen , Xiaolong Wang

This work explores the potential of using differentiable simulation for learning quadruped locomotion. Differentiable simulation promises fast convergence and stable training by computing low-variance first-order gradients using robot…

Robotics · Computer Science 2024-10-16 Yunlong Song , Sangbae Kim , Davide Scaramuzza

Reinforcement learning (RL) has demonstrated impressive performance in legged locomotion over various challenging environments. However, due to the sim-to-real gap and lack of explainability, unconstrained RL policies deployed in the real…

Robotics · Computer Science 2025-06-06 Haoyu Wang , Ruyi Zhou , Liang Ding , Tie Liu , Zhelin Zhang , Peng Xu , Haibo Gao , Zongquan Deng

Motor thermal management is often overlooked in the context of electrically-actuated robots, particularly legged robots, but motor overheating is a key factor that limits long-duration locomotion especially under payload conditions. This…

Robotics · Computer Science 2026-05-27 Yuhang Wan , Weixian Lin , Letian Qian , Yiqi Zou , Weiwei Wu , Shengwei Wu , Chuanlin Zhao , Xin Luo

In this paper, we present a general learning framework for controlling a quadruped robot that can mimic the behavior of real animals and traverse challenging terrains. Our method consists of two steps: an imitation learning step to learn…

Robotics · Computer Science 2023-08-08 Tingguang Li , Yizheng Zhang , Chong Zhang , Qingxu Zhu , Jiapeng sheng , Wanchao Chi , Cheng Zhou , Lei Han

While the recent advances in deep reinforcement learning have achieved impressive results in learning motor skills, many of the trained policies are only capable within a limited set of initial states. We propose a technique to break down a…

Robotics · Computer Science 2018-11-19 Visak C. V. Kumar , Sehoon Ha , C. Karen Liu

Equipping quadruped robots with manipulators provides unique loco-manipulation capabilities, enabling diverse practical applications. This integration creates a more complex system that has increased difficulties in modeling and control.…

Robotics · Computer Science 2025-07-08 Dianyong Hou , Chengrui Zhu , Zhen Zhang , Zhibin Li , Chuang Guo , Yong Liu

Model-free reinforcement learning is a promising approach for autonomously solving challenging robotics control problems, but faces exploration difficulty without information of the robot's kinematics and dynamics morphology. The…

For locomotion, is an arm on a legged robot a liability or an asset for locomotion? Biological systems evolved additional limbs beyond legs that facilitates postural control. This work shows how a manipulator can be an asset for legged…

Robotics · Computer Science 2024-07-26 Huang Huang , Antonio Loquercio , Ashish Kumar , Neerja Thakkar , Ken Goldberg , Jitendra Malik

Quadruped robots face limitations in long-range navigation efficiency due to their reliance on legs. To ameliorate the limitations, we introduce a Reinforcement Learning-based Active Transporter Riding method (\textit{RL-ATR}), inspired by…

Robotics · Computer Science 2026-02-10 Minsung Yoon , Sung-Eui Yoon

We study how robots can autonomously learn skills that require a combination of navigation and grasping. While reinforcement learning in principle provides for automated robotic skill learning, in practice reinforcement learning in the real…

Machine Learning · Computer Science 2021-12-08 Charles Sun , Jędrzej Orbik , Coline Devin , Brian Yang , Abhishek Gupta , Glen Berseth , Sergey Levine

The adaptive learning capabilities seen in biological neural networks are largely a product of the self-modifying behavior emerging from online plastic changes in synaptic connectivity. Current methods in Reinforcement Learning (RL) only…

Neural and Evolutionary Computing · Computer Science 2020-06-16 Samuel Schmidgall

Skill-based reinforcement learning (RL) has emerged as a promising strategy to leverage prior knowledge for accelerated robot learning. Skills are typically extracted from expert demonstrations and are embedded into a latent space from…

Robotics · Computer Science 2022-11-07 Krishan Rana , Ming Xu , Brendan Tidd , Michael Milford , Niko Sünderhauf

Robot assistants for older adults and people with disabilities need to interact with their users in collaborative tasks. The core component of these systems is an interaction manager whose job is to observe and assess the task, and infer…

Quadruped robots demonstrate exceptional potential for navigating complex terrain in critical applications such as search and rescue missions and infrastructure inspection However autonomous traversal of confined 3D environments including…

Robotics · Computer Science 2026-05-14 Amir Hossain Raj , Dibyendu Das , Xuesu Xiao

Quadrupedal animals can perform agile and playful tasks while interacting with real-world objects. For instance, a trained dog can track and catch a flying frisbee before it touches the ground, while a cat left alone at home may leap to…

Robotics · Computer Science 2025-03-19 Xin Duan , Ziwen Zhuang , Hang Zhao , Soeren Schwertfeger