English
Related papers

Related papers: Learning Whole-body Motor Skills for Humanoids

200 papers

Recently, reinforcement learning has become a promising and polular solution for robot legged locomotion. Compared to model-based control, reinforcement learning based controllers can achieve better robustness against uncertainties of…

Robotics · Computer Science 2023-10-09 Yikai Wang , Zheyuan Jiang , Jianyu Chen

Reinforcement learning has received high research interest for developing planning approaches in automated driving. Most prior works consider the end-to-end planning task that yields direct control commands and rarely deploy their algorithm…

Robotics · Computer Science 2023-07-31 Marvin Klimke , Benjamin Völz , Michael Buchholz

Reinforcement learning provides a powerful and flexible framework for automated acquisition of robotic motion skills. However, applying reinforcement learning requires a sufficiently detailed representation of the state, including the…

Machine Learning · Computer Science 2016-03-02 Chelsea Finn , Xin Yu Tan , Yan Duan , Trevor Darrell , Sergey Levine , Pieter Abbeel

Designing effective rehabilitation strategies for upper extremities, particularly hands and fingers, warrants the need for a computational model of human motor learning. The presence of large degrees of freedom (DoFs) available in these…

Systems and Control · Electrical Eng. & Systems 2022-09-13 Ankur Kamboj , Rajiv Ranganathan , Xiaobo Tan , Vaibhav Srivastava

Designing control policies for legged locomotion is complex due to the under-actuated and non-continuous robot dynamics. Model-free reinforcement learning provides promising tools to tackle this challenge. However, a major bottleneck of…

Robotics · Computer Science 2022-03-08 Tsung-Yen Yang , Tingnan Zhang , Linda Luu , Sehoon Ha , Jie Tan , Wenhao Yu

Reinforcement learning (RL) has demonstrated impressive performance in legged locomotion over various challenging environments. However, due to the sim-to-real gap and lack of explainability, unconstrained RL policies deployed in the real…

Robotics · Computer Science 2025-06-06 Haoyu Wang , Ruyi Zhou , Liang Ding , Tie Liu , Zhelin Zhang , Peng Xu , Haibo Gao , Zongquan Deng

Legged robots have enormous potential in their range of capabilities, from navigating unstructured terrains to high-speed running. However, designing robust controllers for highly agile dynamic motions remains a substantial challenge for…

Robotics · Computer Science 2023-04-20 Laura Smith , J. Chase Kew , Tianyu Li , Linda Luu , Xue Bin Peng , Sehoon Ha , Jie Tan , Sergey Levine

Soft robotic manipulators offer operational advantage due to their compliant and deformable structures. However, their inherently nonlinear dynamics presents substantial challenges. Traditional analytical methods often depend on simplifying…

Robotics · Computer Science 2024-10-28 Uljad Berdica , Matthew Jackson , Niccolò Enrico Veronese , Jakob Foerster , Perla Maiolino

In this work, we propose a hybrid hierarchical control framework for reactive dexterous grasping that explicitly decouples high-level spatial intent from low-level joint execution. We introduce a multi-agent reinforcement learning…

Robotics · Computer Science 2026-05-06 Ho Jae Lee , Yonghyeon Lee , Alexander Alexiev , Tzu-Yuan Lin , Se Hwan Jeon , Sangbae Kim

Recent work has shown results on learning navigation policies for idealized cylinder agents in simulation and transferring them to real wheeled robots. Deploying such navigation policies on legged robots can be challenging due to their…

Robotics · Computer Science 2021-09-14 Joanne Truong , Denis Yarats , Tianyu Li , Franziska Meier , Sonia Chernova , Dhruv Batra , Akshara Rai

In recent years, Deep Reinforcement Learning emerged as a promising approach for autonomous navigation of ground vehicles and has been utilized in various areas of navigation such as cruise control, lane changing, or obstacle avoidance.…

Robotics · Computer Science 2023-02-07 Linh Kästner , Marvin Meusel , Teham Bhuiyan , Jens Lambrecht

Musculoskeletal robots provide superior advantages in flexibility and dexterity, positioning them as a promising frontier towards embodied intelligence. However, current research is largely confined to relative simple tasks, restricting the…

Robotics · Computer Science 2026-03-10 Wentao Zhao , Jun Guo , Kangyao Huang , Xin Liu , Huaping Liu

Human motion is highly diverse and dynamic, posing challenges for imitation learning algorithms that aim to generalize motor skills for controlling simulated characters. Previous methods typically rely on a universal full-body controller…

Computer Vision and Pattern Recognition · Computer Science 2025-02-21 Yiming Huang , Zhiyang Dou , Lingjie Liu

Learning to manipulate objects efficiently, particularly those involving sustained contact (e.g., pushing, sliding) and articulated parts (e.g., drawers, doors), presents significant challenges. Traditional methods, such as robot-centric…

Robotics · Computer Science 2025-03-18 Shijie Fang , Wenchang Gao , Shivam Goel , Christopher Thierauf , Matthias Scheutz , Jivko Sinapov

Among the infinite number of possible movements that can be produced, humans are commonly assumed to choose those that optimize criteria such as minimizing movement time, subject to certain movement constraints like signal-dependent and…

Quantitative Methods · Quantitative Biology 2022-04-21 Florian Fischer , Miroslav Bachinski , Markus Klar , Arthur Fleig , Jörg Müller

Recent studies have demonstrated the immense potential of exploiting muscle actuator morphology for natural and robust movement -- in simulation. A validation on real robotic hardware is yet missing. In this study, we emulate muscle…

Robotics · Computer Science 2025-07-10 Pierre Schumacher , Lorenz Krause , Jan Schneider , Dieter Büchler , Georg Martius , Daniel Haeufle

Deep Reinforcement Learning (RL) has shown great success in learning complex control policies for a variety of applications in robotics. However, in most such cases, the hardware of the robot has been considered immutable, modeled as part…

Robotics · Computer Science 2020-11-10 Tianjian Chen , Zhanpeng He , Matei Ciocarlie

Robots often face situations where grasping a goal object is desirable but not feasible due to other present objects preventing the grasp action. We present a deep Reinforcement Learning approach to learn grasping and pushing policies for…

Robotics · Computer Science 2024-03-19 Yongliang Wang , Kamal Mokhtar , Cock Heemskerk , Hamidreza Kasaei

Reinforcement learning has been widely applied to robotic control, but effective policy learning under partial observability remains a major challenge, especially in high-dimensional tasks like humanoid locomotion. To date, no prior work…

Artificial Intelligence · Computer Science 2025-07-28 Wuhao Wang , Zhiyong Chen

Designing agile locomotion for quadruped robots often requires extensive expertise and tedious manual tuning. In this paper, we present a system to automate this process by leveraging deep reinforcement learning techniques. Our system can…