English
Related papers

Related papers: Learning Whole-body Motor Skills for Humanoids

200 papers

Learning a control policy for a multi-phase, long-horizon task, such as basketball maneuvers, remains challenging for reinforcement learning approaches due to the need for seamless policy composition and transitions between skills. A…

Visual-inertial sensors have a wide range of applications in robotics. However, good performance often requires different sophisticated motion routines to accurately calibrate camera intrinsics and inter-sensor extrinsics. This work…

Robotics · Computer Science 2021-10-01 Yunke Ao , Le Chen , Florian Tschopp , Michel Breyer , Andrei Cramariuc , Roland Siegwart

Legged robots pose one of the greatest challenges in robotics. Dynamic and agile maneuvers of animals cannot be imitated by existing methods that are crafted by humans. A compelling alternative is reinforcement learning, which requires…

Existing learning approaches to dexterous manipulation use demonstrations or interactions with the environment to train black-box neural networks that provide little control over how the robot learns the skills or how it would perform post…

Robotics · Computer Science 2023-01-25 Abhineet Jain , Jack Kolb , Harish Ravichandar

This paper addresses the problem of legged locomotion in non-flat terrain. As legged robots such as quadrupeds are to be deployed in terrains with geometries which are difficult to model and predict, the need arises to equip them with the…

Robotics · Computer Science 2020-02-03 Vassilios Tsounis , Mitja Alge , Joonho Lee , Farbod Farshidian , Marco Hutter

Amphibious legged robots inspired by salamanders are promising in applications in complex amphibious environments. However, despite the significant success of training controllers that achieve diverse locomotion behaviors in conventional…

Robotics · Computer Science 2026-03-18 Mengze Tian , Qiyuan Fu , Chuanfang Ning , Javier Jia Jie Pey , Auke Ijspeert

Controlled gliding is one of the most energetically efficient modes of transportation for natural and human powered fliers. Here we demonstrate that gliding and landing strategies with different optimality criteria can be identified through…

Robotics · Computer Science 2018-07-11 Guido Novati , Lakshminarayanan Mahadevan , Petros Koumoutsakos

Humanoid robots remain vulnerable to falls and unrecoverable failure states, limiting their practical utility in unstructured environments. While reinforcement learning has demonstrated stand-up behaviors, existing approaches treat recovery…

Robotics · Computer Science 2026-03-10 Nehar Poddar , Stephen McCrory , Luigi Penco , Geoffrey Clark , Hakki Erhan Svil , Robert Griffin

Whole-body manipulation (WBM) for humanoid robots presents a promising approach for executing embracing tasks involving bulky objects, where traditional grasping relying on end-effectors only remains limited in such scenarios due to…

Robotics · Computer Science 2025-09-18 Chunxin Zheng , Kai Chen , Zhihai Bi , Yulin Li , Liang Pan , Jinni Zhou , Haoang Li , Jun Ma

Recent advancements in reinforcement learning (RL) have led to significant progress in humanoid robot locomotion, simplifying the design and training of motion policies in simulation. However, the numerous implementation details make…

Robotics · Computer Science 2025-06-19 Yushi Wang , Penghui Chen , Xinyu Han , Feng Wu , Mingguo Zhao

The focus of this work is to enumerate the various approaches and algorithms that center around application of reinforcement learning in robotic ma- ]]nipulation tasks. Earlier methods utilized specialized policy representations and human…

Robotics · Computer Science 2017-02-01 Smruti Amarjyoti

Complex high-dimensional spaces with high Degree-of-Freedom and complicated action spaces, such as humanoid robots equipped with dexterous hands, pose significant challenges for reinforcement learning (RL) algorithms, which need to wisely…

Robotics · Computer Science 2025-02-25 Zifeng Zhuang , Diyuan Shi , Runze Suo , Xiao He , Hongyin Zhang , Ting Wang , Shangke Lyu , Donglin Wang

Automating the segregation process is a need for every sector experiencing a high volume of materials handling, repetitive and exhaustive operations, in addition to risky exposures. Learning automated pick-and-place operations can be…

Machine Learning · Computer Science 2024-04-30 Hariharan Arunachalam , Marc Hanheide , Sariah Mghames

We explore sim-to-real transfer of deep reinforcement learning controllers for a heavy vehicle with active suspensions designed for traversing rough terrain. While related research primarily focuses on lightweight robots with electric…

Animals learn to adapt speed of their movements to their capabilities and the environment they observe. Mobile robots should also demonstrate this ability to trade-off aggressiveness and safety for efficiently accomplishing tasks. The aim…

Robotics · Computer Science 2024-07-11 Guangyu Zhao , Tianyue Wu , Yeke Chen , Fei Gao

For the task with complicated manipulation in unstructured environments, traditional hand-coded methods are ineffective, while reinforcement learning can provide more general and useful policy. Although the reinforcement learning is able to…

Robotics · Computer Science 2025-12-03 Nan Lin , Linrui Zhang , Yuxuan Chen , Zhenrui Chen , Yujun Zhu , Ruoxi Chen , Peichen Wu , Xiaoping Chen

We propose a method of learning a policy for human-like locomotion via deep reinforcement learning based on a human anatomical model, muscle actuation, and biologically inspired rewards, without any inherent control rules or reference…

Graphics · Computer Science 2024-01-30 Minkwan Kim , Yoonsang Lee

While the recent advances in deep reinforcement learning have achieved impressive results in learning motor skills, many of the trained policies are only capable within a limited set of initial states. We propose a technique to break down a…

Robotics · Computer Science 2018-11-19 Visak C. V. Kumar , Sehoon Ha , C. Karen Liu

Learning a robot motor skill from scratch is impractically slow; so much so that in practice, learning must be bootstrapped using a good skill policy obtained from human demonstration. However, relying on human demonstration necessarily…

Robotics · Computer Science 2021-01-14 Ben Abbatematteo , Eric Rosen , Stefanie Tellex , George Konidaris

Robot arms should be able to learn new tasks. One framework here is reinforcement learning, where the robot is given a reward function that encodes the task, and the robot autonomously learns actions to maximize its reward. Existing…

Robotics · Computer Science 2024-03-21 Shaunak A. Mehta , Soheil Habibian , Dylan P. Losey