English
Related papers

Related papers: Sim-to-Real Learning for Humanoid Box Loco-Manipul…

200 papers

Learning highly dynamic behaviors for robots has been a longstanding challenge. Traditional approaches have demonstrated robust locomotion, but the exhibited behaviors lack diversity and agility. They employ approximate models, which lead…

Robotics · Computer Science 2024-02-22 Chong Zhang , Jiapeng Sheng , Tingguang Li , He Zhang , Cheng Zhou , Qingxu Zhu , Rui Zhao , Yizheng Zhang , Lei Han

Motion imitation is a pivotal and effective approach for humanoid robots to achieve a more diverse range of complex and expressive movements, making their performances more human-like. However, the significant differences in kinematics and…

Robotics · Computer Science 2025-08-04 Zhenghan Chen , Haodong Zhang , Dongqi Wang , Jiyu Yu , Haocheng Xu , Yue Wang , Rong Xiong

While deep learning has had significant successes in computer vision thanks to the abundance of visual data, collecting sufficiently large real-world datasets for robot learning can be costly. To increase the practicality of these…

Robotics · Computer Science 2017-12-20 Fangyi Zhang , Jürgen Leitner , Michael Milford , Peter Corke

We explore sim-to-real transfer of deep reinforcement learning controllers for a heavy vehicle with active suspensions designed for traversing rough terrain. While related research primarily focuses on lightweight robots with electric…

Legged locomotion holds the premise of universal mobility, a critical capability for many real-world robotic applications. Both model-based and learning-based approaches have advanced the field of legged locomotion in the past three…

Robotics · Computer Science 2024-11-26 Sehoon Ha , Joonho Lee , Michiel van de Panne , Zhaoming Xie , Wenhao Yu , Majid Khadiv

Whole-body humanoid locomotion is challenging due to high-dimensional control, morphological instability, and the need for real-time adaptation to various terrains using onboard perception. Directly applying reinforcement learning (RL) with…

The simulation-to-reality (sim-to-real) transfer of large-scale hydraulic robots presents a significant challenge in robotics because of the inherent slow control response and complex fluid dynamics. The complex dynamics result from the…

Robotics · Computer Science 2026-01-19 Minho Lee , Hyeonseok Kim , Jin Tak Kim , Sangshin Park , Jeong Hyun Lee , Jungsan Cho , Jemin Hwangbo

Humanoid robotics has strong potential to transform daily service and caregiving applications. Although recent advances in general motion tracking within physics engines (GMT) have enabled virtual characters and humanoid robots to reproduce…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Yuto Shibata , Kashu Yamazaki , Lalit Jayanti , Yoshimitsu Aoki , Mariko Isogawa , Katerina Fragkiadaki

With the advent of artificial intelligence and machine learning, humanoid robots are made to learn a variety of skills which humans possess. One of fundamental skills which humans use in day-to-day activities is performing tasks with…

Robotics · Computer Science 2018-05-10 S Phaniteja , Parijat Dewangan , Pooja Guhan , K Madhava Krishna , Abhishek Sarkar

Amphibious legged robots inspired by salamanders are promising in applications in complex amphibious environments. However, despite the significant success of training controllers that achieve diverse locomotion behaviors in conventional…

Robotics · Computer Science 2026-03-18 Mengze Tian , Qiyuan Fu , Chuanfang Ning , Javier Jia Jie Pey , Auke Ijspeert

Mastering robotic manipulation skills through reinforcement learning (RL) typically requires the design of shaped reward functions. Recent developments in this area have demonstrated that using sparse rewards, i.e. rewarding the agent only…

Machine Learning · Computer Science 2021-11-12 Ozsel Kilinc , Giovanni Montana

Deep reinforcement learning (RL) has emerged as a promising approach for autonomously acquiring complex behaviors from low level sensor observations. Although a large portion of deep RL research has focused on applications in video games…

Robotics · Computer Science 2021-02-08 Julian Ibarz , Jie Tan , Chelsea Finn , Mrinal Kalakrishnan , Peter Pastor , Sergey Levine

By combining the agility of legged locomotion with the capabilities of manipulation, loco-manipulation platforms have the potential to perform complex tasks in real-world applications. To this end, state-of-the-art quadrupeds with…

Robotics · Computer Science 2025-09-30 Benjamin Hoffman , Jin Cheng , Chenhao Li , Stelian Coros

In this article, we show that learned policies can be applied to solve legged locomotion control tasks with extensive flight phases, such as those encountered in space exploration. Using an off-the-shelf deep reinforcement learning…

Robotics · Computer Science 2021-06-18 Nikita Rudin , Hendrik Kolvenbach , Vassilios Tsounis , Marco Hutter

A fundamental challenge in teaching robots is to provide an effective interface for human teachers to demonstrate useful skills to a robot. This challenge is exacerbated in dexterous manipulation, where teaching high-dimensional,…

Robotics · Computer Science 2022-10-13 Sridhar Pandian Arunachalam , Irmak Güzey , Soumith Chintala , Lerrel Pinto

Reinforcement learning and sim-to-real transfer have made significant progress in dexterous manipulation. However, progress remains limited by the difficulty of simulating complex contact dynamics and multisensory signals, especially…

Robotics · Computer Science 2026-02-26 Elvis Hsieh , Wen-Han Hsieh , Yen-Jen Wang , Toru Lin , Jitendra Malik , Koushil Sreenath , Haozhi Qi

This paper presents a novel approach for controlling humanoid robots to push heavy objects. The approach combines kinodynamics-based pose optimization and loco-manipulation model predictive control (MPC). The proposed pose optimization…

Robotics · Computer Science 2023-07-27 Junheng Li , Quan Nguyen

Whole-body manipulation (WBM) for humanoid robots presents a promising approach for executing embracing tasks involving bulky objects, where traditional grasping relying on end-effectors only remains limited in such scenarios due to…

Robotics · Computer Science 2025-09-18 Chunxin Zheng , Kai Chen , Zhihai Bi , Yulin Li , Liang Pan , Jinni Zhou , Haoang Li , Jun Ma

While it is relatively easier to train humanoid robots to mimic specific locomotion skills, it is more challenging to learn from various motions and adhere to continuously changing commands. These robots must accurately track motion…

Recently, humanoid robots have made significant advances in their ability to perform challenging tasks due to the deployment of Reinforcement Learning (RL), however, the inherent complexity of humanoid robots, including the difficulty of…