English
Related papers

Related papers: Sim-to-Real Learning for Humanoid Box Loco-Manipul…

200 papers

We present Human to Humanoid (H2O), a reinforcement learning (RL) based framework that enables real-time whole-body teleoperation of a full-sized humanoid robot with only an RGB camera. To create a large-scale retargeted motion dataset of…

Robotics · Computer Science 2024-03-08 Tairan He , Zhengyi Luo , Wenli Xiao , Chong Zhang , Kris Kitani , Changliu Liu , Guanya Shi

Most successes in robotic manipulation have been restricted to single-arm robots, which limits the range of solvable tasks to pick-and-place, insertion, and objects rearrangement. In contrast, dual and multi arm robot platforms unlock a…

Robotics · Computer Science 2022-03-17 Satoshi Kataoka , Seyed Kamyar Seyed Ghasemipour , Daniel Freeman , Igor Mordatch

Transferring human motion to a mobile robotic manipulator and ensuring safe physical human-robot interaction are crucial steps towards automating complex manipulation tasks in human-shared environments. In this work, we present a novel…

Robotics · Computer Science 2021-10-26 Miguel Arduengo , Ana Arduengo , Adrià Colomé , Joan Lobo-Prat , Carme Torras

Humanoid-Gym is an easy-to-use reinforcement learning (RL) framework based on Nvidia Isaac Gym, designed to train locomotion skills for humanoid robots, emphasizing zero-shot transfer from simulation to the real-world environment.…

Robotics · Computer Science 2024-05-21 Xinyang Gu , Yen-Jen Wang , Jianyu Chen

Balancing and push-recovery are essential capabilities enabling humanoid robots to solve complex locomotion tasks. In this context, classical control systems tend to be based on simplified physical models and hard-coded strategies. Although…

Imitation learning is a promising approach for training humanoid robots to both walk and manipulate, but it requires a large number of demonstrations, which are time-intensive and difficult to collect via teleoperation. Existing…

Realizing versatile and human-like performance in high-demand sports like badminton remains a formidable challenge for humanoid robotics. Unlike standard locomotion or static manipulation, this task demands a seamless integration of…

Applying end-to-end learning to solve complex, interactive, pixel-driven control tasks on a robot is an unsolved problem. Deep Reinforcement Learning algorithms are too slow to achieve performance on a real robot, but their potential has…

Robotics · Computer Science 2018-05-23 Andrei A. Rusu , Mel Vecerik , Thomas Rothörl , Nicolas Heess , Razvan Pascanu , Raia Hadsell

Humans possess a large reachable space in the 3D world, enabling interaction with objects at varying heights and distances. However, realizing such large-space reaching on humanoids is a complex whole-body control problem and requires the…

Robotics · Computer Science 2025-12-19 Zhikai Zhang , Chao Chen , Han Xue , Jilong Wang , Sikai Liang , Yun Liu , Zongzhang Zhang , He Wang , Li Yi

This paper presents a new learning framework that leverages the knowledge from imitation learning, deep reinforcement learning, and control theories to achieve human-style locomotion that is natural, dynamic, and robust for humanoids. We…

Robotics · Computer Science 2021-02-15 Chuanyu Yang , Kai Yuan , Shuai Heng , Taku Komura , Zhibin Li

State-of-the-art reinforcement learning is now able to learn versatile locomotion, balancing and push-recovery capabilities for bipedal robots in simulation. Yet, the reality gap has mostly been overlooked and the simulated results hardly…

Robotics · Computer Science 2023-01-02 Alexis Duburcq , Fabian Schramm , Guilhem Boéris , Nicolas Bredeche , Yann Chevaleyre

Motion mimicking, i.e., encouraging the control policy to mimic human motion, facilitates the learning of complex tasks via reinforcement learning (RL) for humanoid robots. Although standard RL frameworks demonstrate impressive locomotion…

Robotics · Computer Science 2026-03-10 Ludwig Chee-Ying Tay , I-Chia Chang , Yan Gu

We present a reinforcement learning framework for autonomous goalkeeping with humanoid robots in real-world scenarios. While prior work has demonstrated similar capabilities on quadrupedal platforms, humanoid goalkeeping introduces two…

This chapter addresses the critical challenge of simulation-to-reality (sim-to-real) transfer for deep reinforcement learning (DRL) in bipedal locomotion. After contextualizing the problem within various control architectures, we dissect…

Robotics · Computer Science 2025-11-11 Lingfan Bao , Tianhu Peng , Chengxu Zhou

Standing-up control is crucial for humanoid robots, with the potential for integration into current locomotion and loco-manipulation systems, such as fall recovery. Existing approaches are either limited to simulations that overlook…

Robotics · Computer Science 2025-04-22 Tao Huang , Junli Ren , Huayi Wang , Zirui Wang , Qingwei Ben , Muning Wen , Xiao Chen , Jianan Li , Jiangmiao Pang

Humanoid robots have the potential to help human workers by realizing physically demanding manipulation tasks such as moving large boxes within warehouses. We define such tasks as Dynamic Mobile Manipulation (DMM). This paper presents a…

Robotics · Computer Science 2023-07-06 Amartya Purushottam , Yeongtae Jung , Christopher Xu , Joao Ramos

Previous humanoid robot research works treat the robot as a bipedal mobile manipulation platform, where only the feet and hands contact the environment. However, we humans use all body parts to interact with the world, e.g., we sit in…

Robotics · Computer Science 2025-02-04 Ziwen Zhuang , Hang Zhao

Throwing with a legged robot involves precise coordination of object manipulation and locomotion - crucial for advanced real-world interactions. Most research focuses on either manipulation or locomotion, with minimal exploration of tasks…

Robotics · Computer Science 2025-04-02 Humphrey Munn , Brendan Tidd , Peter Böhm , Marcus Gallagher , David Howard

Incorporating a robotic manipulator into a wheel-legged robot enhances its agility and expands its potential for practical applications. However, the presence of potential instability and uncertainties presents additional challenges for…

Robotics · Computer Science 2024-03-29 Zifan Wang , Yufei Jia , Lu Shi , Haoyu Wang , Haizhou Zhao , Xueyang Li , Jinni Zhou , Jun Ma , Guyue Zhou

Humans throw and catch objects all the time. However, such a seemingly common skill introduces a lot of challenges for robots to achieve: The robots need to operate such dynamic actions at high-speed, collaborate precisely, and interact…

Robotics · Computer Science 2023-09-12 Binghao Huang , Yuanpei Chen , Tianyu Wang , Yuzhe Qin , Yaodong Yang , Nikolay Atanasov , Xiaolong Wang