English
Related papers

Related papers: Humanoid-Gym: Reinforcement Learning for Humanoid …

200 papers

Whole-body manipulation is a powerful yet underexplored approach that enables robots to interact with large, heavy, or awkward objects using more than just their end-effectors. Soft robots, with their inherent passive compliance, are…

Robotics · Computer Science 2025-09-30 Curtis C. Johnson , Carlo Alessi , Egidio Falotico , Marc D. Killpack

In this work we propose a learning-based approach to box loco-manipulation for a humanoid robot. This is a particularly challenging problem due to the need for whole-body coordination in order to lift boxes of varying weight, position, and…

Robotics · Computer Science 2023-10-06 Jeremy Dao , Helei Duan , Alan Fern

Humanoid robots are envisioned as embodied intelligent agents capable of performing a wide range of human-level loco-manipulation tasks, particularly in scenarios requiring strenuous and repetitive labor. However, learning these skills is…

Robotics · Computer Science 2024-12-20 Junjia Liu , Zhuo Li , Minghao Yu , Zhipeng Dong , Sylvain Calinon , Darwin Caldwell , Fei Chen

Humanoid locomotion is a key skill to bring humanoids out of the lab and into the real-world. Many motion generation methods for locomotion have been proposed including reinforcement learning (RL). RL locomotion policies offer great…

Robotics · Computer Science 2024-07-09 William Thibault , William Melek , Katja Mombaur

Humanoid robots hold great promise in assisting humans in diverse environments and tasks, due to their flexibility and adaptability leveraging human-like morphology. However, research in humanoid robots is often bottlenecked by the costly…

Robotics · Computer Science 2024-06-21 Carmelo Sferrazza , Dun-Ming Huang , Xingyu Lin , Youngwoon Lee , Pieter Abbeel

Isaac Gym offers a high performance learning platform to train policies for wide variety of robotics tasks directly on GPU. Both physics simulation and the neural network policy training reside on GPU and communicate by directly passing…

The design of feedback controllers for bipedal robots is challenging due to the hybrid nature of its dynamics and the complexity imposed by high-dimensional bipedal models. In this paper, we present a novel approach for the design of…

Robotics · Computer Science 2018-10-05 Guillermo A. Castillo , Bowen Weng , Ayonga Hereid , Wei Zhang

Realizing versatile and human-like performance in high-demand sports like badminton remains a formidable challenge for humanoid robotics. Unlike standard locomotion or static manipulation, this task demands a seamless integration of…

This work presents a meta-reinforcement learning approach to develop a universal locomotion control policy capable of zero-shot generalization across diverse quadrupedal platforms. The proposed method trains an RL agent equipped with a…

Robotics · Computer Science 2024-11-05 Fatemeh Zargarbashi , Fabrizio Di Giuro , Jin Cheng , Dongho Kang , Bhavya Sukhija , Stelian Coros

Recently, humanoid robots have made significant advances in their ability to perform challenging tasks due to the deployment of Reinforcement Learning (RL), however, the inherent complexity of humanoid robots, including the difficulty of…

Sim-to-real reinforcement learning (RL) for humanoid robots with high-gear ratio actuators remains challenging due to complex actuator dynamics and the absence of torque sensors. To address this, we propose a novel RL framework leveraging…

Robotics · Computer Science 2025-04-14 Sotaro Katayama , Yuta Koda , Norio Nagatsuka , Masaya Kinoshita

The rapid advancement of humanoid robotics has intensified the need for robust and adaptable controllers to enable stable and efficient locomotion across diverse platforms. However, developing such controllers remains a significant…

Robotics · Computer Science 2025-12-02 Yunfeng Lin , Minghuan Liu , Yufei Xue , Ming Zhou , Yong Yu , Jiangmiao Pang , Weinan Zhang

We introduce LHM-Humanoid, a benchmark and learning framework for long-horizon whole-body humanoid loco-manipulation in diverse, cluttered scenes. In our setting, multiple objects are displaced from their intended locations and may obstruct…

Robotics · Computer Science 2026-03-06 Haozhuo Zhang , Jingkai Sun , Michele Caprio , Jian Tang , Shanghang Zhang , Qiang Zhang , Wei Pan

Humanoid robots have the potential to mimic human motions with high visual fidelity, yet translating these motions into practical, physical execution remains a significant challenge. Existing techniques in the graphics community often…

Robotics · Computer Science 2025-02-18 Yashuai Yan , Esteve Valls Mascaro , Tobias Egle , Dongheui Lee

Designing agile locomotion for quadruped robots often requires extensive expertise and tedious manual tuning. In this paper, we present a system to automate this process by leveraging deep reinforcement learning techniques. Our system can…

Scalable learning of humanoid robots is crucial for their deployment in real-world applications. While traditional approaches primarily rely on reinforcement learning or teleoperation to achieve whole-body control, they are often limited by…

Humanoid loco-manipulation in unstructured environments demands tight integration of egocentric perception and whole-body control. However, existing approaches either depend on external motion capture systems or fail to generalize across…

Robotics · Computer Science 2025-11-14 Shaofeng Yin , Yanjie Ze , Hong-Xing Yu , C. Karen Liu , Jiajun Wu

Humanoid robots, with their human-like skeletal structure, are especially suited for tasks in human-centric environments. However, this structure is accompanied by additional challenges in locomotion controller design, especially in complex…

Robotics · Computer Science 2024-08-27 Xinyang Gu , Yen-Jen Wang , Xiang Zhu , Chengming Shi , Yanjiang Guo , Yichen Liu , Jianyu Chen

Applying Deep Reinforcement Learning (DRL) to complex tasks in the field of robotics has proven to be very successful in the recent years. However, most of the publications focus either on applying it to a task in simulation or to a task in…

Robotics · Computer Science 2020-11-17 Matteo Lucchi , Friedemann Zindler , Stephan Mühlbacher-Karrer , Horst Pichler

Humanoid robots deployed in industrial environments are required to perform load-carrying transportation tasks that tightly couple locomotion and manipulation. However, achieving stable and robust locomotion under varying payloads and…

Robotics · Computer Science 2026-03-17 Lequn Fu , Yijun Zhong , Xiao Li , Yibin Liu , Zhiyuan Xu , Jian Tang , Shiqi Li