English
Related papers

Related papers: Sim-to-Real Learning for Humanoid Box Loco-Manipul…

200 papers

This paper presents a novel learning-based approach to dynamic robot-to-human handover, addressing the challenges of delivering objects to a moving receiver. We hypothesize that dynamic handover, where the robot adjusts to the receiver's…

Robotics · Computer Science 2025-02-19 Hyeonseong Kim , Chanwoo Kim , Matthew Pan , Kyungjae Lee , Sungjoon Choi

Humanoid robots promise transformative capabilities for industrial and service applications. While recent advances in Reinforcement Learning (RL) yield impressive results in locomotion, manipulation, and navigation, the proposed methods…

Robotics · Computer Science 2025-08-12 Feiyang Wu , Xavier Nal , Jaehwi Jang , Wei Zhu , Zhaoyuan Gu , Anqi Wu , Ye Zhao

We present a low-cost legged mobile manipulation system that solves long-horizon real-world tasks, trained by reinforcement learning purely in simulation. This system is made possible by 1) a hierarchical design of a high-level policy for…

Robotics · Computer Science 2025-01-31 Haichao Zhang , Haonan Yu , Le Zhao , Andrew Choi , Qinxun Bai , Break Yang , Wei Xu

Controlling contact forces during interactions is critical for locomotion and manipulation tasks. While sim-to-real reinforcement learning (RL) has succeeded in many contact-rich problems, current RL methods achieve forceful interactions…

Robotics · Computer Science 2024-05-21 Tifanny Portela , Gabriel B. Margolis , Yandong Ji , Pulkit Agrawal

We tackle the problem of developing humanoid loco-manipulation skills with deep imitation learning. The difficulty of collecting task demonstrations and training policies for humanoids with a high degree of freedom presents substantial…

Robotics · Computer Science 2023-11-21 Mingyo Seo , Steve Han , Kyutae Sim , Seung Hyeon Bang , Carlos Gonzalez , Luis Sentis , Yuke Zhu

Reinforcement learning (RL) for bipedal locomotion has recently demonstrated robust gaits over moderate terrains using only proprioceptive sensing. However, such blind controllers will fail in environments where robots must anticipate and…

Robotics · Computer Science 2024-07-10 Helei Duan , Bikram Pandit , Mohitvishnu S. Gadde , Bart van Marum , Jeremy Dao , Chanho Kim , Alan Fern

Humans' ability to smoothly switch between locomotion and manipulation is a remarkable feature of sensorimotor coordination. Leaning and replication of such human-like strategies can lead to the development of more sophisticated robots…

Robotics · Computer Science 2024-02-22 Jianzhuang Zhao , Francesco Tassi , Yanlong Huang , Elena De Momi , Arash Ajoudani

Humanoid robots hold great promise in assisting humans in diverse environments and tasks, due to their flexibility and adaptability leveraging human-like morphology. However, research in humanoid robots is often bottlenecked by the costly…

Robotics · Computer Science 2024-06-21 Carmelo Sferrazza , Dun-Ming Huang , Xingyu Lin , Youngwoon Lee , Pieter Abbeel

Human-robot shared control, which integrates the advantages of both humans and robots, is an effective approach to facilitate efficient surgical operation. Learning from demonstration (LfD) techniques can be used to automate some of the…

Simulation-based reinforcement learning (RL) has significantly advanced humanoid locomotion tasks, yet direct real-world RL from scratch or adapting from pretrained policies remains rare, limiting the full potential of humanoid robots.…

Robotics · Computer Science 2025-08-27 Kaizhe Hu , Haochen Shi , Yao He , Weizhuo Wang , C. Karen Liu , Shuran Song

Imitation learning has been actively studied in recent years. In particular, skill acquisition by a robot with a fixed body, whose root link position and posture and camera angle of view do not change, has been realized in many cases. On…

Robotics · Computer Science 2023-12-19 Yutaro Matsuura , Kento Kawaharazuka , Naoki Hiraoka , Kunio Kojima , Kei Okada , Masayuki Inaba

We study the problem of realizing the full spectrum of bipedal locomotion on a real robot with sim-to-real reinforcement learning (RL). A key challenge of learning legged locomotion is describing different gaits, via reward functions, in a…

Robotics · Computer Science 2021-03-12 Jonah Siekmann , Yesh Godse , Alan Fern , Jonathan Hurst

This paper presents Adaptive Whole-body Loco-Manipulation, AdaptManip, a fully autonomous framework for humanoid robots to perform integrated navigation, object lifting, and delivery. Unlike prior imitation learning-based approaches that…

Robotics · Computer Science 2026-02-17 Morgan Byrd , Donghoon Baek , Kartik Garg , Hyunyoung Jung , Daesol Cho , Maks Sorokin , Robert Wright , Sehoon Ha

Locomotion has seen dramatic progress for walking or running across challenging terrains. However, robotic quadrupeds are still far behind their biological counterparts, such as dogs, which display a variety of agile skills and can use the…

Robotics · Computer Science 2023-03-23 Xuxin Cheng , Ashish Kumar , Deepak Pathak

Legged manipulators extend robotic capabilities beyond static manipulation by integrating agile locomotion with versatile arm control. However, achieving precise manipulation while maintaining coordinated locomotion remains a major…

Deep reinforcement learning has seen successful implementations on humanoid robots to achieve dynamic walking. However, these implementations have been so far successful in simple environments void of obstacles. In this paper, we aim to…

Robotics · Computer Science 2024-10-14 Marwan Hamze , Mitsuharu Morisawa , Eiichi Yoshida

This paper presents a hierarchical framework for Deep Reinforcement Learning that acquires motor skills for a variety of push recovery and balancing behaviors, i.e., ankle, hip, foot tilting, and stepping strategies. The policy is trained…

Robotics · Computer Science 2020-02-11 Chuanyu Yang , Kai Yuan , Wolfgang Merkt , Taku Komura , Sethu Vijayakumar , Zhibin Li

Although humanoid and quadruped robots provide a wide range of capabilities, current control methods, such as Deep Reinforcement Learning, focus mainly on single skills. This approach is inefficient for solving more complicated tasks where…

Robotics · Computer Science 2025-09-22 Maciej Stępień , Rafael Kourdis , Constant Roux , Olivier Stasse

Whole-body loco-manipulation for quadruped robots with arms remains a challenging problem, particularly in achieving multi-task control. To address this, we propose MLM, a reinforcement learning framework driven by both real-world and…

Humanoid robots hold great potential to perform various human-level skills, involving unified locomotion and manipulation in real-world settings. Driven by advances in machine learning and the strength of existing model-based approaches,…