English
Related papers

Related papers: GMT: General Motion Tracking for Humanoid Whole-Bo…

200 papers

Remote physiological measurement (RPM) is an essential tool for healthcare monitoring as it enables the measurement of physiological signs, e.g., heart rate, in a remote setting via physical wearables. Recently, with facial videos, we have…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Hao Wang , Euijoon Ahn , Jinman Kim

Humanoid robots have demonstrated robust locomotion capabilities using Reinforcement Learning (RL)-based approaches. Further, to obtain human-like behaviors, existing methods integrate human motion-tracking or motion prior in the RL…

Robotics · Computer Science 2025-06-13 Dewei Wang , Xinmiao Wang , Xinzhe Liu , Jiyuan Shi , Yingnan Zhao , Chenjia Bai , Xuelong Li

This paper considers the problem of managing single or multiple robots and proposes a cloud-based robot fleet manager, Adaptive Goal Management (AGM) System, for teams of unmanned mobile robots. The AGM system uses an adaptive goal…

Robotics · Computer Science 2023-03-22 Muhammad Kazim , Michael Muldoon , Kwang-Ki K. Kim

Human motion prediction from historical pose sequence is at the core of many applications in machine intelligence. However, in current state-of-the-art methods, the predicted future motion is confined within the same activity. One can…

Computer Vision and Pattern Recognition · Computer Science 2021-03-18 Zhenguang Liu , Kedi Lyu , Shuang Wu , Haipeng Chen , Yanbin Hao , Shouling Ji

Humanoid robots are envisioned to perform a wide range of tasks in human-centered environments, requiring controllers that combine agility with robust balance. Recent advances in locomotion and whole-body tracking have enabled impressive…

Recent advancements in reinforcement learning (RL) have led to significant progress in humanoid robot locomotion, simplifying the design and training of motion policies in simulation. However, the numerous implementation details make…

Robotics · Computer Science 2025-06-19 Yushi Wang , Penghui Chen , Xinyu Han , Feng Wu , Mingguo Zhao

We present a universal motion representation that encompasses a comprehensive range of motor skills for physics-based humanoid control. Due to the high dimensionality of humanoids and the inherent difficulties in reinforcement learning,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Zhengyi Luo , Jinkun Cao , Josh Merel , Alexander Winkler , Jing Huang , Kris Kitani , Weipeng Xu

Whole-body loco-manipulation for quadruped robots with arms remains a challenging problem, particularly in achieving multi-task control. To address this, we propose MLM, a reinforcement learning framework driven by both real-world and…

Long-horizon whole-body humanoid teleoperation remains challenging due to accumulated global pose drift, particularly on full-sized humanoids. Although recent learning-based tracking methods enable agile and coordinated motions, they…

Long-horizon, high-dynamic motion tracking on humanoids remains brittle because absolute joint commands cannot compensate model-plant mismatch, leading to error accumulation. We propose RobotDancing, a simple, scalable framework that…

Robotics · Computer Science 2025-09-26 Zhenguo Sun , Yibo Peng , Yuan Meng , Xukun Li , Bo-Sheng Huang , Zhenshan Bing , Xinlong Wang , Alois Knoll

We present a reinforcement learning framework for autonomous goalkeeping with humanoid robots in real-world scenarios. While prior work has demonstrated similar capabilities on quadrupedal platforms, humanoid goalkeeping introduces two…

Cross-embodiment video generation aims to transfer motions across different humanoid embodiments, such as human-to-robot and robot-to-robot, enabling scalable data generation for embodied intelligence. A major challenge in this setting is…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Yiren Song , Xiyao Deng , Pei Yang , Yihan Wang , Mike Zheng Shou

In this report, we present HoloMotion-1, a humanoid motion foundation model for zero-shot whole-body motion tracking. A key innovation of HoloMotion-1 is to scale control-policy training with a large-scale hybrid motion corpus, where…

Robotics · Computer Science 2026-05-20 Maiyue Chen , Kaihui Wang , Bo Zhang , Xihan Ma , Zhiyuan Yang , Yi Ren , Qijun Huang , Zihao Zhu , Yucheng Wang , Zhizhong Su

We introduce a new, analytical method for generating whole-body motions for humanoid robots, which approximate the desired Composite Rigid Body (CRB) inertia. Our approach uses a reduced five mass model, where four of the masses are…

Robotics · Computer Science 2020-07-14 Grzegorz Ficht , Sven Behnke

Generating realistic human motion from given action descriptions has experienced significant advancements because of the emerging requirement of digital humans. While recent works have achieved impressive results in generating motion…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Yaqi Zhang , Di Huang , Bin Liu , Shixiang Tang , Yan Lu , Lu Chen , Lei Bai , Qi Chu , Nenghai Yu , Wanli Ouyang

Accurate control of a humanoid robot's global position (i.e., its three-dimensional position in the world) is critical to the reliable execution of high-risk tasks such as avoiding collision with pedestrians in a crowded environment. This…

Robotics · Computer Science 2023-04-28 Yuan Gao , Kentaro Barhydt , Christopher Niezrecki , Yan Gu

Human motion generation, a cornerstone technique in animation and video production, has widespread applications in various tasks like text-to-motion and music-to-dance. Previous works focus on developing specialist models tailored for each…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Mingyuan Zhang , Daisheng Jin , Chenyang Gu , Fangzhou Hong , Zhongang Cai , Jingfang Huang , Chongzhi Zhang , Xinying Guo , Lei Yang , Ying He , Ziwei Liu

Despite the rise of billion-parameter foundation models trained across thousands of GPUs, similar scaling gains have not been shown for humanoid control. Current neural controllers for humanoids remain modest in size, target a limited set…

This work presents a meta-reinforcement learning approach to develop a universal locomotion control policy capable of zero-shot generalization across diverse quadrupedal platforms. The proposed method trains an RL agent equipped with a…

Robotics · Computer Science 2024-11-05 Fatemeh Zargarbashi , Fabrizio Di Giuro , Jin Cheng , Dongho Kang , Bhavya Sukhija , Stelian Coros

There are several challenges in developing a model for multi-tasking humanoid control. Reinforcement learning and imitation learning approaches are quite popular in this domain. However, there is a trade-off between the two. Reinforcement…

Robotics · Computer Science 2024-06-18 Siddharth Padmanabhan , Kazuki Miyazawa , Takato Horii , Takayuki Nagai