English
Related papers

Related papers: HDMI: Learning Interactive Humanoid Whole-Body Con…

200 papers

We present a reinforcement learning framework for autonomous goalkeeping with humanoid robots in real-world scenarios. While prior work has demonstrated similar capabilities on quadrupedal platforms, humanoid goalkeeping introduces two…

We aim to build complex humanoid agents that integrate perception, motor control, and memory. In this work, we partly factor this problem into low-level motor control from proprioception and high-level coordination of the low-level skills…

Artificial Intelligence · Computer Science 2019-01-16 Josh Merel , Arun Ahuja , Vu Pham , Saran Tunyasuvunakool , Siqi Liu , Dhruva Tirumala , Nicolas Heess , Greg Wayne

Safe and trustworthy Human Robot Interaction (HRI) requires robots not only to complete tasks but also to regulate impedance and speed according to scene context and human proximity. We present SafeHumanoid, an egocentric vision pipeline…

Learning generalizable robot manipulation policies, especially for complex multi-fingered humanoids, remains a significant challenge. Existing approaches primarily rely on extensive data collection and imitation learning, which are…

Robotics · Computer Science 2025-09-03 Toru Lin , Kartik Sachdev , Linxi Fan , Jitendra Malik , Yuke Zhu

Generating physically realistic humanoid-object interactions (HOI) is a fundamental challenge in robotics. Existing HOI generation approaches, such as diffusion-based models, often suffer from artifacts such as implausible contacts,…

Robotics · Computer Science 2025-08-21 Yuhang Lin , Yijia Xie , Jiahong Xie , Yuehao Huang , Ruoyu Wang , Jiajun Lv , Yukai Ma , Xingxing Zuo

Teaching robots dexterous manipulation skills often requires collecting hundreds of demonstrations using wearables or teleoperation, a process that is challenging to scale. Videos of human-object interactions are easier to collect and…

Robotics · Computer Science 2025-08-19 Tyler Ga Wei Lum , Olivia Y. Lee , C. Karen Liu , Jeannette Bohg

To address key limitations in human-object interaction (HOI) video generation -- specifically the reliance on curated motion data, limited generalization to novel objects/scenarios, and restricted accessibility -- we introduce…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Ziyao Huang , Zixiang Zhou , Juan Cao , Yifeng Ma , Yi Chen , Zejing Rao , Zhiyong Xu , Hongmei Wang , Qin Lin , Yuan Zhou , Qinglin Lu , Fan Tang

Humanoid robots have demonstrated strong capabilities for interacting with static scenes across locomotion and manipulation, yet dynamic real-world interactions remain challenging. As a step toward fast-moving object interactions, we…

Robotics · Computer Science 2026-04-28 Chenhao Liu , Leyun Jiang , Yibo Wang , Kairan Yao , Jinchen Fu , Xiaoyu Ren

Enabling humanoid robots to clean rooms has long been a pursued dream within humanoid research communities. However, many tasks require multi-humanoid collaboration, such as carrying large and heavy furniture together. Given the scarcity of…

Robotics · Computer Science 2024-10-31 Jiawei Gao , Ziqin Wang , Zeqi Xiao , Jingbo Wang , Tai Wang , Jinkun Cao , Xiaolin Hu , Si Liu , Jifeng Dai , Jiangmiao Pang

Humans possess delicate dynamic balance mechanisms that enable them to maintain stability across diverse terrains and under extreme conditions. However, despite significant advances recently, existing locomotion algorithms for humanoid…

Robotics · Computer Science 2025-03-03 Weiji Xie , Chenjia Bai , Jiyuan Shi , Junkai Yang , Yunfei Ge , Weinan Zhang , Xuelong Li

This work presents DemoBot, a learning framework that enables a dual-arm, multi-finger robotic system to acquire complex manipulation skills from a single unannotated RGB-D video demonstration. The method extracts structured motion…

Robotics · Computer Science 2026-01-06 Yucheng Xu , Xiaofeng Mao , Elle Miller , Xinyu Yi , Yang Li , Zhibin Li , Robert B. Fisher

Modeling 4D human-object interaction (HOI) is a compelling challenge in computer vision and an essential technology powering virtual and mixed-reality applications. While existing works have achieved promising results on specific HOI…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Mengfei Zhang , Jinlu Zhang , Zhigang Tu

Humanoid robots are envisioned as embodied intelligent agents capable of performing a wide range of human-level loco-manipulation tasks, particularly in scenarios requiring strenuous and repetitive labor. However, learning these skills is…

Robotics · Computer Science 2024-12-20 Junjia Liu , Zhuo Li , Minghao Yu , Zhipeng Dong , Sylvain Calinon , Darwin Caldwell , Fei Chen

Humanoid-Gym is an easy-to-use reinforcement learning (RL) framework based on Nvidia Isaac Gym, designed to train locomotion skills for humanoid robots, emphasizing zero-shot transfer from simulation to the real-world environment.…

Robotics · Computer Science 2024-05-21 Xinyang Gu , Yen-Jen Wang , Jianyu Chen

Human-object interaction (HOI) detection aims to comprehend the intricate relationships between humans and objects, predicting $<human, action, object>$ triplets, and serving as the foundation for numerous computer vision tasks. The…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Yichao Cao , Qingfei Tang , Xiu Su , Chen Song , Shan You , Xiaobo Lu , Chang Xu

Humanoid robots that autonomously interact with physical environments over extended horizons represent a central goal of embodied intelligence. Existing approaches rely on reference motions or task-specific rewards, tightly coupling…

Robotics · Computer Science 2026-02-26 Yutang Lin , Jieming Cui , Yixuan Li , Baoxiong Jia , Yixin Zhu , Siyuan Huang

Humanoid robots hold great potential to perform various human-level skills, involving unified locomotion and manipulation in real-world settings. Driven by advances in machine learning and the strength of existing model-based approaches,…

Humanoid robots have the promise of locomoting like humans, including fast and dynamic running. Recently, reinforcement learning (RL) controllers that can mimic human motions have become popular as they can generate very dynamic behaviors,…

Robotics · Computer Science 2026-03-30 Zachary Olkin , William D. Compton , Ryan M. Bena , Aaron D. Ames

Humanoid robots are capable of performing various actions such as greeting, dancing and even backflipping. However, these motions are often hard-coded or specifically trained, which limits their versatility. In this work, we present…

Humanoid robots have demonstrated impressive motor skills in a wide range of tasks, yet whole-body control for humanlike long-time, dynamic fighting remains particularly challenging due to the stringent requirements on agility and…

Robotics · Computer Science 2026-04-24 Yucheng Xin , Jiacheng Bao , Yubo Dong , Xueqian Wang , Bin Zhao , Xuelong Li , Junbo Tan , Dong Wang