English
Related papers

Related papers: TrajBooster: Boosting Humanoid Whole-Body Manipula…

200 papers

We present Human to Humanoid (H2O), a reinforcement learning (RL) based framework that enables real-time whole-body teleoperation of a full-sized humanoid robot with only an RGB camera. To create a large-scale retargeted motion dataset of…

Robotics · Computer Science 2024-03-08 Tairan He , Zhengyi Luo , Wenli Xiao , Chong Zhang , Kris Kitani , Changliu Liu , Guanya Shi

We introduce Green-VLA, a staged Vision-Language-Action (VLA) framework for real-world deployment on the Green humanoid robot while maintaining generalization across diverse embodiments. Green-VLA follows a five stage curriculum: (L0)…

Recent advancements in whole-body control through deep reinforcement learning have enabled humanoid robots to achieve remarkable progress in real-world chal lenging locomotion skills. However, existing approaches often struggle with…

Robotics · Computer Science 2026-04-17 Yuen-Fui Lau , Qihan Zhao , Yinhuai Wang , Runyi Yu , Hok Wai Tsui , Qifeng Chen , Ping Tan

Whole-body humanoid teleoperation enables humans to remotely control humanoid robots, serving as both a real-time operational tool and a scalable engine for collecting demonstrations for autonomous learning. Despite recent advances,…

Robotics · Computer Science 2026-03-17 Yixuan Li , Le Ma , Yutang Lin , Yushi Du , Mengya Liu , Kaizhe Hu , Jieming Cui , Yixin Zhu , Wei Liang , Baoxiong Jia , Siyuan Huang

We introduce Being-H0, a dexterous Vision-Language-Action model (VLA) trained on large-scale human videos. Existing VLAs struggle with complex manipulation tasks requiring high dexterity and generalize poorly to novel scenarios and tasks,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Hao Luo , Yicheng Feng , Wanpeng Zhang , Sipeng Zheng , Ye Wang , Haoqi Yuan , Jiazheng Liu , Chaoyi Xu , Qin Jin , Zongqing Lu

Humanoid robots, designed to operate in human-centric environments, serve as a fundamental platform for a broad range of tasks. Although humanoid robots have been extensively studied for decades, a majority of existing humanoid robots still…

Robotics · Computer Science 2025-10-28 Xiao Lin , Yuhao Huang , Taimeng Fu , Xiaobin Xiong , Chen Wang

A motion-based control interface promises flexible robot operations in dangerous environments by combining user intuitions with the robot's motor capabilities. However, designing a motion interface for non-humanoid robots, such as…

Robotics · Computer Science 2022-04-29 Sunwoo Kim , Maks Sorokin , Jehee Lee , Sehoon Ha

Bilateral teleoperation provides humanoid robots with human planning intelligence while enabling the human to feel what the robot feels. It has the potential to transform physically capable humanoid robots into dynamically intelligent ones.…

Robotics · Computer Science 2021-09-10 Sunyu Wang , Joao Ramos

Embodied intelligence has advanced rapidly in recent years; however, bimanual manipulation-especially in contact-rich tasks remains challenging. This is largely due to the lack of datasets with rich physical interaction signals, systematic…

Robotics · Computer Science 2026-04-23 Qianxi Hua , Xinyue Li , Zheng Yan , Yang Li , Chi Zhang , Yongyao Li , Yufei Liu

This paper proposes the Transition Motion Tensor, a data-driven framework that creates novel and physically accurate transitions outside of the motion dataset. It enables simulated characters to adopt new motion skills efficiently and…

Robotics · Computer Science 2021-12-01 Jonathan Hans Soeseno , Ying-Sheng Luo , Trista Pei-Chun Chen , Wei-Chao Chen

Reinforcement learning (RL) enables high-frequency, closed-loop control for robotic manipulation, but scaling to long-horizon tasks with sparse or imperfect rewards remains difficult due to inefficient exploration and poor credit…

Machine Learning · Computer Science 2026-04-16 Angelo Moroncelli , Roberto Zanetti , Marco Maccarini , Loris Roveda

Scalable Embodied AI faces fundamental constraints due to prohibitive costs and safety risks of real-world interaction. While Embodied World Models (EWMs) offer promise through imagined rollouts, existing approaches suffer from geometric…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Ruicheng Zhang , Guangyu Chen , Zunnan Xu , Zihao Liu , Zhizhou Zhong , Mingyang Zhang , Jun Zhou , Xiu Li

We study active object tracking, where a tracker takes visual observations (i.e., frame sequences) as input and produces the corresponding camera control signals as output (e.g., move forward, turn left, etc.). Conventional methods tackle…

Computer Vision and Pattern Recognition · Computer Science 2019-02-14 Wenhan Luo , Peng Sun , Fangwei Zhong , Wei Liu , Tong Zhang , Yizhou Wang

Large-scale pre-training using egocentric human videos has proven effective for robot learning. However, the models pre-trained on such data can be suboptimal for robot learning due to the significant visual gap between human hands and…

Robotics · Computer Science 2026-03-17 Guangrun Li , Yaoxu Lyu , Zhuoyang Liu , Chengkai Hou , Jieyu Zhang , Shanghang Zhang

Humanoid robots capable of autonomous operation in diverse environments have long been a goal for roboticists. However, autonomous manipulation by humanoid robots has largely been restricted to one specific scene, primarily due to the…

Robotics · Computer Science 2025-09-10 Yanjie Ze , Zixuan Chen , Wenhao Wang , Tianyi Chen , Xialin He , Ying Yuan , Xue Bin Peng , Jiajun Wu

While recent image-based human animation methods achieve realistic body and facial motion synthesis, critical gaps remain in fine-grained holistic controllability, multi-scale adaptability, and long-term temporal coherence, which leads to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Yuxuan Luo , Zhengkun Rong , Lizhen Wang , Longhao Zhang , Tianshu Hu , Yongming Zhu

Vision-Language-Action Models (VLAs) inherit their visual and linguistic capabilities from Vision-Language Models (VLMs), yet most VLAs are built from off-the-shelf VLMs that are not adapted to the embodied domain, limiting their downstream…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Yiyang Du , Zhanqiu Guo , Xin Ye , Liu Ren , Chenyan Xiong

Embodied intelligence seamlessly integrates vision, language, and action.~However, most multimodal robotic models rely on massive fine-tuning, incurring high time and hardware costs.~To address this, we introduce RoboBERT, an end-to-end…

Robotics · Computer Science 2025-05-02 Sicheng Wang , Sheng Liu , Weiheng Wang , Jianhua Shan , Bin Fang

Humans are excellent at understanding language and vision to accomplish a wide range of tasks. In contrast, creating general instruction-following embodied agents remains a difficult challenge. Prior work that uses pure language-only models…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Hao Liu , Lisa Lee , Kimin Lee , Pieter Abbeel

Unsupervised reinforcement learning (RL) aims at pre-training agents that can solve a wide range of downstream tasks in complex environments. Despite recent advancements, existing approaches suffer from several limitations: they may require…