English
Related papers

Related papers: OmniUMI: Towards Physically Grounded Robot Learnin…

200 papers

Data-driven robotic learning faces an obvious dilemma: robust policies demand large-scale, high-quality demonstration data, yet collecting such data remains a major challenge owing to high operational costs, dependence on specialized…

Robotics · Computer Science 2025-11-13 Yan Huang , Shoujie Li , Xingting Li , Wenbo Ding

We present a scalable framework for cross-embodiment humanoid robot control by learning a shared latent representation that unifies motion across humans and diverse humanoid platforms, including single-arm, dual-arm, and legged humanoid…

Robotics · Computer Science 2026-01-23 Yashuai Yan , Dongheui Lee

Humanoid robots are expected to operate in human-centered environments where safe and natural physical interaction is essential. However, most recent reinforcement learning (RL) policies emphasize rigid tracking and suppress external…

Robotics · Computer Science 2025-11-07 Qingzhou Lu , Yao Feng , Baiyu Shi , Michael Piseno , Zhenan Bao , C. Karen Liu

The deployment of humanoid robots for dexterous manipulation in unstructured environments remains challenging due to perceptual limitations that constrain the effective workspace. In scenarios where physical constraints prevent the robot…

Robotics · Computer Science 2026-03-09 Pei Qu , Zheng Li , Yufei Jia , Ziyun Liu , Liang Zhu , Haoang Li , Jinni Zhou , Jun Ma

We study the problem of teaching humanoid robots manipulation skills by imitating from single video demonstrations. We introduce OKAMI, a method that generates a manipulation plan from a single RGB-D video and derives a policy for…

Robotics · Computer Science 2024-10-16 Jinhan Li , Yifeng Zhu , Yuqi Xie , Zhenyu Jiang , Mingyo Seo , Georgios Pavlakos , Yuke Zhu

Physical interactive robotics, ranging from wearable devices to collaborative humanoid robots, require close coordination between mechanical design and control. However, evaluating interactive dynamics is challenging due to complex human…

Robotics · Computer Science 2026-03-11 Chenhui Zuo , Jinhao Xu , Michael Qian Vergnolle , Yanan Sui

Vision-language-action (VLA) models have shown strong generalization for robotic action prediction through large-scale vision-language pretraining. However, most existing models rely solely on RGB cameras, limiting their perception and,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Heyu Guo , Shanmu Wang , Ruichun Ma , Shiqi Jiang , Yasaman Ghasempour , Omid Abari , Baining Guo , Lili Qiu

Whole-body manipulation (WBM) for humanoid robots presents a promising approach for executing embracing tasks involving bulky objects, where traditional grasping relying on end-effectors only remains limited in such scenarios due to…

Robotics · Computer Science 2025-09-18 Chunxin Zheng , Kai Chen , Zhihai Bi , Yulin Li , Liang Pan , Jinni Zhou , Haoang Li , Jun Ma

Robotic manipulation requires both rich multimodal perception and effective learning frameworks to handle complex real-world tasks. See-through-skin (STS) sensors, which combine tactile and visual perception, offer promising sensing…

Robotics · Computer Science 2026-02-10 Yuyang Li , Yinghan Chen , Zihang Zhao , Puhao Li , Tengyu Liu , Siyuan Huang , Yixin Zhu

This paper presents a novel human-robot interaction (HRI) framework that enables intuitive gesture-driven control through a capacitance-based woven tactile skin. Unlike conventional interfaces that rely on panels or handheld devices, the…

Previous humanoid robot research works treat the robot as a bipedal mobile manipulation platform, where only the feet and hands contact the environment. However, we humans use all body parts to interact with the world, e.g., we sit in…

Robotics · Computer Science 2025-02-04 Ziwen Zhuang , Hang Zhao

We present a unified framework for multi-task locomotion and manipulation policy learning grounded in a contact-explicit representation. Instead of designing different policies for different tasks, our approach unifies the definition of a…

Robotics · Computer Science 2026-05-05 Shafeef Omar , Majid Khadiv

As intelligent robots become more integrated into human environments, there is a growing need for intuitive and reliable Human-Robot Interaction (HRI) interfaces that are adaptable and more natural to interact with. Traditional robot…

High-fidelity motion tracking serves as the ultimate litmus test for generalizable, human-level motor skills. However, current policies often hit a "generality barrier": as motion libraries scale in diversity, tracking fidelity inevitably…

Underwater robotic grasping is difficult due to degraded, highly variable imagery and the expense of collecting diverse underwater demonstrations. We introduce a system that (i) autonomously collects successful underwater grasp…

Robotics · Computer Science 2026-03-31 Hao Li , Long Yin Chung , Jack Goler , Ryan Zhang , Xiaochi Xie , Huy Ha , Shuran Song , Mark Cutkosky

Data-driven robotic manipulation learning depends on large-scale, high-quality expert demonstration datasets. However, existing datasets, which primarily rely on human teleoperated robot collection, are limited in terms of scalability,…

Humanoid robots must adapt their contact behavior to diverse objects and tasks, yet most controllers rely on fixed, hand-tuned impedance gains and gripper settings. This paper introduces HumanoidVLM, a vision-language driven retrieval…

Robotics · Computer Science 2026-01-22 Yara Mahmoud , Yasheerah Yaqoot , Miguel Altamirano Cabrera , Dzmitry Tsetserukou

With the advancements in human-robot interaction (HRI), robots are now capable of operating in close proximity and engaging in physical interactions with humans (pHRI). Likewise, contact-based pHRI is becoming increasingly common as robots…

Robotics · Computer Science 2024-07-31 Mohammad Farajtabar , Marie Charbonneau

Handheld paradigms offer an efficient and intuitive way for collecting large-scale demonstration of robot manipulation. However, achieving contact-rich bimanual manipulation through these methods remains a pivotal challenge, which is…

Robotics · Computer Science 2026-04-09 Longyan Wu , Jieji Ren , Chenghang Jiang , Junxi Zhou , Shijia Peng , Ran Huang , Guoying Gu , Li Chen , Hongyang Li

Embodied learning for object-centric robotic manipulation is a rapidly developing and challenging area in embodied AI. It is crucial for advancing next-generation intelligent robots and has garnered significant interest recently. Unlike…

Robotics · Computer Science 2025-01-15 Ying Zheng , Lei Yao , Yuejiao Su , Yi Zhang , Yi Wang , Sicheng Zhao , Yiyi Zhang , Lap-Pui Chau