English
Related papers

Related papers: DexImit: Learning Bimanual Dexterous Manipulation …

200 papers

Achieving generalized in-hand object rotation remains a significant challenge in robotics, largely due to the difficulty of transferring policies from simulation to the real world. The complex, contact-rich dynamics of dexterous…

Robotics · Computer Science 2025-10-10 Xueyi Liu , He Wang , Li Yi

Planning physically feasible dexterous hand manipulation is a central challenge in robotic manipulation and Embodied AI. Prior work typically relies on object-centric cues or precise hand-object interaction sequences, foregoing the rich,…

Robotics · Computer Science 2026-03-03 Zhenhao Zhang , Jiaxin Liu , Ye Shi , Jingya Wang

Modeling dexterous hand-object interactions is challenging as it requires understanding how subtle finger motions influence the environment through contact with objects. While recent world models address interaction modeling, they typically…

Teaching robots dexterous manipulation skills often requires collecting hundreds of demonstrations using wearables or teleoperation, a process that is challenging to scale. Videos of human-object interactions are easier to collect and…

Robotics · Computer Science 2025-08-19 Tyler Ga Wei Lum , Olivia Y. Lee , C. Karen Liu , Jeannette Bohg

We present a method for teaching dexterous manipulation tasks to robots from human hand motion demonstrations. Unlike existing approaches that solely rely on kinematics information without taking into account the plausibility of robot and…

Robotics · Computer Science 2025-01-09 Sungjae Park , Seungho Lee , Mingi Choi , Jiye Lee , Jeonghwan Kim , Jisoo Kim , Hanbyul Joo

Dexterous manipulation is a crucial yet highly complex challenge in humanoid robotics, demanding precise, adaptable, and sample-efficient learning methods. As humanoid robots are usually designed to operate in human-centric environments and…

Robotics · Computer Science 2026-02-26 Edgar Welte , Rania Rayyes

Recent advancements in teleoperation systems have enabled high-quality data collection for robotic manipulators, showing impressive results in learning manipulation at scale. This progress suggests that extending these capabilities to…

Egocentric human videos provide scalable demonstrations for imitation learning, but existing corpora often lack either fine-grained, temporally localized action descriptions or dexterous hand annotations. We introduce OpenEgo, a multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Ahad Jawaid , Yu Xiang

We introduce an efficient approach for learning dexterous grasping with minimal data, advancing robotic manipulation capabilities across different robotic hands. Unlike traditional methods that require millions of grasp labels for each…

Robotics · Computer Science 2025-02-25 Hao-Shu Fang , Hengxu Yan , Zhenyu Tang , Hongjie Fang , Chenxi Wang , Cewu Lu

Dexterous manipulation remains one of the most challenging problems in robotics, requiring coherent control of high-DoF hands and arms under complex, contact-rich dynamics. A major barrier is embodiment variability: different dexterous…

Robotics · Computer Science 2026-02-10 Ke Zhang , Lixin Xu , Chengyi Song , Junzhe Xu , Xiaoyi Lin , Zeyu Jiang , Renjing Xu

Robotic dexterous grasping is the first step to enable human-like dexterous object manipulation and thus a crucial robotic technology. However, dexterous grasping is much more under-explored than object grasping with parallel grippers,…

Robotics · Computer Science 2023-03-09 Ruicheng Wang , Jialiang Zhang , Jiayi Chen , Yinzhen Xu , Puhao Li , Tengyu Liu , He Wang

Complex and contact-rich robotic manipulation tasks, particularly those that involve multi-fingered hands and underactuated object manipulation, present a significant challenge to any control method. Methods based on reinforcement learning…

Machine Learning · Computer Science 2022-12-21 Kelvin Xu , Zheyuan Hu , Ria Doshi , Aaron Rovinsky , Vikash Kumar , Abhishek Gupta , Sergey Levine

Many recent advances in robotic manipulation have come through imitation learning, yet these rely largely on mimicking a particularly hard-to-acquire form of demonstrations: those collected on the same robot in the same room with the same…

Robotics · Computer Science 2025-04-01 Junyao Shi , Zhuolun Zhao , Tianyou Wang , Ian Pedroza , Amy Luo , Jie Wang , Jason Ma , Dinesh Jayaraman

Acquiring large-scale, high-fidelity robot demonstration data remains a critical bottleneck for scaling Vision-Language-Action (VLA) models in dexterous manipulation. We propose a Real-Sim-Real data collection and data editing pipeline that…

Robotics · Computer Science 2026-02-10 Jiacheng Fan , Zhiyue Zhao , Yiqian Zhang , Chao Chen , Peide Wang , Hengdi Zhang , Zhengxue Cheng

Data-driven dexterous hand manipulation requires large-scale, physically consistent demonstration data. Simulation and video-based methods suffer from sim-to-real gaps and retargeting problems, while MoCap glove-based teleoperation systems…

Robotics · Computer Science 2026-04-17 Joonho Koh , Haechan Jung , Nayoung Kim , Wook Ko , Changjoo Nam

Teleoperation offers the possibility of imparting robotic systems with sophisticated reasoning skills, intuition, and creativity to perform tasks. However, current teleoperation solutions for high degree-of-actuation (DoA), multi-fingered…

Computer Vision and Pattern Recognition · Computer Science 2019-10-16 Ankur Handa , Karl Van Wyk , Wei Yang , Jacky Liang , Yu-Wei Chao , Qian Wan , Stan Birchfield , Nathan Ratliff , Dieter Fox

A dexterous hand capable of grasping any object is essential for the development of general-purpose embodied intelligent robots. However, due to the high degree of freedom in dexterous hands and the vast diversity of objects, generating…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Yiming Zhong , Qi Jiang , Jingyi Yu , Yuexin Ma

Enabling humanoid robots to perform agile and adaptive interactive tasks has long been a core challenge in robotics. Current approaches are bottlenecked by either the scarcity of realistic interaction data or the need for meticulous,…

Robotics · Computer Science 2026-02-03 Yinhuai Wang , Qihan Zhao , Yuen Fui Lau , Runyi Yu , Hok Wai Tsui , Qifeng Chen , Jingbo Wang , Jiangmiao Pang , Ping Tan

This paper proposes a vision-based framework for a 7-degree-of-freedom robotic manipulator, with the primary objective of facilitating its capacity to acquire information from human hand demonstrations for the execution of dexterous…

Robotics · Computer Science 2024-09-17 Nuo Chen , Ya-Jun Pan

Achieving human-like dexterous robotic manipulation remains a central goal and a pivotal challenge in robotics. The development of Artificial Intelligence (AI) has allowed rapid progress in robotic manipulation. This survey summarizes the…

Robotics · Computer Science 2025-11-19 Gaofeng Li , Ruize Wang , Peisen Xu , Qi Ye , Jiming Chen