English
Related papers

Related papers: UniHM: Unified Dexterous Hand Manipulation with Vi…

200 papers

Leveraging human motion data to impart robots with versatile manipulation skills has emerged as a promising paradigm in robotic manipulation. Nevertheless, translating multi-source human hand motions into feasible robot behaviors remains…

Robotics · Computer Science 2025-09-03 Zhecheng Yuan , Tianming Wei , Langzhe Gu , Pu Hua , Tianhai Liang , Yuanpei Chen , Huazhe Xu

Tactile sensing is crucial for robotic hands to achieve human-level dexterous manipulation, especially in scenarios with visual occlusion. However, its application is often hindered by the difficulty of collecting large-scale real-world…

Robotics · Computer Science 2025-12-30 Chi Zhang , Penglin Cai , Haoqi Yuan , Chaoyi Xu , Zongqing Lu

Data scarcity fundamentally limits the generalization of bimanual dexterous manipulation, as real-world data collection for dexterous hands is expensive and labor-intensive. Human manipulation videos, as a direct carrier of manipulation…

Robotics · Computer Science 2026-02-11 Juncheng Mu , Sizhe Yang , Yiming Bao , Hojin Bae , Tianming Wei , Linning Xu , Boyi Li , Huazhe Xu , Jiangmiao Pang

This paper investigates humanoid whole-body dexterous manipulation, where the efficient collection of high-quality demonstration data remains a central bottleneck. Existing teleoperation systems often suffer from limited portability,…

Robotics · Computer Science 2026-03-16 Liang Heng , Yihe Tang , Jiajun Xu , Henghui Bao , Di Huang , Yue Wang

Dexterous in-hand manipulation is a unique and valuable human skill requiring sophisticated sensorimotor interaction with the environment while respecting stability constraints. Satisfying these constraints with generated motions is…

In embodied intelligence, the embodiment gap between robotic and human hands brings significant challenges for learning from human demonstrations. Although some studies have attempted to bridge this gap using reinforcement learning, they…

In this work, we aim to learn dexterous manipulation of deformable objects using multi-fingered hands. Reinforcement learning approaches for dexterous rigid object manipulation would struggle in this setting due to the complexity of physics…

Computer Vision and Pattern Recognition · Computer Science 2023-04-07 Sizhe Li , Zhiao Huang , Tao Chen , Tao Du , Hao Su , Joshua B. Tenenbaum , Chuang Gan

Language-guided long-horizon manipulation of deformable objects presents significant challenges due to high degrees of freedom, complex dynamics, and the need for accurate vision-language grounding. In this work, we focus on multi-step…

IMU-based gesture interfaces are being increasingly adopted as efficient, accessible, and intuitive alternatives to traditional input methods, such as touchscreens and voice. However, current gesture recognition algorithms are tailored to…

Human-Computer Interaction · Computer Science 2026-03-13 Prerna Khanna , Tanmay Srivastava , Shubham Jain , Aruna Balasubramanian

Despite advances in dexterous hand manipulation, robotic hand design is still largely decoupled from task-driven evaluation and control, limiting systematic optimization. Existing robotic hand co-design approaches are often limited in…

Robotics · Computer Science 2026-05-01 Mohammad Amin Mirzaee , Harsh Gupta , Wenzhen Yuan

Dexterous robotic hands are essential for performing complex manipulation tasks, yet remain difficult to train due to the challenges of demonstration collection and high-dimensional control. While reinforcement learning (RL) can alleviate…

We study the problem of functional retargeting: learning dexterous manipulation policies to track object states from human hand-object demonstrations. We focus on long-horizon, bimanual tasks with articulated objects, which is challenging…

Robotics · Computer Science 2025-06-02 Zhao Mandi , Yifan Hou , Dieter Fox , Yashraj Narang , Ajay Mandlekar , Shuran Song

While significant progress has been made on understanding hand-object interactions in computer vision, it is still very challenging for robots to perform complex dexterous manipulation. In this paper, we propose a new platform and pipeline…

Machine Learning · Computer Science 2022-07-07 Yuzhe Qin , Yueh-Hua Wu , Shaowei Liu , Hanwen Jiang , Ruihan Yang , Yang Fu , Xiaolong Wang

Dexterous manipulation is a critical aspect of human capability, enabling interaction with a wide variety of objects. Recent advancements in learning from human demonstrations and teleoperation have enabled progress for robots in such…

Robotics · Computer Science 2026-01-14 Shuqi Zhao , Xinghao Zhu , Yuxin Chen , Chenran Li , Lichen Xie , Xiang Zhang , Mingyu Ding , Masayoshi Tomizuka

Designing effective data manipulation methods is a long standing problem in data lakes. Traditional methods, which rely on rules or machine learning models, require extensive human efforts on training data collection and tuning models.…

Artificial Intelligence · Computer Science 2024-05-13 Yichen Qian , Yongyi He , Rong Zhu , Jintao Huang , Zhijian Ma , Haibin Wang , Yaohua Wang , Xiuyu Sun , Defu Lian , Bolin Ding , Jingren Zhou

Dexterous multi-fingered hands can provide robots with the ability to flexibly perform a wide range of manipulation skills. However, many of the more complex behaviors are also notoriously difficult to control: Performing in-hand object…

Robotics · Computer Science 2019-09-26 Anusha Nagabandi , Kurt Konoglie , Sergey Levine , Vikash Kumar

Designing robotic hand morphologies for diverse manipulation tasks requires balancing dexterity, manufacturability, and task-specific functionality. While open-source frameworks and parametric tools support reproducible design, they still…

Robotics · Computer Science 2025-09-24 Yanyuan Qiao , Kieran Gilday , Yutong Xie , Josie Hughes

Automatically assessing handwritten mathematical solutions is an important problem in educational technology with practical applications, but it remains a significant challenge due to the diverse formats, unstructured layouts, and symbolic…

Computation and Language · Computer Science 2025-10-28 Thu Phuong Nguyen , Duc M. Nguyen , Hyotaek Jeon , Hyunwook Lee , Hyunmin Song , Sungahn Ko , Taehwan Kim

This paper presents a hierarchical framework for planning and control of in-hand manipulation of a rigid object involving grasp changes using fully-actuated multifingered robotic hands. While the framework can be applied to the general…

Robotics · Computer Science 2022-09-22 Rana Soltani Zarrin , Katsu Yamane , Rianna Jitosho

Dexterous manipulation policies today largely assume fixed hand designs, severely restricting their generalization to new embodiments with varied kinematic and structural layouts. To overcome this limitation, we introduce a parameterized…

Robotics · Computer Science 2026-05-19 Zhenyu Wei , Yunchao Yao , Mingyu Ding