English
Related papers

Related papers: Towards Human-Level Bimanual Dexterous Manipulatio…

200 papers

Biomimetic, dexterous robotic hands have the potential to replicate much of the tasks that a human can do, and to achieve status as a general manipulation platform. Recent advances in reinforcement learning (RL) frameworks have achieved…

Reinforcement learning (RL) and sim-to-real transfer have advanced rigid-object manipulation. However, policies remain brittle for articulated mechanisms due to contact-rich dynamics that require both stable grasping and simultaneous free…

Robotics · Computer Science 2026-03-06 Soofiyan Atar , Daniel Huang , Florian Richter , Michael Yip

This work presents DemoBot, a learning framework that enables a dual-arm, multi-finger robotic system to acquire complex manipulation skills from a single unannotated RGB-D video demonstration. The method extracts structured motion…

Robotics · Computer Science 2026-01-06 Yucheng Xu , Xiaofeng Mao , Elle Miller , Xinyu Yi , Yang Li , Zhibin Li , Robert B. Fisher

Dexterous robot hands offer rich opportunities for multifunctional manipulation, where a robot must execute multiple skills in sequence while maintaining control over previously grasped objects. Most prior work in dexterous manipulation…

Robotics · Computer Science 2026-04-29 Ethan Foong , Yunshuang Li , Hao Jiang , Gaurav S. Sukhatme , Daniel Seita

In this work, we aim to learn dexterous manipulation of deformable objects using multi-fingered hands. Reinforcement learning approaches for dexterous rigid object manipulation would struggle in this setting due to the complexity of physics…

Computer Vision and Pattern Recognition · Computer Science 2023-04-07 Sizhe Li , Zhiao Huang , Tao Chen , Tao Du , Hao Su , Joshua B. Tenenbaum , Chuang Gan

Achieving human-level dexterity in robotic hands remains a fundamental challenge for enabling versatile manipulation across diverse applications. This extended abstract presents BiDexHand, a cable-driven biomimetic robotic hand that…

Robotics · Computer Science 2025-10-07 Zhengyang Kris Weng

Retrieving objects buried beneath multiple objects is not only challenging but also time-consuming. Performing manipulation in such environments presents significant difficulty due to complex contact relationships. Existing methods…

Robotics · Computer Science 2025-02-27 Fengshuo Bai , Yu Li , Jie Chu , Tawei Chou , Runchuan Zhu , Ying Wen , Yaodong Yang , Yuanpei Chen

Bimanual manipulation, i.e., the coordinated use of two robotic arms to complete tasks, is essential for achieving human-level dexterity in robotics. Recent simulation benchmarks, e.g., RoboTwin and RLBench2, have advanced data-driven…

Robotics · Computer Science 2026-04-08 Xingyu Peng , Chen Gao , Liankai Jin , Annan Li , Si Liu

Human dexterity arises from combining high-level task reasoning with finger-level dexterity control and physical compliance at the muscle and skin layers. In robotics, large Vision-Language-Action (VLA) models demonstrate text-conditioned…

Robotics · Computer Science 2026-05-12 Cheng Pan , Kai Junge , Benhui Dai , Qinghua Guan , Josie Hughes

We present DexCanvas, a large-scale hybrid real-synthetic human manipulation dataset containing 7,000 hours of dexterous hand-object interactions seeded from 70 hours of real human demonstrations, organized across 21 fundamental…

Robotics · Computer Science 2025-10-24 Xinyue Xu , Jieqiang Sun , Jing , Dai , Siyuan Chen , Lanjie Ma , Ke Sun , Bin Zhao , Jianbo Yuan , Sheng Yi , Haohua Zhu , Yiwen Lu

Training agents to autonomously learn how to use anthropomorphic robotic hands has the potential to lead to systems capable of performing a multitude of complex manipulation tasks in unstructured and uncertain environments. In this work, we…

Robotics · Computer Science 2021-05-18 Henry Charlesworth , Giovanni Montana

Manipulating objects with two multi-fingered hands has been a long-standing challenge in robotics, due to the contact-rich nature of many manipulation tasks and the complexity inherent in coordinating a high-dimensional bimanual system. In…

Robotics · Computer Science 2024-10-15 Toru Lin , Zhao-Heng Yin , Haozhi Qi , Pieter Abbeel , Jitendra Malik

Multi-finger robotic hand manipulation and grasping are challenging due to the high-dimensional action space and the difficulty of acquiring large-scale training data. Existing approaches largely rely on human teleoperation with wearable…

Most successes in robotic manipulation have been restricted to single-arm gripper robots, whose low dexterity limits the range of solvable tasks to pick-and-place, inser-tion, and object rearrangement. More complex tasks such as assembly…

Dexterous hands exhibit significant potential for complex real-world grasping tasks. While recent studies have primarily focused on learning policies for specific robotic hands, the development of a universal policy that controls diverse…

Robotics · Computer Science 2024-10-04 Haoqi Yuan , Bohan Zhou , Yuhui Fu , Zongqing Lu

Dexterous manipulation is a critical aspect of human capability, enabling interaction with a wide variety of objects. Recent advancements in learning from human demonstrations and teleoperation have enabled progress for robots in such…

Robotics · Computer Science 2026-01-14 Shuqi Zhao , Xinghao Zhu , Yuxin Chen , Chenran Li , Lichen Xie , Xiang Zhang , Mingyu Ding , Masayoshi Tomizuka

While there have been significant strides in dexterous manipulation, most of it is limited to benchmark tasks like in-hand reorientation which are of limited utility in the real world. The main benefit of dexterous hands over two-fingered…

Robotics · Computer Science 2023-12-06 Ananye Agarwal , Shagun Uppal , Kenneth Shaw , Deepak Pathak

Data scarcity fundamentally limits the generalization of bimanual dexterous manipulation, as real-world data collection for dexterous hands is expensive and labor-intensive. Human manipulation videos, as a direct carrier of manipulation…

Robotics · Computer Science 2026-02-11 Juncheng Mu , Sizhe Yang , Yiming Bao , Hojin Bae , Tianming Wei , Linning Xu , Boyi Li , Huazhe Xu , Jiangmiao Pang

Replicating human-like dexterity in robot hands represents one of the largest open problems in robotics. Reinforcement learning is a promising approach that has achieved impressive progress in the last few years; however, the class of…

Human hands possess remarkable dexterity and have long served as a source of inspiration for robotic manipulation. In this work, we propose a human $\textbf{H}$and$\textbf{-In}$formed visual representation learning framework to solve…

Machine Learning · Computer Science 2023-10-16 Yanjie Ze , Yuyao Liu , Ruizhe Shi , Jiaxin Qin , Zhecheng Yuan , Jiashun Wang , Huazhe Xu