English
Related papers

Related papers: MoDex: Planning High-Dimensional Dexterous Control…

200 papers

A fundamental challenge in teaching robots is to provide an effective interface for human teachers to demonstrate useful skills to a robot. This challenge is exacerbated in dexterous manipulation, where teaching high-dimensional,…

Robotics · Computer Science 2022-10-13 Sridhar Pandian Arunachalam , Irmak Güzey , Soumith Chintala , Lerrel Pinto

Dexterity is often seen as a cornerstone of complex manipulation. Humans are able to perform a host of skills with their hands, from making food to operating tools. In this paper, we investigate these challenges, especially in the case of…

Robotics · Computer Science 2023-12-13 Aditya Kannan , Kenneth Shaw , Shikhar Bahl , Pragna Mannam , Deepak Pathak

Objects with large base areas become ungraspable when they exceed the end-effector's maximum aperture. Existing approaches address this limitation through extrinsic dexterity, which exploits environmental features for non-prehensile…

Robotics · Computer Science 2025-04-01 Yuhan Wang , Yu Li , Yaodong Yang , Yuanpei Chen

Humans naturally exhibit bilateral symmetry in their gross manipulation skills, effortlessly mirroring simple actions between left and right hands. Bimanual robots-which also feature bilateral symmetry-should similarly exploit this property…

Robotics · Computer Science 2025-09-03 Zechu Li , Yufeng Jin , Daniel Ordonez Apraez , Claudio Semini , Puze Liu , Georgia Chalvatzaki

Optimizing behaviors for dexterous manipulation has been a longstanding challenge in robotics, with a variety of methods from model-based control to model-free reinforcement learning having been previously explored in literature. Perhaps…

Robotics · Computer Science 2022-03-25 Sridhar Pandian Arunachalam , Sneha Silwal , Ben Evans , Lerrel Pinto

Dexterous in-hand manipulation for a multi-fingered anthropomorphic hand is extremely difficult because of the high-dimensional state and action spaces, rich contact patterns between the fingers and objects. Even though deep reinforcement…

Robotics · Computer Science 2023-04-20 Yongkang Luo , Wanyi Li , Peng Wang , Haonan Duan , Wei Wei , Jia Sun

Dexterous intelligence -- the ability to perform complex interactions with multi-fingered hands -- is a pinnacle of human physical intelligence and emergent higher-order cognitive skills. However, contrary to Moravec's paradox, dexterous…

Robotics · Computer Science 2025-07-15 Gagan Khandate

This paper investigates humanoid whole-body dexterous manipulation, where the efficient collection of high-quality demonstration data remains a central bottleneck. Existing teleoperation systems often suffer from limited portability,…

Robotics · Computer Science 2026-03-16 Liang Heng , Yihe Tang , Jiajun Xu , Henghui Bao , Di Huang , Yue Wang

Recently, reinforcement learning has led to dexterous manipulation skills of increasing complexity. Nonetheless, learning these skills in simulation still exhibits poor sample-efficiency which stems from the fact these skills are learned…

Robotics · Computer Science 2023-09-28 Gagan Khandate , Cameron Mehlman , Xingsheng Wei , Matei Ciocarlie

Human hands play a central role in interacting, motivating increasing research in dexterous robotic manipulation. Data-driven embodied AI algorithms demand precise, large-scale, human-like manipulation sequences, which are challenging to…

Robotics · Computer Science 2025-03-31 Kailin Li , Puhao Li , Tengyu Liu , Yuyang Li , Siyuan Huang

Human dexterity arises from combining high-level task reasoning with finger-level dexterity control and physical compliance at the muscle and skin layers. In robotics, large Vision-Language-Action (VLA) models demonstrate text-conditioned…

Robotics · Computer Science 2026-05-12 Cheng Pan , Kai Junge , Benhui Dai , Qinghua Guan , Josie Hughes

Dexterous manipulation is limited by both control and design, without consensus as to what makes manipulators best for performing dexterous tasks. This raises a fundamental challenge: how should we design and control robot manipulators that…

We study the problem of functional retargeting: learning dexterous manipulation policies to track object states from human hand-object demonstrations. We focus on long-horizon, bimanual tasks with articulated objects, which is challenging…

Robotics · Computer Science 2025-06-02 Zhao Mandi , Yifan Hou , Dieter Fox , Yashraj Narang , Ajay Mandlekar , Shuran Song

Dexterous multi-fingered hands can accomplish fine manipulation behaviors that are infeasible with simple robotic grippers. However, sophisticated multi-fingered hands are often expensive and fragile. Low-cost soft hands offer an appealing…

Machine Learning · Computer Science 2017-03-21 Abhishek Gupta , Clemens Eppner , Sergey Levine , Pieter Abbeel

Dexterous hands enable concurrent prehensile and nonprehensile manipulation, such as holding one object while interacting with another, a capability essential for everyday tasks yet underexplored in robotics. Learning such long-horizon,…

Robotics · Computer Science 2026-03-17 Hao Jiang , Yue Wu , Yue Wang , Gaurav S. Sukhatme , Daniel Seita

Human dexterity is an invaluable capability for precise manipulation of objects in complex tasks. The capability of robots to similarly grasp and perform in-hand manipulation of objects is critical for their use in the ever changing human…

Robotics · Computer Science 2024-10-25 Abraham Itzhak Weinberg , Alon Shirizly , Osher Azulay , Avishai Sintov

Dexterous multi-fingered hands are extremely versatile and provide a generic way to perform a multitude of tasks in human-centric environments. However, effectively controlling them remains challenging due to their high dimensionality and…

Machine Learning · Computer Science 2018-06-27 Aravind Rajeswaran , Vikash Kumar , Abhishek Gupta , Giulia Vezzani , John Schulman , Emanuel Todorov , Sergey Levine

We explore learning-based approaches for feedback control of a dexterous five-finger hand performing non-prehensile manipulation. First, we learn local controllers that are able to perform the task starting at a predefined initial state.…

Machine Learning · Computer Science 2016-11-17 Vikash Kumar , Abhishek Gupta , Emanuel Todorov , Sergey Levine

We address the challenge of developing a generalizable neural tracking controller for dexterous manipulation from human references. This controller aims to manage a dexterous robot hand to manipulate diverse objects for various purposes…

Robotics · Computer Science 2025-02-14 Xueyi Liu , Jianibieke Adalibieke , Qianwei Han , Yuzhe Qin , Li Yi

Robotic dexterous manipulation is a challenging problem due to high degrees of freedom (DoFs) and complex contacts of multi-fingered robotic hands. Many existing deep reinforcement learning (DRL) based methods aim at improving sample…

Robotics · Computer Science 2026-02-26 Qingtao Liu , Zhengnan Sun , Yu Cui , Haoming Li , Gaofeng Li , Lin Shao , Jiming Chen , Qi Ye