English
Related papers

Related papers: Learning Dexterous In-Hand Manipulation with Multi…

200 papers

In-hand manipulation using multiple dexterous fingers is a critical robotic skill that can reduce the reliance on large arm motions, thereby saving space and energy. This letter focuses on in-grasp object movement, which refers to…

Robotics · Computer Science 2025-03-24 Mingrui Yu , Yongpeng Jiang , Chen Chen , Yongyi Jia , Xiang Li

Dexterous in-hand manipulation for a multi-fingered anthropomorphic hand is extremely difficult because of the high-dimensional state and action spaces, rich contact patterns between the fingers and objects. Even though deep reinforcement…

Robotics · Computer Science 2023-04-20 Yongkang Luo , Wanyi Li , Peng Wang , Haonan Duan , Wei Wei , Jia Sun

Vision-Language-Action (VLA) models have recently become a central direction in embodied AI, but current systems are restricted to either dual-gripper control or single-arm dexterous hand manipulation. While low-dimensional gripper control…

Dexterous manipulation is a cornerstone capability for robotic systems aiming to interact with the physical world in a human-like manner. Although vision-based methods have advanced rapidly, tactile sensing remains crucial for fine-grained…

Robotics · Computer Science 2026-05-14 Liang Heng , Haoran Geng , Kaifeng Zhang , Pieter Abbeel , Jitendra Malik

Bimanual dexterous manipulation is a critical yet underexplored area in robotics. Its high-dimensional action space and inherent task complexity present significant challenges for policy learning, and the limited task diversity in existing…

Robotics · Computer Science 2024-10-04 Bohan Zhou , Haoqi Yuan , Yuhui Fu , Zongqing Lu

Controlling hands in high-dimensional action space has been a longstanding challenge, yet humans naturally perform dexterous tasks with ease. In this paper, we draw inspiration from the concept of internal model exhibited in human behavior…

Robotics · Computer Science 2025-05-13 Tong Wu , Shoujie Li , Chuqiao Lyu , Kit-Wa Sou , Wang-Sing Chan , Wenbo Ding

While significant progress has been made on understanding hand-object interactions in computer vision, it is still very challenging for robots to perform complex dexterous manipulation. In this paper, we propose a new platform and pipeline…

Machine Learning · Computer Science 2022-07-07 Yuzhe Qin , Yueh-Hua Wu , Shaowei Liu , Hanwen Jiang , Ruihan Yang , Yang Fu , Xiaolong Wang

Dexterous intelligence -- the ability to perform complex interactions with multi-fingered hands -- is a pinnacle of human physical intelligence and emergent higher-order cognitive skills. However, contrary to Moravec's paradox, dexterous…

Robotics · Computer Science 2025-07-15 Gagan Khandate

To enable general-purpose robots, we will require the robot to operate daily articulated objects as humans do. Current robot manipulation has heavily relied on using a parallel gripper, which restricts the robot to a limited set of objects.…

Robotics · Computer Science 2023-05-11 Chen Bao , Helin Xu , Yuzhe Qin , Xiaolong Wang

In-hand manipulation with multi-fingered hands is a challenging problem that recently became feasible with the advent of deep reinforcement learning methods. While most contributions to the task brought improvements in robustness and…

Robotics · Computer Science 2024-11-21 Johannes Pitz , Lennart Röstel , Leon Sievers , Berthold Bäuml

The inherent difficulty and limited scalability of collecting manipulation data using multi-fingered robot hand hardware platforms have resulted in severe data scarcity, impeding research on data-driven dexterous manipulation policy…

Robotics · Computer Science 2025-11-17 Wenbin Bai , Qiyu Chen , Xiangbo Lin , Jianwen Li , Quancheng Li , Hejiang Pan , Yi Sun

Dexterous in-hand manipulation is an essential skill of production and life. However, the highly stiff and mutable nature of contacts limits real-time contact detection and inference, degrading the performance of model-based methods.…

Robotics · Computer Science 2024-11-08 Yongpeng Jiang , Mingrui Yu , Xinghao Zhu , Masayoshi Tomizuka , Xiang Li

Manipulating objects with two multi-fingered hands has been a long-standing challenge in robotics, due to the contact-rich nature of many manipulation tasks and the complexity inherent in coordinating a high-dimensional bimanual system. In…

Robotics · Computer Science 2024-10-15 Toru Lin , Zhao-Heng Yin , Haozhi Qi , Pieter Abbeel , Jitendra Malik

Robotic manipulation tasks often rely on static cameras for perception, which can limit flexibility, particularly in scenarios like robotic surgery and cluttered environments where mounting static cameras is impractical. Ideally, robots…

Robotics · Computer Science 2025-09-18 Xiatao Sun , Francis Fan , Yinxing Chen , Daniel Rakita

Reinforcement learning (RL) and sim-to-real transfer have advanced rigid-object manipulation. However, policies remain brittle for articulated mechanisms due to contact-rich dynamics that require both stable grasping and simultaneous free…

Robotics · Computer Science 2026-03-06 Soofiyan Atar , Daniel Huang , Florian Richter , Michael Yip

We introduce an efficient approach for learning dexterous grasping with minimal data, advancing robotic manipulation capabilities across different robotic hands. Unlike traditional methods that require millions of grasp labels for each…

Robotics · Computer Science 2025-02-25 Hao-Shu Fang , Hengxu Yan , Zhenyu Tang , Hongjie Fang , Chenxi Wang , Cewu Lu

A fundamental challenge in teaching robots is to provide an effective interface for human teachers to demonstrate useful skills to a robot. This challenge is exacerbated in dexterous manipulation, where teaching high-dimensional,…

Robotics · Computer Science 2022-10-13 Sridhar Pandian Arunachalam , Irmak Güzey , Soumith Chintala , Lerrel Pinto

Collecting demonstrations enriched with fine-grained tactile information is critical for dexterous manipulation, particularly in contact-rich tasks that require precise force control and physical interaction. While prior works primarily…

Robotics · Computer Science 2025-05-06 Di Zhang , Chengbo Yuan , Chuan Wen , Hai Zhang , Junqiao Zhao , Yang Gao

Opening heavy, self closing doors, especially those that require pulling remains a long standing challenge in robotics. Humans naturally employ both arms in a dexterous manner, rotating the handle, widening the gap, holding the door,…

Robotics · Computer Science 2026-05-18 Shangqun Yu , Matthew En , Daniel Wu , Sangjun Park , Ziyi Zhou , Seyed Fakoorian , Donghyun Kim

Dexterous hands exhibit significant potential for complex real-world grasping tasks. While recent studies have primarily focused on learning policies for specific robotic hands, the development of a universal policy that controls diverse…

Robotics · Computer Science 2024-10-04 Haoqi Yuan , Bohan Zhou , Yuhui Fu , Zongqing Lu