English
Related papers

Related papers: Dexterous In-hand Manipulation by Guiding Explorat…

200 papers

Robotic dexterous hands are central to contact-rich manipulation, with rapid progress driven by advances in hardware, sensing, control, simulation, and data generation. However, existing studies are often developed under different…

Robotics · Computer Science 2026-05-18 Weiguang Zhao , Tian Liang , Xihao Guo , Rui Zhang , Irwin King , Kaizhu Huang

Reinforcement learning (RL) and sim-to-real transfer have advanced rigid-object manipulation. However, policies remain brittle for articulated mechanisms due to contact-rich dynamics that require both stable grasping and simultaneous free…

Robotics · Computer Science 2026-03-06 Soofiyan Atar , Daniel Huang , Florian Richter , Michael Yip

We explore learning-based approaches for feedback control of a dexterous five-finger hand performing non-prehensile manipulation. First, we learn local controllers that are able to perform the task starting at a predefined initial state.…

Machine Learning · Computer Science 2016-11-17 Vikash Kumar , Abhishek Gupta , Emanuel Todorov , Sergey Levine

Reinforcement learning is a promising method for robotic grasping as it can learn effective reaching and grasping policies in difficult scenarios. However, achieving human-like manipulation capabilities with sophisticated robotic hands is…

Robotics · Computer Science 2022-06-29 Martin Schuck , Jan Brüdigam , Alexandre Capone , Stefan Sosnowski , Sandra Hirche

We use reinforcement learning (RL) to learn dexterous in-hand manipulation policies which can perform vision-based object reorientation on a physical Shadow Dexterous Hand. The training is performed in a simulated environment in which we…

Dexterous in-hand manipulation for a multi-fingered anthropomorphic hand is extremely difficult because of the high-dimensional state and action spaces, rich contact patterns between the fingers and objects. Even though deep reinforcement…

Robotics · Computer Science 2023-04-20 Yongkang Luo , Wanyi Li , Peng Wang , Haonan Duan , Wei Wei , Jia Sun

Finger-gaiting manipulation is an important skill to achieve large-angle in-hand re-orientation of objects. However, achieving these gaits with arbitrary orientations of the hand is challenging due to the unstable nature of the task. In…

Robotics · Computer Science 2022-03-17 Gagan Khandate , Maxmillian Haas-Heger , Matei Ciocarlie

Dexterous multi-fingered hands can provide robots with the ability to flexibly perform a wide range of manipulation skills. However, many of the more complex behaviors are also notoriously difficult to control: Performing in-hand object…

Robotics · Computer Science 2019-09-26 Anusha Nagabandi , Kurt Konoglie , Sergey Levine , Vikash Kumar

The success of reinforcement learning for real world robotics has been, in many cases limited to instrumented laboratory scenarios, often requiring arduous human effort and oversight to enable continuous learning. In this work, we discuss…

Machine Learning · Computer Science 2020-04-28 Henry Zhu , Justin Yu , Abhishek Gupta , Dhruv Shah , Kristian Hartikainen , Avi Singh , Vikash Kumar , Sergey Levine

Training agents to autonomously learn how to use anthropomorphic robotic hands has the potential to lead to systems capable of performing a multitude of complex manipulation tasks in unstructured and uncertain environments. In this work, we…

Robotics · Computer Science 2021-05-18 Henry Charlesworth , Giovanni Montana

Controlling hands in high-dimensional action space has been a longstanding challenge, yet humans naturally perform dexterous tasks with ease. In this paper, we draw inspiration from the concept of internal model exhibited in human behavior…

Robotics · Computer Science 2025-05-13 Tong Wu , Shoujie Li , Chuqiao Lyu , Kit-Wa Sou , Wang-Sing Chan , Wenbo Ding

We introduce an efficient approach for learning dexterous grasping with minimal data, advancing robotic manipulation capabilities across different robotic hands. Unlike traditional methods that require millions of grasp labels for each…

Robotics · Computer Science 2025-02-25 Hao-Shu Fang , Hengxu Yan , Zhenyu Tang , Hongjie Fang , Chenxi Wang , Cewu Lu

Dexterous manipulation requires planning a grasp configuration suited to the object and task, which is then executed through coordinated multi-finger control. However, specifying grasp plans with dense pose or contact targets for every…

Effective execution of long-horizon tasks with dexterous robotic hands remains a significant challenge in real-world problems. While learning from human demonstrations have shown encouraging results, they require extensive data collection…

In this work, we aim to learn dexterous manipulation of deformable objects using multi-fingered hands. Reinforcement learning approaches for dexterous rigid object manipulation would struggle in this setting due to the complexity of physics…

Computer Vision and Pattern Recognition · Computer Science 2023-04-07 Sizhe Li , Zhiao Huang , Tao Chen , Tao Du , Hao Su , Joshua B. Tenenbaum , Chuang Gan

While there have been significant strides in dexterous manipulation, most of it is limited to benchmark tasks like in-hand reorientation which are of limited utility in the real world. The main benefit of dexterous hands over two-fingered…

Robotics · Computer Science 2023-12-06 Ananye Agarwal , Shagun Uppal , Kenneth Shaw , Deepak Pathak

In-hand manipulation of tools using dexterous hands in real-world is an underexplored problem in the literature. In addition to more complex geometry and larger size of the tools compared to more commonly used objects like cubes or…

Robotics · Computer Science 2024-10-11 Shaunak A. Mehta , Rana Soltani Zarrin

Continuous in-hand manipulation is an important physical interaction skill, where tactile sensing provides indispensable contact information to enable dexterous manipulation of small objects. This work proposed a framework for end-to-end…

Robotics · Computer Science 2023-04-12 Wenbin Hu , Bidan Huang , Wang Wei Lee , Sicheng Yang , Yu Zheng , Zhibin Li

How can robots learn dexterous grasping skills efficiently and apply them adaptively based on user instructions? This work tackles two key challenges: efficient skill acquisition from limited human demonstrations and context-driven skill…

Robotics · Computer Science 2025-08-12 Liangzhi Shi , Yulin Liu , Lingqi Zeng , Bo Ai , Zhengdong Hong , Hao Su

Multi-step dexterous manipulation is a fundamental skill in household scenarios, yet remains an underexplored area in robotics. This paper proposes a modular approach, where each step of the manipulation process is addressed with dedicated…