English
Related papers

Related papers: Learning Generalizable Dexterous Manipulation from…

200 papers

Reinforcement learning is a promising method for robotic grasping as it can learn effective reaching and grasping policies in difficult scenarios. However, achieving human-like manipulation capabilities with sophisticated robotic hands is…

Robotics · Computer Science 2022-06-29 Martin Schuck , Jan Brüdigam , Alexandre Capone , Stefan Sosnowski , Sandra Hirche

We propose to learn to generate grasping motion for manipulation with a dexterous hand using implicit functions. With continuous time inputs, the model can generate a continuous and smooth grasping plan. We name the proposed model…

Robotics · Computer Science 2024-04-10 Jianglong Ye , Jiashun Wang , Binghao Huang , Yuzhe Qin , Xiaolong Wang

In this work, we propose algorithms and methods that enable learning dexterous object manipulation using simulated one- or two-armed robots equipped with multi-fingered hand end-effectors. Using a parallel GPU-accelerated physics simulator…

Robotics · Computer Science 2023-05-23 Aleksei Petrenko , Arthur Allshire , Gavriel State , Ankur Handa , Viktor Makoviychuk

Reaching-and-grasping is a fundamental skill for robotic manipulation, but existing methods usually train models on a specific gripper and cannot be reused on another gripper. In this paper, we propose a novel method that can learn a…

Robotics · Computer Science 2025-02-04 Qijin She , Shishun Zhang , Yunfan Ye , Ruizhen Hu , Kai Xu

Dexterous grasping in the real world presents a fundamental and significant challenge for robot learning. The ability to employ affordance-aware poses to grasp objects with diverse geometries and properties in arbitrary scenarios is…

Robotics · Computer Science 2025-09-23 Dongchi Huang , Tianle Zhang , Yihang Li , Ling Zhao , Jiayi Li , Zhirui Fang , Chunhe Xia , Xiaodong He

Dexterous multi-fingered robotic hands can perform a wide range of manipulation skills, making them an appealing component for general-purpose robotic manipulators. However, such hands pose a major challenge for autonomous control, due to…

Artificial Intelligence · Computer Science 2018-10-16 Henry Zhu , Abhishek Gupta , Aravind Rajeswaran , Sergey Levine , Vikash Kumar

Learning robust and generalizable manipulation skills from demonstrations remains a key challenge in robotics, with broad applications in industrial automation and service robotics. While recent imitation learning methods have achieved…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Yu Ren , Yang Cong , Ronghan Chen , Jiahao Long

Human hands possess the dexterity to interact with diverse objects such as grasping specific parts of the objects and/or approaching them from desired directions. More importantly, humans can grasp objects of any shape without…

Robotics · Computer Science 2024-07-15 Hui Zhang , Sammy Christen , Zicong Fan , Otmar Hilliges , Jie Song

The ability to successfully grasp objects is crucial in robotics, as it enables several interactive downstream applications. To this end, most approaches either compute the full 6D pose for the object of interest or learn to predict a set…

Deformable linear object (DLO) manipulation is needed in many fields. Previous research on deformable linear object (DLO) manipulation has primarily involved parallel jaw gripper manipulation with fixed grasping positions. However, the…

Robotics · Computer Science 2023-12-27 Sun Zhaole , Jihong Zhu , Robert B. Fisher

In this work, we tackle the problem of learning universal robotic dexterous grasping from a point cloud observation under a table-top setting. The goal is to grasp and lift up objects in high-quality and diverse ways and generalize across…

Deep learning and reinforcement learning methods have recently been used to solve a variety of problems in continuous control domains. An obvious application of these techniques is dexterous manipulation tasks in robotics which are…

Learning generalizable robot manipulation policies, especially for complex multi-fingered humanoids, remains a significant challenge. Existing approaches primarily rely on extensive data collection and imitation learning, which are…

Robotics · Computer Science 2025-09-03 Toru Lin , Kartik Sachdev , Linxi Fan , Jitendra Malik , Yuke Zhu

Dexterous multi-fingered robotic hands have a formidable action space, yet their morphological similarity to the human hand holds immense potential to accelerate robot learning. We propose DexVIP, an approach to learn dexterous robotic…

Robotics · Computer Science 2022-02-02 Priyanka Mandikal , Kristen Grauman

Humans can determine a proper strategy to grasp an object according to the measured physical attributes or the prior knowledge of the object. This paper proposes an approach to determining the strategy of dexterous grasping by using an…

Robotics · Computer Science 2020-11-18 Bharath Rao , Hui Li , Krishna Krishnan , Enkhsaikhan Boldsaikhan , Hongsheng He

Recent work has demonstrated the ability of deep reinforcement learning (RL) algorithms to learn complex robotic behaviours in simulation, including in the domain of multi-fingered manipulation. However, such models can be challenging to…

Garment manipulation is a critical challenge due to the diversity in garment categories, geometries, and deformations. Despite this, humans can effortlessly handle garments, thanks to the dexterity of our hands. However, existing research…

Robotics · Computer Science 2025-10-14 Yuran Wang , Ruihai Wu , Yue Chen , Jiarui Wang , Jiaqi Liang , Ziyu Zhu , Haoran Geng , Jitendra Malik , Pieter Abbeel , Hao Dong

Optimizing behaviors for dexterous manipulation has been a longstanding challenge in robotics, with a variety of methods from model-based control to model-free reinforcement learning having been previously explored in literature. Perhaps…

Robotics · Computer Science 2022-03-25 Sridhar Pandian Arunachalam , Sneha Silwal , Ben Evans , Lerrel Pinto

It is essential yet challenging for future home-assistant robots to understand and manipulate diverse 3D objects in daily human environments. Towards building scalable systems that can perform diverse manipulation tasks over various 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Yan Zhao , Ruihai Wu , Zhehuan Chen , Yourong Zhang , Qingnan Fan , Kaichun Mo , Hao Dong

The ability to robustly grasp a variety of objects is essential for dexterous robots. In this paper, we present a framework for zero-shot dynamic dexterous grasping using single-view visual inputs, designed to be resilient to various…

Robotics · Computer Science 2025-08-15 Hui Zhang , Zijian Wu , Linyi Huang , Sammy Christen , Jie Song