English
Related papers

Related papers: Contact Coverage-Guided Exploration for General-Pu…

200 papers

Tactile sensing allows robots to gather detailed geometric information about objects through physical interaction, complementing vision-based approaches. However, efficiently acquiring useful tactile data remains challenging due to the…

Robotics · Computer Science 2026-02-27 Chung Hee Kim , Shivani Kamtikar , Tye Brady , Taskin Padir , Joshua Migdal

Most modern approaches to quadruped locomotion focus on using Deep Reinforcement Learning (DRL) to learn policies from scratch, in an end-to-end manner. Such methods often fail to scale, as every new problem or application requires…

Robotics · Computer Science 2025-09-29 Vassil Atanassov , Wanming Yu , Siddhant Gangapurwala , James Wilson , Ioannis Havoutis

Dexterous grasping in cluttered environments presents substantial challenges due to the high degrees of freedom of dexterous hands, occlusion, and potential collisions arising from diverse object geometries and complex layouts. To address…

Robotics · Computer Science 2026-02-03 Jiyao Zhang , Zhiyuan Ma , Tianhao Wu , Zeyuan Chen , Hao Dong

Deep Reinforcement Learning (DRL) has emerged as a powerful model-free paradigm for learning optimal policies. However, in navigation tasks with cluttered environments, DRL methods often suffer from insufficient exploration, especially…

Robotics · Computer Science 2025-07-04 Licheng Luo , Mingyu Cai

Deep reinforcement learning (DRL) has been widely applied in autonomous exploration and mapping tasks, but often struggles with the challenges of sampling efficiency, poor adaptability to unknown map sizes, and slow simulation speed. To…

Robotics · Computer Science 2023-02-28 Zhi Li , Jinghao Xin , Ning Li

Recently, reinforcement learning has led to dexterous manipulation skills of increasing complexity. Nonetheless, learning these skills in simulation still exhibits poor sample-efficiency which stems from the fact these skills are learned…

Robotics · Computer Science 2023-09-28 Gagan Khandate , Cameron Mehlman , Xingsheng Wei , Matei Ciocarlie

Dexterous robotic hands are essential for performing complex manipulation tasks, yet remain difficult to train due to the challenges of demonstration collection and high-dimensional control. While reinforcement learning (RL) can alleviate…

Task automation of surgical robot has the potentials to improve surgical efficiency. Recent reinforcement learning (RL) based approaches provide scalable solutions to surgical automation, but typically require extensive data collection to…

Robotics · Computer Science 2023-02-21 Tao Huang , Kai Chen , Bin Li , Yun-Hui Liu , Qi Dou

Hand-object motion-capture (MoCap) repositories offer large-scale, contact-rich demonstrations and hold promise for scaling dexterous robotic manipulation. Yet demonstration inaccuracies and embodiment gaps between human and robot hands…

Robotics · Computer Science 2025-09-12 Sirui Xu , Yu-Wei Chao , Liuyu Bian , Arsalan Mousavian , Yu-Xiong Wang , Liang-Yan Gui , Wei Yang

Demonstrations are widely used in Deep Reinforcement Learning (DRL) for facilitating solving tasks with sparse rewards. However, the tasks in real-world scenarios can often have varied initial conditions from the demonstration, which would…

Robotics · Computer Science 2023-07-11 Ruiqi Zhu , Siyuan Li , Tianhong Dai , Chongjie Zhang , Oya Celiktutan

Intelligent exploration remains a critical challenge in reinforcement learning (RL), especially in visual control tasks. Unlike low-dimensional state-based RL, visual RL must extract task-relevant structure from raw pixels, making…

Robotics · Computer Science 2026-03-10 Le Mao , Andrew H. Liu , Renos Zabounidis , Yanan Niu , Zachary Kingston , Joseph Campbell

Rewards play a crucial role in reinforcement learning. To arrive at the desired policy, the design of a suitable reward function often requires significant domain expertise as well as trial-and-error. Here, we aim to minimize the effort…

Robotics · Computer Science 2020-11-18 Zheng Wu , Wenzhao Lian , Vaibhav Unhelkar , Masayoshi Tomizuka , Stefan Schaal

To achieve general-purpose dexterous manipulation, robots must rapidly devise and execute contact-rich behaviors. Existing model-based controllers are incapable of globally optimizing in real-time over the exponential number of possible…

Robotics · Computer Science 2026-05-18 Sharanya Venkatesh , Bibit Bianchini , Alp Aydinoglu , William Yang , Michael Posa

Functional dexterous grasping requires precise hand-object interaction, going beyond simple gripping. Existing affordance-based methods primarily predict coarse interaction regions and cannot directly constrain the grasping posture, leading…

Robotics · Computer Science 2025-08-13 Fan Yang , Dongsheng Luo , Wenrui Chen , Jiacheng Lin , Junjie Cai , Kailun Yang , Zhiyong Li , Yaonan Wang

A key challenge in contact-rich dexterous manipulation is the need to jointly reason over geometry, kinematic constraints, and intricate, nonsmooth contact dynamics. End-to-end visuomotor policies bypass this structure, but often require…

Robotics · Computer Science 2026-01-26 Zhixian Xie , Yu Xiang , Michael Posa , Wanxin Jin

In this paper, we present a novel method for achieving dexterous manipulation of complex objects, while simultaneously securing the object without the use of passive support surfaces. We posit that a key difficulty for training such…

Dexterous robotic manipulation remains a longstanding challenge in robotics due to the high dimensionality of control spaces and the semantic complexity of object interaction. In this paper, we propose an object affordance-guided…

This paper presents Contact Mode Guided Manipulation Planning (CMGMP) for 3D quasistatic and quasidynamic rigid body motion planning in dexterous manipulation. The CMGMP algorithm generates hybrid motion plans including both continuous…

Robotics · Computer Science 2022-06-06 Xianyi Cheng , Eric Huang , Yifan Hou , Matthew T. Mason

Deep Reinforcement Learning (DRL) enables robots to perform some intelligent tasks end-to-end. However, there are still many challenges for long-horizon sparse-reward robotic manipulator tasks. On the one hand, a sparse-reward setting…

Robotics · Computer Science 2021-12-07 Guangming Wang , Minjian Xin , Wenhua Wu , Zhe Liu , Hesheng Wang

The deep learning models has significantly advanced dexterous manipulation techniques for multi-fingered hand grasping. However, the contact information-guided grasping in cluttered environments remains largely underexplored. To address…

Robotics · Computer Science 2025-06-25 Lei Zhang , Kaixin Bai , Guowen Huang , Zhenshan Bing , Zhaopeng Chen , Alois Knoll , Jianwei Zhang