English
Related papers

Related papers: Learning to Grasp the Ungraspable with Emergent Ex…

200 papers

Grasping is fundamental to robotic manipulation, and recent advances in large-scale grasping datasets have provided essential training data and evaluation benchmarks, accelerating the development of learning-based methods for robust object…

Robotics · Computer Science 2025-07-04 Siyu Ma , Wenxin Du , Chang Yu , Ying Jiang , Zeshun Zong , Tianyi Xie , Yunuo Chen , Yin Yang , Xuchen Han , Chenfanfu Jiang

Grasping objects under uncertainty remains an open problem in robotics research. This uncertainty is often due to noisy or partial observations of the object pose or shape. To enable a robot to react appropriately to unforeseen effects, it…

Robotics · Computer Science 2018-09-20 Hamza Merzic , Miroslav Bogdanovic , Daniel Kappler , Ludovic Righetti , Jeannette Bohg

Complex and contact-rich robotic manipulation tasks, particularly those that involve multi-fingered hands and underactuated object manipulation, present a significant challenge to any control method. Methods based on reinforcement learning…

Machine Learning · Computer Science 2022-12-21 Kelvin Xu , Zheyuan Hu , Ria Doshi , Aaron Rovinsky , Vikash Kumar , Abhishek Gupta , Sergey Levine

Dexterous manipulation has received considerable attention in recent research. Predominantly, existing studies have concentrated on reinforcement learning methods to address the substantial degrees of freedom in hand movements. Nonetheless,…

Robotics · Computer Science 2024-12-23 Hengxu Yan , Haoshu Fang , Cewu Lu

This paper presents a reinforcement learning framework that incorporates a Contextual Reward Machine for task-oriented grasping. The Contextual Reward Machine reduces task complexity by decomposing grasping tasks into manageable sub-tasks.…

Robotics · Computer Science 2025-12-12 Hui Li , Akhlak Uz Zaman , Fujian Yan , Hongsheng He

Self-supervised grasp learning, i.e., learning to grasp by trial and error, has made great progress. However, it is still time-consuming to train such a model and also a challenge to apply it in practice. This work presents an accelerating…

Robotics · Computer Science 2022-05-16 Yanxu Hou , Jun Li

Unsupervised reinforcement learning (RL) studies how to leverage environment statistics to learn useful behaviors without the cost of reward engineering. However, a central challenge in unsupervised RL is to extract behaviors that…

Recent advances have been made in learning of grasps for fully actuated hands. A typical approach learns the target locations of finger links on the object. When a new object must be grasped, new finger locations are generated, and a…

Robotics · Computer Science 2016-09-27 Marek Kopicki , Carlos J. Rosales , Hamal Marino , Marco Gabiccini , Jeremy L. Wyatt

Dexterous grasping in cluttered scenes presents significant challenges due to diverse object geometries, occlusions, and potential collisions. Existing methods primarily focus on single-object grasping or grasp-pose prediction without…

Robotics · Computer Science 2025-09-05 Zeyuan Chen , Qiyang Yan , Yuanpei Chen , Tianhao Wu , Jiyao Zhang , Zihan Ding , Jinzhou Li , Yaodong Yang , Hao Dong

Exploration in environments with sparse rewards has been a persistent problem in reinforcement learning (RL). Many tasks are natural to specify with a sparse reward, and manually shaping a reward function can result in suboptimal…

Machine Learning · Computer Science 2018-02-27 Ashvin Nair , Bob McGrew , Marcin Andrychowicz , Wojciech Zaremba , Pieter Abbeel

Robotic manipulation has made significant advancements, with systems demonstrating high precision and repeatability. However, this remarkable precision often fails to translate into efficient manipulation of thin deformable objects. Current…

Robotics · Computer Science 2025-07-09 Chao Zhao , Chunli Jiang , Lifan Luo , Shuai Yuan , Qifeng Chen , Hongyu Yu

Offline-to-online reinforcement learning (O2O RL) aims to obtain a continually improving policy as it interacts with the environment, while ensuring the initial policy behaviour is satisficing. This satisficing behaviour is necessary for…

Robotics · Computer Science 2025-01-24 Bryan Chan , Anson Leung , James Bergstra

In this paper we focus on developing a control algorithm for multi-terrain tracked robots with flippers using a reinforcement learning (RL) approach. The work is based on the deep deterministic policy gradient (DDPG) algorithm, proven to be…

Robotics · Computer Science 2017-09-26 Giuseppe Paolo , Lei Tai , Ming Liu

Robotic dexterous manipulation is a challenging problem due to high degrees of freedom (DoFs) and complex contacts of multi-fingered robotic hands. Many existing deep reinforcement learning (DRL) based methods aim at improving sample…

Robotics · Computer Science 2026-02-26 Qingtao Liu , Zhengnan Sun , Yu Cui , Haoming Li , Gaofeng Li , Lin Shao , Jiming Chen , Qi Ye

Robots must know how to be gentle when they need to interact with fragile objects, or when the robot itself is prone to wear and tear. We propose an approach that enables deep reinforcement learning to train policies that are gentle, both…

In recent years, as robotics has advanced, human-robot collaboration has gained increasing importance. However, current robots struggle to fully and accurately interpret human intentions from voice commands alone. Traditional gripper and…

Robotics · Computer Science 2024-12-17 Junliang Li , Kai Ye , Haolan Kang , Mingxuan Liang , Yuhang Wu , Zhenhua Liu , Huiping Zhuang , Rui Huang , Yongquan Chen

In this paper, a novel robotic grasping system is established to automatically pick up objects in cluttered scenes. A composite robotic hand composed of a suction cup and a gripper is designed for grasping the object stably. The suction cup…

Robotics · Computer Science 2023-02-22 Yuhong Deng , Xiaofeng Guo , Yixuan Wei , Kai Lu , Bin Fang , Di Guo , Huaping Liu , Fuchun Sun

We propose a method that simultaneously estimates and controls extrinsic contact with tactile feedback. The method enables challenging manipulation tasks that require controlling light forces and accurate motions in contact, such as…

Robotics · Computer Science 2023-03-07 Sangwoon Kim , Devesh K. Jha , Diego Romeres , Parag Patre , Alberto Rodriguez

Most reinforcement learning (RL) methods focus on learning optimal policies over low-level action spaces. While these methods can perform well in their training environments, they lack the flexibility to transfer to new tasks. Instead, RL…

Robotics · Computer Science 2024-09-20 Jesse Zhang , Minho Heo , Zuxin Liu , Erdem Biyik , Joseph J Lim , Yao Liu , Rasool Fakoor

We focus on the task of goal-oriented grasping, in which a robot is supposed to grasp a pre-assigned goal object in clutter and needs some pre-grasp actions such as pushes to enable stable grasps. However, in this task, the robot gets…

Robotics · Computer Science 2021-06-24 Kechun Xu , Hongxiang Yu , Qianen Lai , Yue Wang , Rong Xiong