English
Related papers

Related papers: Sim2Real for Peg-Hole Insertion with Eye-in-Hand C…

200 papers

This paper proposes a learning-based visual peg-in-hole that enables training with several shapes in simulation, and adapting to arbitrary unseen shapes in real world with minimal sim-to-real cost. The core idea is to decouple the…

Robotics · Computer Science 2026-05-29 Liang Xie , Hongxiang Yu , Kechun Xu , Tong Yang , Minhang Wang , Haojian Lu , Rong Xiong , Yue Wang

Simulation has recently become key for deep reinforcement learning to safely and efficiently acquire general and complex control policies from visual and proprioceptive inputs. Tactile information is not usually considered despite its…

Robotics · Computer Science 2021-11-02 Alex Church , John Lloyd , Raia Hadsell , Nathan F. Lepora

Deep reinforcement learning is becoming increasingly popular for robot control algorithms, with the aim for a robot to self-learn useful feature representations from unstructured sensory input leading to the optimal actuation policy. In…

Robotics · Computer Science 2017-03-16 Steven Bohez , Tim Verbelen , Elias De Coninck , Bert Vankeirsbilck , Pieter Simoens , Bart Dhoedt

We use reinforcement learning in simulation to obtain a driving system controlling a full-size real-world vehicle. The driving policy takes RGB images from a single camera and their semantic segmentation as input. We use mostly synthetic…

Deep learning and reinforcement learning methods have recently been used to solve a variety of problems in continuous control domains. An obvious application of these techniques is dexterous manipulation tasks in robotics which are…

We study the problem of robotic stacking with objects of complex geometry. We propose a challenging and diverse set of such objects that was carefully designed to require strategies beyond a simple "pick-and-place" solution. Our method is a…

Deep reinforcement learning has proven to be successful for learning tasks in simulated environments, but applying same techniques for robots in real-world domain is more challenging, as they require hours of training. To address this,…

Machine Learning · Computer Science 2020-03-24 Janne Karttunen , Anssi Kanervisto , Ville Kyrki , Ville Hautamäki

When transferring a Deep Reinforcement Learning model from simulation to the real world, the performance could be unsatisfactory since the simulation cannot imitate the real world well in many circumstances. This results in a long period of…

Robotics · Computer Science 2023-09-19 Wenxing Liu , Hanlin Niu , Robert Skilton , Joaquin Carrasco

Learning generalizable robot manipulation policies, especially for complex multi-fingered humanoids, remains a significant challenge. Existing approaches primarily rely on extensive data collection and imitation learning, which are…

Robotics · Computer Science 2025-09-03 Toru Lin , Kartik Sachdev , Linxi Fan , Jitendra Malik , Yuke Zhu

Deep reinforcement learning enables algorithms to learn complex behavior, deal with continuous action spaces and find good strategies in environments with high dimensional state spaces. With deep reinforcement learning being an active area…

Machine Learning · Computer Science 2018-10-17 Winfried Lötzsch

Many industrial assembly tasks involve peg-in-hole like insertions with sub-millimeter tolerances which are challenging, even in highly calibrated robot cells. Visual servoing can be employed to increase the robustness towards uncertainties…

Robotics · Computer Science 2022-06-20 Rasmus Laurvig Haugaard , Anders Glent Buch , Thorbjørn Mosekjær Iversen

The study addresses the foundational and challenging task of peg-in-hole assembly in robotics, where misalignments caused by sensor inaccuracies and mechanical errors often result in insertion failures or jamming. This research introduces…

Robotics · Computer Science 2023-12-06 Geonhyup Lee , Joosoon Lee , Sangjun Noh , Minhwan Ko , Kangmin Kim , Kyoobin Lee

Deep reinforcement learning could be used to learn dexterous robotic policies but it is challenging to transfer them to new robots with vastly different hardware properties. It is also prohibitively expensive to learn a new policy from…

Robotics · Computer Science 2019-01-15 Tao Chen , Adithyavairavan Murali , Abhinav Gupta

Deep reinforcement learning provides a promising approach for vision-based control of real-world robots. However, the generalization of such models depends critically on the quantity and variety of data available for training. This data can…

Machine Learning · Computer Science 2019-02-12 Katie Kang , Suneel Belkhale , Gregory Kahn , Pieter Abbeel , Sergey Levine

We explore sim-to-real transfer of deep reinforcement learning controllers for a heavy vehicle with active suspensions designed for traversing rough terrain. While related research primarily focuses on lightweight robots with electric…

On robotics computer vision tasks, generating and annotating large amounts of data from real-world for the use of deep learning-based approaches is often difficult or even impossible. A common strategy for solving this problem is to apply…

Computer Vision and Pattern Recognition · Computer Science 2023-01-13 Chengzhi Wu , Xuelei Bi , Julius Pfrommer , Alexander Cebulla , Simon Mangold , Jürgen Beyerer

Enabling autonomous robots to interact in unstructured environments with dynamic objects requires manipulation capabilities that can deal with clutter, changes, and objects' variability. This paper presents a comparison of different…

Robotics · Computer Science 2019-02-01 Michel Breyer , Fadri Furrer , Tonci Novkovic , Roland Siegwart , Juan Nieto

Deep Reinforcement Learning (RL) has shown great success in learning complex control policies for a variety of applications in robotics. However, in most such cases, the hardware of the robot has been considered immutable, modeled as part…

Robotics · Computer Science 2020-11-10 Tianjian Chen , Zhanpeng He , Matei Ciocarlie

Sim-to-real transfer is a fundamental challenge in robot reinforcement learning. Discrepancies between simulation and reality can significantly impair policy performance, especially if it receives high-dimensional inputs such as dense depth…

Robotics · Computer Science 2025-05-20 Hang Yu , Christophe De Wagter , Guido C. H. E de Croon

Deep reinforcement learning has emerged as a promising and powerful technique for automatically acquiring control policies that can process raw sensory inputs, such as images, and perform complex behaviors. However, extending deep RL to…

Machine Learning · Computer Science 2017-06-09 Fereshteh Sadeghi , Sergey Levine